Skip to content

Instantly share code, notes, and snippets.

View sharvaridhote's full-sized avatar

Sharvari Dhote sharvaridhote

View GitHub Profile
@ghl3
ghl3 / wiki_downloader.py
Last active May 1, 2023 16:36
Using python threading to download random wikipedia articles.
import time
import urllib2
import threading
from Queue import Queue
from random import choice
def get_random_article(namespace=None):
""" Download a random wikipiedia article"""
try:
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ErikTromp
ErikTromp / train_emotions.py
Created March 9, 2020 07:56
text categorization with spacy-transformers
#!/usr/bin/env python
import plac
import re
import random
import json
import pandas as pd
from pathlib import Path
from collections import Counter
import thinc.extra.datasets
import spacy
@omri374
omri374 / spacy_preprocessor.py
Created May 13, 2020 10:39
Text preprocessing using spaCy
import re
from typing import List
import spacy
from spacy.tokens import Doc
from tqdm import tqdm
class SpacyPreprocessor:
def __init__(
@mananai
mananai / user_classifier_full.ipynb
Created November 4, 2020 12:25
User classifier full code
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.