Skip to content

Instantly share code, notes, and snippets.

View sharvaridhote's full-sized avatar

Sharvari Dhote sharvaridhote

View GitHub Profile
@mananai
mananai / user_classifier_full.ipynb
Created November 4, 2020 12:25
User classifier full code
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@omri374
omri374 / spacy_preprocessor.py
Created May 13, 2020 10:39
Text preprocessing using spaCy
import re
from typing import List
import spacy
from spacy.tokens import Doc
from tqdm import tqdm
class SpacyPreprocessor:
def __init__(
@ErikTromp
ErikTromp / train_emotions.py
Created March 9, 2020 07:56
text categorization with spacy-transformers
#!/usr/bin/env python
import plac
import re
import random
import json
import pandas as pd
from pathlib import Path
from collections import Counter
import thinc.extra.datasets
import spacy
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@ghl3
ghl3 / wiki_downloader.py
Last active May 1, 2023 16:36
Using python threading to download random wikipedia articles.
import time
import urllib2
import threading
from Queue import Queue
from random import choice
def get_random_article(namespace=None):
""" Download a random wikipiedia article"""
try: