Skip to content

Instantly share code, notes, and snippets.

@FeryET

FeryET/clean_data.py

Created August 26, 2020 11:01
Show Gist options
  • Save FeryET/05d09d34c71bd9500e6c4f569f70064e to your computer and use it in GitHub Desktop.
Save FeryET/05d09d34c71bd9500e6c4f569f70064e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
clean_data.py
processor = SpacyCleaner(chunksize=1000, workers=workers)
docs = processor.transform(raw_docs)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment