Skip to content

Instantly share code, notes, and snippets.

@vyuh

vyuh/sentence.sh

Last active November 24, 2015 17:34
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vyuh/825a6f4c691965674fbc to your computer and use it in GitHub Desktop.
Save vyuh/825a6f4c691965674fbc to your computer and use it in GitHub Desktop.
Download ZIP
Filter english text files to one sentence per line.
Raw
sentence.sh
perl -M'Lingua::EN::Sentence qw/get_sentences/' -00 -lne 'tr/\r\n \t/ /s;print join "\n", @{get_sentences $_};'
Raw
sentences.pl
#!/usr/bin/perl -M'Lingua::EN::Sentence qw/get_sentences/' -00 -ln
tr/\r\n \t/ /s;
print join "\n", @{get_sentences $_};
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment