Text Statistics Coding Tips.ipynb

{
 "worksheets": [
  {
   "cells": [
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "##Being Divisive\n\nThis is just a little \"gotcha\" to watch out for in python 2.7.  Can you predict what will happen in the following code before you run it?"
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "nums = [2,4,6]\n[2/n for n in nums]",
     "prompt_number": 1,
     "outputs": [
      {
       "text": "[1, 0, 0]",
       "output_type": "pyout",
       "metadata": {},
       "prompt_number": 1
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "Why did this happen? "
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "Python is treating this as integers."
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "There are ways to fix this:\n* 2.0/n\n* 2/float(n)\n* `from __future__ import division`  #get it from python 3.x\n"
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "## Let Me Enumerate The Ways\n\nSay your ischool project partner gave you a list of stuff to you.  It's in priority order already but you want each item to be numbered in order, you know, first do ANLP reading, then do ANLP homework, then do ANLP corpus selection, and oh yeah, maybe then do something for 202 and TUI.  So you start with a list like \n> todo = ['anlp_reading', 'anlp_homework', 'anlp_corpus', '202_reading', 'tui_homework', 'tui_project'] \n\nand you want to turn it into \n\n> [(0, 'anlp_reading'), (1, 'anlp_homework'), (2,'anlp_corpus'), (3, '202_reading'), (4, 'tui_homework'), (5, 'tui_project')]\n\nBelow, write code for a standard way to do this, either with a for loop or a list comprehension."
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "todo = ['anlp_reading', 'anlp_homework', 'anlp_corpus', '202_reading', 'tui_homework', \n        'tui_project']\n[(i,todo[i]) for i in range(len(todo))]",
     "prompt_number": 3,
     "outputs": [
      {
       "text": "[(0, 'anlp_reading'),\n (1, 'anlp_homework'),\n (2, 'anlp_corpus'),\n (3, '202_reading'),\n (4, 'tui_homework'),\n (5, 'tui_project')]",
       "output_type": "pyout",
       "metadata": {},
       "prompt_number": 3
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "Now here is the handy quick little way to do this faster: enumerate!  This produces an iterator object, so to see its output all at once, wrap a list() around it, e.g, \n> list(enumerate(todo))\n"
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "## Word (parts) Are Cheap \n\nIn English we can determine a lot of information about word forms by looking at the endings of the words.  Python makes this very easy to do.  For example, words that end in \"ing\" are often gerunds or else present participles.  (The [gerund](http://www.edufind.com/english/grammar/gerund.php) has the same function as a noun but looks like a verb.  The  [present particle](http://www.edufind.com/english/grammar/present_participle.php) is part of present tense.)  Below, the code loads the text files from NLTK as described in Chapter 1.\n\nChoose one of the texts and write one line of code that pulls out all words that end in 'ing' from that text file.  (Hint: there is a special string command that does just what you want.)\n"
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "import nltk\nfrom nltk.book import *",
     "prompt_number": 4,
     "outputs": [
      {
       "output_type": "stream",
       "text": "*** Introductory Examples for the NLTK Book ***\nLoading text1, ..., text9 and sent1, ..., sent9\nType the name of the text or sentence to view it.\nType: 'texts()' or 'sents()' to list the materials.\ntext1:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " Moby Dick by Herman Melville 1851\ntext2:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " Sense and Sensibility by Jane Austen 1811\ntext3:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " The Book of Genesis\ntext4:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " Inaugural Address Corpus\ntext5:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " Chat Corpus\ntext6: Monty Python and the Holy Grail\ntext7:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " Wall Street Journal\ntext8: Personals Corpus\ntext9:",
       "stream": "stdout"
      },
      {
       "output_type": "stream",
       "text": " The Man Who Was Thursday by G . K . Chesterton 1908\n",
       "stream": "stdout"
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "{w for w in text4 if w[-3:] == 'ing'}",
     "prompt_number": 7,
     "outputs": [
      {
       "text": "{'Abhorring',\n 'Acting',\n 'Advancing',\n 'Appreciating',\n 'Assessing',\n 'Assuring',\n 'Being',\n 'Believing',\n 'Claiming',\n 'Conceiving',\n 'Considering',\n 'Contemplating',\n 'Descending',\n 'Discouraging',\n 'Doing',\n 'During',\n 'Encountering',\n 'Encouraging',\n 'Ending',\n 'Entering',\n 'Existing',\n 'Experiencing',\n 'Following',\n 'Founding',\n 'Growing',\n 'Having',\n 'Honoring',\n 'Indulging',\n 'King',\n 'Knowing',\n 'Laboring',\n 'Looking',\n 'Magnifying',\n 'Nothing',\n 'Notwithstanding',\n 'Overlooking',\n 'Passing',\n 'Peking',\n 'Penetrating',\n 'Perceiving',\n 'Possessing',\n 'Proceeding',\n 'Putting',\n 'Realizing',\n 'Recognizing',\n 'Reflecting',\n 'Relying',\n 'Removing',\n 'Respecting',\n 'Resting',\n 'Returning',\n 'Seeking',\n 'Something',\n 'Standing',\n 'Starting',\n 'Tapping',\n 'Unwilling',\n 'Xpreparing',\n 'abiding',\n 'abolishing',\n 'abounding',\n 'abridging',\n 'absorbing',\n 'abstaining',\n 'accepting',\n 'accomplishing',\n 'according',\n 'accruing',\n 'achieving',\n 'acknowledging',\n 'acquiring',\n 'acting',\n 'adding',\n 'addressing',\n 'adjusting',\n 'administering',\n 'admitting',\n 'adopting',\n 'adoring',\n 'advancing',\n 'affecting',\n 'affording',\n 'agitating',\n 'agonizing',\n 'agreeing',\n 'allocating',\n 'alluring',\n 'amending',\n 'animating',\n 'anticipating',\n 'anything',\n 'appalling',\n 'appealing',\n 'appearing',\n 'applying',\n 'appointing',\n 'appreciating',\n 'approaching',\n 'approving',\n 'arising',\n 'arresting',\n 'arriving',\n 'ascertaining',\n 'asking',\n 'assisting',\n 'assuming',\n 'astonishing',\n 'astounding',\n 'attaining',\n 'attempting',\n 'attending',\n 'attributing',\n 'auguring',\n 'authorizing',\n 'averting',\n 'avoiding',\n 'avowing',\n 'awaiting',\n 'balancing',\n 'banking',\n 'bearing',\n 'beating',\n 'becoming',\n 'befitting',\n 'beginning',\n 'being',\n 'belaboring',\n 'believing',\n 'belonging',\n 'benefiting',\n 'beseeching',\n 'bickering',\n 'bidding',\n 'binding',\n 'blessing',\n 'blowing',\n 'bordering',\n 'borrowing',\n 'breaking',\n 'breathing',\n 'bring',\n 'bringing',\n 'broadening',\n 'buccaneering',\n 'building',\n 'burthening',\n 'calculating',\n 'calling',\n 'caring',\n 'carrying',\n 'casting',\n 'causing',\n 'ceasing',\n 'cementing',\n 'changing',\n 'checking',\n 'cheering',\n 'choosing',\n 'circulating',\n 'claiming',\n 'clinching',\n 'cling',\n 'closing',\n 'clothing',\n 'coaling',\n 'combining',\n 'coming',\n 'commanding',\n 'commencing',\n 'commending',\n 'committing',\n 'communicating',\n 'compelling',\n 'competing',\n 'composing',\n 'comprehending',\n 'conceiving',\n 'concentrating',\n 'concerning',\n 'concluding',\n 'condemning',\n 'condescending',\n 'conducting',\n 'conferring',\n 'confiding',\n 'conflicting',\n 'conforming',\n 'confronting',\n 'conquering',\n 'conserving',\n 'considering',\n 'consisting',\n 'consoling',\n 'constituting',\n 'constructing',\n 'consulting',\n 'consummating',\n 'containing',\n 'contemplating',\n 'contending',\n 'continuing',\n 'contracting',\n 'contriving',\n 'controlling',\n 'convening',\n 'converging',\n 'cooperating',\n 'corresponding',\n 'corrupting',\n 'counting',\n 'covering',\n 'craving',\n 'creating',\n 'cruising',\n 'crushing',\n 'cutting',\n 'daring',\n 'dawning',\n 'dealing',\n 'deciding',\n 'declaring',\n 'declining',\n 'decoding',\n 'decreasing',\n 'deepening',\n 'defaulting',\n 'defending',\n 'defining',\n 'degrading',\n 'deliberating',\n 'delivering',\n 'demanding',\n 'demoralizing',\n 'denying',\n 'depending',\n 'deriving',\n 'descending',\n 'deserving',\n 'designing',\n 'desiring',\n 'destroying',\n 'determining',\n 'developing',\n 'devising',\n 'devoting',\n 'differentiating',\n 'differing',\n 'diminishing',\n 'directing',\n 'disappearing',\n 'discarding',\n 'discharging',\n 'discountenancing',\n 'discovering',\n 'discrediting',\n 'discriminating',\n 'discussing',\n 'disorganizing',\n 'displaying',\n 'disposing',\n 'dissenting',\n 'distinguishing',\n 'distressing',\n 'disturbing',\n 'diverting',\n 'doing',\n 'doubting',\n 'draining',\n 'drawing',\n 'drifting',\n 'driving',\n 'during',\n 'dying',\n 'easing',\n 'ebbing',\n 'embarking',\n 'embarrassing',\n 'embracing',\n 'emerging',\n 'emigrating',\n 'encouraging',\n 'encroaching',\n 'endearing',\n 'ending',\n 'enduring',\n 'enforcing',\n 'engaging',\n 'enhancing',\n 'enjoying',\n 'enlarging',\n 'enlightening',\n 'ennobling',\n 'enriching',\n 'entailing',\n 'entangling',\n 'entering',\n 'enterprising',\n 'entertaining',\n 'equipping',\n 'escaping',\n 'establishing',\n 'evening',\n 'everything',\n 'exacting',\n 'exceeding',\n 'excepting',\n 'exciting',\n 'executing',\n 'exercising',\n 'exhausting',\n 'exhibiting',\n 'existing',\n 'expanding',\n 'expecting',\n 'expiring',\n 'explaining',\n 'exploring',\n 'exposing',\n 'expressing',\n 'extending',\n 'extenuating',\n 'exterminating',\n 'facilitating',\n 'facing',\n 'failing',\n 'falling',\n 'farthing',\n 'fashioning',\n 'fearing',\n 'feeling',\n 'fighting',\n 'financing',\n 'finding',\n 'finishing',\n 'firing',\n 'fitting',\n 'fixing',\n 'flattering',\n 'fleeting',\n 'flocking',\n 'flourishing',\n 'flowing',\n 'following',\n 'fomenting',\n 'footing',\n 'forbearing',\n 'forbidding',\n 'foreboding',\n 'foregoing',\n 'forgetting',\n 'forging',\n 'forming',\n 'formulating',\n 'fostering',\n 'founding',\n 'framing',\n 'freeing',\n 'freezing',\n 'frowning',\n 'fulfilling',\n 'furnishing',\n 'gaining',\n 'gaping',\n 'gathering',\n 'giving',\n 'going',\n 'governing',\n 'granting',\n 'grasping',\n 'gratifying',\n 'grinding',\n 'groping',\n 'growing',\n 'grudging',\n 'guarding',\n 'guiding',\n 'hanging',\n 'hardworking',\n 'harnessing',\n 'having',\n 'heading',\n 'healing',\n 'hearing',\n 'heartening',\n 'helping',\n 'hiding',\n 'hiring',\n 'holding',\n 'hoping',\n 'housing',\n 'humiliating',\n 'hushing',\n 'igniting',\n 'imitating',\n 'impairing',\n 'impending',\n 'imposing',\n 'impoverishing',\n 'improving',\n 'inclining',\n 'including',\n 'incoming',\n 'increasing',\n 'inculcating',\n 'incurring',\n 'indicating',\n 'inducing',\n 'infusing',\n 'inheriting',\n 'injuring',\n 'insisting',\n 'inspiring',\n 'insuring',\n 'interesting',\n 'interfering',\n 'interposing',\n 'intersecting',\n 'intervening',\n 'invading',\n 'inviting',\n 'invoking',\n 'involving',\n 'irritating',\n 'jarring',\n 'keeping',\n 'killing',\n 'king',\n 'knowing',\n 'laboring',\n 'lacking',\n 'languishing',\n 'lasting',\n 'laying',\n 'leading',\n 'learning',\n 'leaving',\n 'lending',\n 'lessening',\n 'levying',\n 'liberating',\n 'lifting',\n 'lightening',\n 'lightning',\n 'limiting',\n 'living',\n 'lodging',\n 'longing',\n 'looking',\n 'losing',\n 'loving',\n 'luring',\n 'lurking',\n 'lying',\n 'mailing',\n 'maintaining',\n 'making',\n 'manifesting',\n 'manufacturing',\n 'maturing',\n 'meaning',\n 'meeting',\n 'menacing',\n 'mingling',\n 'mining',\n 'missing',\n 'misunderstanding',\n 'mortgaging',\n 'moving',\n 'multiplying',\n 'nagging',\n 'narrowing',\n 'naturalizing',\n 'nearing',\n 'needing',\n 'neighboring',\n 'nothing',\n 'noting',\n 'obeying',\n 'obliging',\n 'observing',\n 'obtaining',\n 'obtruding',\n 'occupying',\n 'offering',\n 'offspring',\n 'omitting',\n 'opening',\n 'operating',\n 'opposing',\n 'oppressing',\n 'ordaining',\n 'originating',\n 'outgoing',\n 'outlawing',\n 'outrunning',\n 'outstanding',\n 'overflowing',\n 'overruling',\n 'overturning',\n 'overwhelming',\n 'owing',\n 'owning',\n 'pardoning',\n 'partaking',\n 'participating',\n 'passing',\n 'paying',\n 'pending',\n 'perfecting',\n 'performing',\n 'permitting',\n 'perpetuating',\n 'persevering',\n 'persuading',\n 'pervading',\n 'piercing',\n 'pitching',\n 'placing',\n 'planning',\n 'planting',\n 'pleading',\n 'pleasing',\n 'pledging',\n 'possessing',\n 'preceding',\n 'predominating',\n 'preparing',\n 'presaging',\n 'prescribing',\n 'presenting',\n 'preserving',\n 'presiding',\n 'pressing',\n 'prevailing',\n 'preventing',\n 'preying',\n 'probing',\n 'proceeding',\n 'proclaiming',\n 'producing',\n 'progressing',\n 'prohibiting',\n 'promising',\n 'promoting',\n 'propagating',\n 'protecting',\n 'providing',\n 'provoking',\n 'purchasing',\n 'purloining',\n 'pursuing',\n 'pushing',\n 'putting',\n 'questing',\n 'questioning',\n 'racing',\n 'raging',\n 'raising',\n 'rating',\n 'reaching',\n 'reaffirming',\n 'realizing',\n 'reasoning',\n 'reassuring',\n 'rebuilding',\n 'receding',\n 'receiving',\n 'reckoning',\n 'reclaiming',\n 'recognizing',\n 'recommending',\n 'reconciling',\n 'reconnecting',\n 'recovering',\n 'recruiting',\n 'recurring',\n 'reducing',\n 'referring',\n 'reflecting',\n 'reforming',\n 'refunding',\n 'refusing',\n 'regaining',\n 'regarding',\n 'regulating',\n 'rejecting',\n 'rejoicing',\n 'rekindling',\n 'relying',\n 'remaining',\n 'remaking',\n 'remembering',\n 'removing',\n 'remunerating',\n 'rendering',\n 'renewing',\n 'repeating',\n 'repelling',\n 'representing',\n 'requiring',\n 'residing',\n 'resorting',\n 'resounding',\n 'respecting',\n 'resting',\n 'restoring',\n 'restraining',\n 'restricting',\n 'resulting',\n 'retaining',\n 'returning',\n 'revealing',\n 'revising',\n 'reviving',\n 'rewarding',\n 'ridding',\n 'riding',\n 'rising',\n 'roaming',\n 'robbing',\n 'rolling',\n 'ruling',\n 'sacrificing',\n 'safeguarding',\n 'sailing',\n 'sanctioning',\n 'sapping',\n 'satisfying',\n 'saving',\n 'saying',\n 'scheming',\n 'scorning',\n 'searching',\n 'securing',\n 'seeing',\n 'seeking',\n 'seizing',\n 'sending',\n 'sentimentalizing',\n 'separating',\n 'serving',\n 'settling',\n 'shaking',\n 'shaping',\n 'sharing',\n 'shielding',\n 'shining',\n 'shirking',\n 'shortening',\n 'shouting',\n 'showering',\n 'shrinking',\n 'signifying',\n 'silencing',\n 'sing',\n 'sinking',\n 'sitting',\n 'slaughtering',\n 'slaveholding',\n 'sleeping',\n 'slipping',\n 'sloping',\n 'smelting',\n 'solving',\n 'something',\n 'sparing',\n 'speaking',\n 'specifying',\n 'spending',\n 'spiraling',\n 'spreading',\n 'spring',\n 'springing',\n 'squandering',\n 'staggering',\n 'stamping',\n 'standing',\n 'stating',\n 'stilling',\n 'stimulating',\n 'stopping',\n 'strengthening',\n 'stretching',\n 'striking',\n 'striving',\n 'struggling',\n 'studying',\n 'stunning',\n 'submitting',\n 'substituting',\n 'succeeding',\n 'suffering',\n 'suggesting',\n 'supervising',\n 'supplicating',\n 'supplying',\n 'supporting',\n 'suppressing',\n 'surging',\n 'surmounting',\n 'surpassing',\n 'surveying',\n 'surviving',\n 'sustaining',\n 'swarming',\n 'swearing',\n 'sweeping',\n 'symbolizing',\n 'taking',\n 'talking',\n 'taxing',\n 'teaching',\n 'teeming',\n 'telling',\n 'tempering',\n 'tendering',\n 'tending',\n 'terrifying',\n 'testifying',\n 'thing',\n 'thinking',\n 'thirsting',\n 'threatening',\n 'thrilling',\n 'thriving',\n 'throwing',\n 'tiring',\n 'toiling',\n 'touching',\n 'tracing',\n 'trading',\n 'training',\n 'transcending',\n 'translating',\n 'traversing',\n 'treading',\n 'treating',\n 'trembling',\n 'trifling',\n 'trusting',\n 'trying',\n 'turning',\n 'unbending',\n 'unceasing',\n 'unchanging',\n 'uncomplaining',\n 'uncompromising',\n 'undergoing',\n 'understanding',\n 'undertaking',\n 'undeviating',\n 'undoing',\n 'unerring',\n 'unfailing',\n 'unfaltering',\n 'unfeeling',\n 'unflinching',\n 'unfolding',\n 'unfurling',\n 'ungrudging',\n 'unifying',\n 'uninspiring',\n 'uninteresting',\n 'unknowing',\n 'unquestioning',\n 'unreasoning',\n 'untrusting',\n 'unwavering',\n 'unwilling',\n 'upbuilding',\n 'upholding',\n 'uprooting',\n 'urging',\n 'ushering',\n 'using',\n 'uttering',\n 'varying',\n 'viewing',\n 'vitalizing',\n 'voting',\n 'waging',\n 'waiting',\n 'wanting',\n 'warming',\n 'warning',\n 'watching',\n 'wavering',\n 'weakening',\n 'weaving',\n 'wellspring',\n 'widening',\n 'willing',\n 'winding',\n 'winning',\n 'wishing',\n 'working',\n 'wringing',\n 'writing',\n 'wrongdoing',\n 'yearning',\n 'yielding'}",
       "output_type": "pyout",
       "metadata": {},
       "prompt_number": 7
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "Look at the results and try to see what you can tell, without context, about those words -- are they nouns, gerunds, present participles, something else?"
    },
    {
     "metadata": {},
     "cell_type": "markdown",
     "source": "## The Words Get In the Way\n\nIn the homework we looked a bit at how to get rid of some of the noise from a list of frequent words.  Some standard approaches are to:\n* remove punctuation\n* lowercase words\n* stem words, or otherwise normalize them (e.g., convert to their infinitives or singular forms)\n* remove very common words (stopwords)\n\nThese are all fine things to do.  An additional idea is to **compare the common words from one collection to those of another** and see how they differ.  Those that differ but are still very common are probably quite interesting and signify something special about that collection, especially after some simple normalization steps.\n\nTo try this out, do the following steps: \n 1. Create frequency distributions fd1 and fd2 from the contents of two different NLTK texts text1 and text2 (you can choose which texts you want to work with).\n 2. Compare the keys in the top 50 (or 100 or 200) most frequent keys for these two collections.  So compare the keys from fd1 to those from fd2 and vice versa.  You should see different words pop out in each comparison.\n  \n\n"
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "fd1 = set(FreqDist(text1).keys()[:100])\nfd2 = set(FreqDist(text2).keys()[:100])\nintersect = fd1 & fd2\nintersect",
     "prompt_number": 9,
     "outputs": [
      {
       "text": "{'!',\n '\"',\n \"'\",\n ',',\n '-',\n '--',\n '.',\n '.\"',\n ';',\n 'But',\n 'I',\n 'The',\n 'a',\n 'all',\n 'an',\n 'and',\n 'any',\n 'are',\n 'as',\n 'at',\n 'be',\n 'been',\n 'but',\n 'by',\n 'for',\n 'from',\n 'had',\n 'have',\n 'he',\n 'her',\n 'him',\n 'his',\n 'if',\n 'in',\n 'is',\n 'it',\n 'me',\n 'more',\n 'my',\n 'no',\n 'not',\n 'now',\n 'of',\n 'on',\n 'one',\n 'only',\n 'or',\n 's',\n 'so',\n 'such',\n 'than',\n 'that',\n 'the',\n 'their',\n 'them',\n 'there',\n 'they',\n 'this',\n 'time',\n 'to',\n 'very',\n 'was',\n 'were',\n 'what',\n 'when',\n 'which',\n 'who',\n 'will',\n 'with',\n 'would',\n 'you'}",
       "output_type": "pyout",
       "metadata": {},
       "prompt_number": 9
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "fd1not2 = fd1 - fd2\nfd1not2",
     "prompt_number": 10,
     "outputs": [
      {
       "text": "{'!\"',\n '?',\n 'Ahab',\n 'And',\n 'It',\n 'about',\n 'boat',\n 'down',\n 'head',\n 'into',\n 'its',\n 'like',\n 'long',\n 'man',\n 'old',\n 'other',\n 'out',\n 'over',\n 'sea',\n 'ship',\n 'some',\n 'then',\n 'these',\n 'though',\n 'up',\n 'upon',\n 'we',\n 'whale',\n 'ye'}",
       "output_type": "pyout",
       "metadata": {},
       "prompt_number": 10
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "fd2not1 = fd2 - fd1\nfd2not1",
     "prompt_number": 11,
     "outputs": [
      {
       "text": "{',\"',\n '?\"',\n 'Dashwood',\n 'Edward',\n 'Elinor',\n 'Jennings',\n 'Marianne',\n 'Miss',\n 'Mrs',\n 'She',\n 'Willoughby',\n 'am',\n 'could',\n 'did',\n 'do',\n 'every',\n 'herself',\n 'know',\n 'might',\n 'mother',\n 'much',\n 'must',\n 'own',\n 'said',\n 'she',\n 'should',\n 'sister',\n 'think',\n 'your'}",
       "output_type": "pyout",
       "metadata": {},
       "prompt_number": 11
      }
     ],
     "language": "python",
     "trusted": true,
     "collapsed": false
    },
    {
     "metadata": {},
     "cell_type": "code",
     "input": "",
     "outputs": [],
     "language": "python",
     "trusted": true,
     "collapsed": false
    }
   ],
   "metadata": {}
  }
 ],
 "metadata": {
  "name": "",
  "signature": "sha256:c2f4cb274a0811d390680d090ef9df4b6a152004abbcb28b4b2b7e9f64afdc3b"
 },
 "nbformat": 3
}