Skip to content

Instantly share code, notes, and snippets.

@apg
Created September 2, 2010 13:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save apg/562255 to your computer and use it in GitHub Desktop.
Save apg/562255 to your computer and use it in GitHub Desktop.
#!/usr/bin/python
# -*- coding: utf-8 -*-
"""
Lingua::EN::Syllable::syllable() estimates the number of syllables in
the word passed to it.
Note that it isn't entirely accurate... it fails (by one syllable) for
about 10-15% of my /usr/dict/words. The only way to get a 100% accurate
count is to do a dictionary lookup, so this is a small and fast alternative
where more-or-less accurate results will suffice, such as estimating the
reading level of a document.
I welcome pointers to more accurate algorithms, since this one is
pretty quick-and-dirty. This was designed for English (well, American
at least) words, but sometimes guesses well for other languages.
KNOWN LIMITATIONS
Accuracy for words with non-alpha characters is somewhat undefined.
In general, punctuation characters, et al, should be trimmed off before
handing the word to syllable(), and hyphenated compounds should be broken
into their separate parts.
Syllables for all-digit words (eg, "1998"; some call them "numbers") are
often counted as the number of digits. A cooler solution would be converting
"1998" to "nineteen eighty eight" (or "one thousand nine hundred eighty
eight", or...), but that is left as an exercise for the reader.
Contractions are not well supported.
Compound words (like "lifeboat"), where the first word ends in a silent 'e'
are counted with an extra syllable.
COPYRIGHT
Distributed under the same terms as Perl.
Contact the author with any questions.
AUTHOR
Greg Fast
Dispenser (python port)
Andrew Gwozdziewycz (mods to python port)
"""
__version__ = '0.251';
# note that this is not infallible. it does fail for some percentage of
# words (10% seems a good guess)... so it's useful for approximation, but
# don't use this for running your nuclear reactor...
import re
# basic algortithm:
# each vowel-group indicates a syllable, except for:
# final (silent) e
# 'ia' ind two syl
# @AddSyl and @SubSyl list regexps to massage the basic count.
# Each match from @AddSyl adds 1 to the basic count, each @SubSyl match -1
# Keep in mind that when the regexps are checked, any final 'e' will have
# been removed, and all '\'' will have been removed.
SubSyl = (
'cial',
'tia',
'cius',
'cious',
'giu', # belgium!
'ion',
'iou',
'sia$',
'.ely$', # absolutely! (but not ely!)
)
AddSyl = (
'ia',
'riet',
'dien',
'iu',
'io',
'ii',
'[aeiouym]bl$', # -Vble, plus -mble
'[aeiou]{3}', # agreeable
'^mc',
'ism$', # -isms
'([^aeiouy])\1l$', # middle twiddle battle bottle, etc.
'[^l]lien', # alien, salient [1]
'^coa[dglx].', # [2]
'[^gq]ua[^auieo]', # i think this fixes more than it breaks
'dnt$', # couldn't
)
# (comments refer to titan's /usr/dict/words)
# [1] alien, salient, but not lien or ebbullient...
# (those are the only 2 exceptions i found, there may be others)
# [2] exception for 7 words:
# coadjutor coagulable coagulate coalesce coalescent coalition coaxial
#----------------------------------------
def syllable(word):
print word,
word = word.lower()
word = word.replace('\'', '') # fold contractions. not very effective.
word = re.sub(r'e$', '', word); # strip trailing "e"s
scrugg = re.split(r'[^aeiouy]+', word); # '-' should perhaps be added?
for i in scrugg:
if not i:
scrugg.remove(i)
syl = 0;
# special cases
for syll in SubSyl:
if re.search(syll, word): syl -= 1
for syll in AddSyl:
if re.search(syll, word): syl += 1
if len(word) == 1:
syl +=1 # 'x'
else:
# count vowel groupings
syl += len(scrugg)
print (syl or 1)
return (syl or 1) # got no vowels? ("the", "crwth")
def is_haiku(sent, seperator=' / '):
sentences = sent.split(seperator)
syls = []
for s in sentences:
words = re.split('[ ,.;:?#-]+', s)
print words
a = sum(syllable(x) for x in words if len(x) > 0)
syls.append(a)
print syls
return syls == [5, 7, 5]
print is_haiku("serious question / venture capital for banks? / i might be baffled")
print is_haiku("tweeting in #haiku / a pleasant surprise for all / when will i tire?")
print is_haiku("forgot about that / a reminder came to me / an email of course")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment