Skip to content

Instantly share code, notes, and snippets.

@cookedapple
Created January 2, 2013 09:05
Show Gist options
  • Save cookedapple/4433185 to your computer and use it in GitHub Desktop.
Save cookedapple/4433185 to your computer and use it in GitHub Desktop.
convert unicode chars to html (incomplete)
def latin1_to_html (unicrap):
"""This takes a UNICODE string and replaces Latin-1 characters with
something equivalent in html. It returns a plain ASCII string.
This function makes a best effort to convert Latin-1 characters into
ASCII equivalents. It does not just strip out the Latin-1 characters.
All characters in the standard 7-bit ASCII range are preserved.
In the 8th bit range all the Latin-1 accented letters are converted
to unaccented equivalents. Most symbol characters are converted to
something meaningful. Anything not converted is deleted.
"""
xlate={0xc0:'À', 0xc1:'Á', 0xc2:'Â', 0xc3:'Ã', 0xc4:'Ä', 0xc5:'Å',
0xc6:'Ae', 0xc7:'C',
0xc8:'È', 0xc9:'É', 0xca:'E', 0xcb:'E',
0xcc:'Ì', 0xcd:'Í', 0xce:'I', 0xcf:'I',
0xd0:'Th', 0xd1:'N',
0xd2:'Ò', 0xd3:'Ó', 0xd4:'O', 0xd5:'O', 0xd6:'O', 0xd8:'O',
0xd9:'Ù', 0xda:'Ù', 0xdb:'U', 0xdc:'U',
0xdd:'Y', 0xde:'th', 0xdf:'ss',
0xe0:'à', 0xe1:'á', 0xe2:'â', 0xe3:'ã', 0xe4:'ä', 0xe5:'å',
0xe6:'ae', 0xe7:'c',
0xe8:'è', 0xe9:'é', 0xea:'e', 0xeb:'e',
0xec:'ì', 0xed:'í', 0xee:'i', 0xef:'i',
0xf0:'th', 0xf1:'n',
0xf2:'ò', 0xf3:'ó', 0xf4:'o', 0xf5:'o', 0xf6:'o', 0xf8:'o',
0xf9:'ù', 0xfa:'ú', 0xfb:'u', 0xfc:'u',
0xfd:'y', 0xfe:'th', 0xff:'y',
0xa1:'!', 0xa2:'{cent}', 0xa3:'{pound}', 0xa4:'{currency}',
0xa5:'{yen}', 0xa6:'|', 0xa7:'{section}', 0xa8:'{umlaut}',
0xa9:'{C}', 0xaa:'{^a}', 0xab:'<<', 0xac:'{not}',
0xad:'-', 0xae:'{R}', 0xaf:'_', 0xb0:'{degrees}',
0xb1:'{+/-}', 0xb2:'{^2}', 0xb3:'{^3}', 0xb4:"'",
0xb5:'{micro}', 0xb6:'{paragraph}', 0xb7:'*', 0xb8:'{cedilla}',
0xb9:'{^1}', 0xba:'{^o}', 0xbb:'>>',
0xbc:'{1/4}', 0xbd:'{1/2}', 0xbe:'{3/4}', 0xbf:'?',
0xd7:'*', 0xf7:'/'
}
r = ''
for i in unicrap:
if xlate.has_key(ord(i)):
r += xlate[ord(i)]
elif ord(i) >= 0x80:
pass
else:
r += str(i)
return r
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment