Skip to content

Instantly share code, notes, and snippets.

@sente
Forked from jbarciauskas/unicode_safe_127.py
Created February 1, 2011 20:39
Show Gist options
  • Save sente/806610 to your computer and use it in GitHub Desktop.
Save sente/806610 to your computer and use it in GitHub Desktop.
import codecs
def unicode_safe_127(ss, debug=False):
"""safely handle strings with have ordinal values greater than 127
by escaping each value as appropriate.
if debug=True, log each conversion to stderr
"""
mys = ss
tos=[]
for i,s in enumerate(mys):
if ord(s)>127:
if debug:
sys.stderr.write(codecs.unicode_escape_encode(mys)[0] + "\n")
tos.append(codecs.unicode_escape_encode(s)[0])
else:
tos.append(s)
return "".join(tos)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment