Embed URL


SSH clone URL

You can clone with HTTPS or SSH.

Download Gist

Find Python string literals that should probably be Unicode

View gist:7394412
1 2 3 4 5 6 7 8 9 10 11 12
import ast, _ast, os
for root, dirs, files in os.walk('.'):
for name in files:
if name.endswith('.py'):
full = os.path.join(root, name)
t = ast.parse(open(full).read())
for n in ast.walk(t):
if isinstance(n, _ast.Str) and not isinstance(n.s, unicode):
if any(ord(c) > 127 for c in n.s.decode('utf-8')):
print full, 'line', n.lineno, 'col', n.col_offset, ':', n.s.decode('utf-8')

You could have marked it as Python source, so we could get syntax highlighting :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.