Skip to content

Instantly share code, notes, and snippets.

@msikma

msikma/normalize_unicode.py

Created July 22, 2020 19:16
Show Gist options
  • Save msikma/4a26e8585e6075fd7dacf34f23b7af47 to your computer and use it in GitHub Desktop.
Save msikma/4a26e8585e6075fd7dacf34f23b7af47 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
normalize_unicode.py
#!/usr/bin/env python3
import unicodedata
with open('SLPS-01144+AREA17+A003.UNGAM_21.html', 'r') as file:
data = file.read()
norm = unicodedata.normalize('NFC', data)
with open('out.html', 'w') as file:
file.write(norm)
print('Done')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment