Skip to content

Instantly share code, notes, and snippets.

@netinlet

netinlet/find_non_ascii_chars.sh

Created September 19, 2018 22:40
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save netinlet/dcbb2738b3917233e355edeb2459d881 to your computer and use it in GitHub Desktop.
Save netinlet/dcbb2738b3917233e355edeb2459d881 to your computer and use it in GitHub Desktop.
Download ZIP
Find non-ascii characters in file
Raw
find_non_ascii_chars.sh
# Found at https://superuser.com/questions/1002080/how-to-get-csvkit-to-recognise-long-ascii-lines
awk '/[^\x00-\x7F]/{ print NR ":", $0 }' data.csv | less
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment