Skip to content

Instantly share code, notes, and snippets.

@franzramadhan
Last active March 26, 2018 10:31
Show Gist options
  • Save franzramadhan/ef9cd0862c876bea20bc798e66e01a97 to your computer and use it in GitHub Desktop.
Save franzramadhan/ef9cd0862c876bea20bc798e66e01a97 to your computer and use it in GitHub Desktop.
Change newline into commas
[admin@tscredit-dedge ~]$ parquet-tools cat part-00000-c00f3303-2c93-467e-847d-6049e99980bf-c000.gz.parquet | awk '{print $3}'| awk NF | head -n 10 | sed ':a;N;$!ba;s/\n/,/g'
1245541338292,755914356949,1666447420906,841814584100,85899498045,103079686442,773095309528,704375532464,1348619892622,34737697829747
[admin@tscredit-dedge ~]$ parquet-tools cat part-00000-c00f3303-2c93-467e-847d-6049e99980bf-c000.gz.parquet | awk '{print $3}'| awk NF | head -n 10
1245541338292
755914356949
1666447420906
841814584100
85899498045
103079686442
773095309528
704375532464
1348619892622
34737697829747
### encoded with ' '
awk -F ',' '{print $2}' blacklist_20180325.csv | sed "s/ //g;s/.$/'/g; s/^./'/g" | sed ':a;N;$!ba;s/\n/,/g'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment