Skip to content

Instantly share code, notes, and snippets.

@jazzwang

jazzwang/json-to-ndjson.md

Forked from bzerangue/json-to-ndjson.md
Created February 16, 2023 12:59
Show Gist options
  • Save jazzwang/69d57ac1af1388765c919684bc68373e to your computer and use it in GitHub Desktop.
Save jazzwang/69d57ac1af1388765c919684bc68373e to your computer and use it in GitHub Desktop.
Download ZIP
JSON to NDJSON
Raw
json-to-ndjson.md

NDJSON is a convenient format for storing or streaming structured data that may be processed one record at a time.

  • Each line is a valid JSON value
  • Line separator is ‘\n’

1. Convert JSON to NDJSON?

cat test.json | jq -c '.[]' > testNDJSON.json

With this simple line of code, you can convert and save files in NDJSON format.

Note: jq is a lightweight and flexible command-line JSON processor.
https://stedolan.github.io/jq/

Source: https://medium.com/datadriveninvestor/json-parsing-error-how-to-load-json-into-bigquery-successfully-using-ndjson-2b7d94616bcb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment