Skip to content

Instantly share code, notes, and snippets.

View benjaminsims's full-sized avatar

Benjamin Sims benjaminsims

View GitHub Profile

Keybase proof

I hereby claim:

  • I am benjaminsims on github.
  • I am benjaminsims (https://keybase.io/benjaminsims) on keybase.
  • I have a public key ASCum4O0LI_7miZriUIdmxpBfWeL8d49Zyf6XUJDG-iOwAo

To claim this, I am signing this object:

import apache_beam as beam
from apache_beam.utils.pipeline_options import PipelineOptions
from beam_utils.sources import JsonLinesFileSource
options = PipelineOptions()
p = beam.Pipeline(options=options)
lines = (
p | 'ReadDirectoryData' >> beam.Read(
JsonLinesFileSource('/tmp/random.jsonl'))
{"word":"uneschewed"}
{"word":"ancestorially"}
{"word":"pooler"}
{"word":"hydrorrhachis"}
{"word":"attainableness"}
{"word":"Ancylus"}
{"word":"unflexibly"}
{"word":"spagyrical"}
{"word":"contraindicative"}
{"word":"microanalyst"}