Skip to content

Instantly share code, notes, and snippets.

@ruseel

ruseel/parquet.clj

Created March 29, 2017 06:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ruseel/b16f191587f4278480d239dc71c5a0a1 to your computer and use it in GitHub Desktop.
Save ruseel/b16f191587f4278480d239dc71c5a0a1 to your computer and use it in GitHub Desktop.
Download ZIP
parquet clojure without mr
Raw
parquet.clj
;; writer
(ParquetWriter. path (ThriftWriteSupport. clazz))
;; reader
(ParquetReader. (Configuration.) path (ThriftReadSupport. clazz))
;; reader with filter
(ParquetReader. (doto (Configuration.)
(.set ThriftReadSupport/THRIFT_COLUMN_FILTER_KEY "eventId;eventName;actType;clientId;ifa;dt"))
path
(ThriftReadSupport. clazz))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment