Create a gist now

Instantly share code, notes, and snippets.

LZO Indexing test in LZO Pail
;; After renaming files in Pail to have .lzo extension
user=> (def indexer (com.hadoop.compression.lzo.LzoIndexer. (org.apache.hadoop.conf.Configuration.)))
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
#'user/indexer
user=> indexer
#<LzoIndexer com.hadoop.compression.lzo.LzoIndexer@381eb0c6>
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5/9/1/2e"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5/9/1/2e/cons2efa060c-78d4-4145-aa8d-29850530cfab.lzo"))
nil
;; Can't see any index file ....
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment