public
Created

LZO Indexing test in LZO Pail

  • Download Gist
gistfile1.clj
Clojure
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
;; After renaming files in Pail to have .lzo extension
user=> (def indexer (com.hadoop.compression.lzo.LzoIndexer. (org.apache.hadoop.conf.Configuration.)))
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
#'user/indexer
user=> indexer
#<LzoIndexer com.hadoop.compression.lzo.LzoIndexer@381eb0c6>
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5/9/1/2e"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5/9/1/2e/cons2efa060c-78d4-4145-aa8d-29850530cfab.lzo"))
nil
 
;; Can't see any index file ....

Please sign in to comment on this gist.

Something went wrong with that request. Please try again.