Skip to content

Instantly share code, notes, and snippets.

@lelayf
Created April 27, 2012 13:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save lelayf/2509510 to your computer and use it in GitHub Desktop.
Save lelayf/2509510 to your computer and use it in GitHub Desktop.
LZO Indexing test in LZO Pail
;; After renaming files in Pail to have .lzo extension
user=> (def indexer (com.hadoop.compression.lzo.LzoIndexer. (org.apache.hadoop.conf.Configuration.)))
log4j:WARN No appenders could be found for logger (org.apache.hadoop.conf.Configuration).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
#'user/indexer
user=> indexer
#<LzoIndexer com.hadoop.compression.lzo.LzoIndexer@381eb0c6>
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5/9/1/2e"))
nil
user=> (.index indexer (org.apache.hadoop.fs.Path. "/tmp/data5/9/1/2e/cons2efa060c-78d4-4145-aa8d-29850530cfab.lzo"))
nil
;; Can't see any index file ....
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment