Skip to content

Instantly share code, notes, and snippets.

@myui

myui/gist:fc15755d1ab3ad1e3f2a

Created September 22, 2014 06:25
Show Gist options
  • Save myui/fc15755d1ab3ad1e3f2a to your computer and use it in GitHub Desktop.
Save myui/fc15755d1ab3ad1e3f2a to your computer and use it in GitHub Desktop.
Download ZIP
HDFS caching
Raw
gistfile1.md 
hdfs dfsadmin -report

# プールの作成
hdfs cacheadmin -addPool expr

#プールの削除
hdfs cacheadmin -removePool expr

# プールの確認
hdfs cacheadmin -listPools -statsa

# キャッシュへの追加
hdfs cacheadmin -addDirective -path /user/hive/warehouse/kdd12track2.db/training_orcfile -pool expr

# キャッシュへの追加 (TTL付き）
hdfs cacheadmin -addDirective -path /user/hive/warehouse/kdd12track2.db/training_orcfile -pool expr -ttl 30m
hdfs cacheadmin -addDirective -path /dataset/a9a/test -pool expr -ttl 30m

# エントリの確認
hdfs cacheadmin -listDirectives -stats

# キャッシュからの削除
hdfs cacheadmin -removeDirectives -path /user/hive/warehouse/kdd12track2.db/training_orcfile
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment