Created
July 29, 2014 22:52
-
-
Save apple-corps/80667388cc7bfd9dea4d to your computer and use it in GitHub Desktop.
Can't import data into hbase from hdfs using hbase.jar
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [root@rhel1 hadoop-hdfs]# sudo -u hdfs hadoop jar /usr/lib/hbase/hbase.jar import AuthorDetailsMd5 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/ | |
| 2014-07-29 15:25:37,480 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.df.interval is deprecated. Instead, use fs.df.interval | |
| 2014-07-29 15:25:37,493 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects | |
| 2014-07-29 15:25:37,494 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available | |
| 2014-07-29 15:25:37,494 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir | |
| 2014-07-29 15:25:37,494 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir | |
| 2014-07-29 15:25:37,494 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.default.name is deprecated. Instead, use fs.defaultFS | |
| 2014-07-29 15:25:37,494 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir | |
| 2014-07-29 15:25:37,495 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.block.size is deprecated. Instead, use dfs.blocksize | |
| 2014-07-29 15:25:37,495 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision | |
| 2014-07-29 15:25:37,495 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min | |
| 2014-07-29 15:25:37,495 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir | |
| 2014-07-29 15:25:37,495 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad | |
| 2014-07-29 15:25:37,495 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec | |
| 2014-07-29 15:25:37,498 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct | |
| 2014-07-29 15:25:37,498 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address | |
| 2014-07-29 15:25:37,499 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore | |
| 2014-07-29 15:25:37,501 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource | |
| 2014-07-29 15:25:37,501 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address | |
| 2014-07-29 15:25:37,501 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval | |
| 2014-07-29 15:25:37,506 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir | |
| 2014-07-29 15:25:37,507 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size | |
| 2014-07-29 15:25:37,511 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup | |
| 2014-07-29 15:25:37,511 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.federation.nameservices is deprecated. Instead, use dfs.nameservices | |
| 2014-07-29 15:25:37,512 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args | |
| 2014-07-29 15:25:37,512 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address | |
| 2014-07-29 15:25:37,512 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period | |
| 2014-07-29 15:25:37,512 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl | |
| 2014-07-29 15:25:37,513 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum | |
| Exception in thread "main" java.lang.reflect.InvocationTargetException | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:51) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.util.RunJar.main(RunJar.java:208) | |
| Caused by: java.io.IOException: java.lang.RuntimeException: java.io.IOException: No such file or directory | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:521) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:472) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:438) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:381) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:318) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:288) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:271) | |
| at org.apache.hadoop.hbase.mapreduce.Import.createSubmittableJob(Import.java:177) | |
| at org.apache.hadoop.hbase.mapreduce.Import.main(Import.java:205) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) | |
| at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) | |
| ... 10 more | |
| Caused by: java.lang.RuntimeException: java.io.IOException: No such file or directory | |
| at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:164) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:518) | |
| ... 24 more | |
| Caused by: java.io.IOException: No such file or directory | |
| at java.io.UnixFileSystem.createFileExclusively(Native Method) | |
| at java.io.File.createNewFile(File.java:1006) | |
| at java.io.File.createTempFile(File.java:1989) | |
| at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:156) | |
| ... 29 more | |
| _________________________________________________________________________________________________________________________ | |
| [root@rhel1 hadoop-hdfs]# sudo -u hdfs hadoop jar /usr/lib/hbase/hbase.jar import AuthorDetailsMd5 /user/hdfs/AuthorDetailsQA/ | |
| 2014-07-29 15:19:33,817 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.df.interval is deprecated. Instead, use fs.df.interval | |
| 2014-07-29 15:19:33,827 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects | |
| 2014-07-29 15:19:33,827 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available | |
| 2014-07-29 15:19:33,828 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.default.name is deprecated. Instead, use fs.defaultFS | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.block.size is deprecated. Instead, use dfs.blocksize | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address | |
| 2014-07-29 15:19:33,837 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore | |
| 2014-07-29 15:19:33,842 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension | |
| 2014-07-29 15:19:33,847 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads | |
| 2014-07-29 15:19:33,848 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth | |
| 2014-07-29 15:19:33,848 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.federation.nameservices is deprecated. Instead, use dfs.nameservices | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address | |
| 2014-07-29 15:19:33,852 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period | |
| 2014-07-29 15:19:33,852 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl | |
| 2014-07-29 15:19:33,852 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum | |
| Exception in thread "main" java.lang.reflect.InvocationTargetException | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:51) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.util.RunJar.main(RunJar.java:208) | |
| Caused by: java.io.IOException: java.lang.RuntimeException: java.io.IOException: No such file or directory | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:521) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:472) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:438) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:381) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:318) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:288) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:271) | |
| at org.apache.hadoop.hbase.mapreduce.Import.createSubmittableJob(Import.java:177) | |
| at org.apache.hadoop.hbase.mapreduce.Import.main(Import.java:205) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) | |
| at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) | |
| ... 10 more | |
| Caused by: java.lang.RuntimeException: java.io.IOException: No such file or directory | |
| at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:164) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:518) | |
| ... 24 more | |
| Caused by: java.io.IOException: No such file or directory | |
| at java.io.UnixFileSystem.createFileExclusively(Native Method) | |
| at java.io.File.createNewFile(File.java:1006) | |
| at java.io.File.createTempFile(File.java:1989) | |
| at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:156) | |
| ... 29 more | |
| ______________________________________________________________________________________________________________________ | |
| [root@rhel1 hadoop-hdfs]# sudo -u hdfs hadoop jar /usr/lib/hbase/hbase.jar import AuthorDetailsMd5 /user/hdfs/AuthorDetailsQA/ | |
| 2014-07-29 15:19:33,817 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.df.interval is deprecated. Instead, use fs.df.interval | |
| 2014-07-29 15:19:33,827 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects | |
| 2014-07-29 15:19:33,827 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available | |
| 2014-07-29 15:19:33,828 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.default.name is deprecated. Instead, use fs.defaultFS | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.block.size is deprecated. Instead, use dfs.blocksize | |
| 2014-07-29 15:19:33,830 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct | |
| 2014-07-29 15:19:33,833 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address | |
| 2014-07-29 15:19:33,837 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore | |
| 2014-07-29 15:19:33,842 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled | |
| 2014-07-29 15:19:33,844 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension | |
| 2014-07-29 15:19:33,847 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads | |
| 2014-07-29 15:19:33,848 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth | |
| 2014-07-29 15:19:33,848 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.federation.nameservices is deprecated. Instead, use dfs.nameservices | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args | |
| 2014-07-29 15:19:33,851 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address | |
| 2014-07-29 15:19:33,852 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period | |
| 2014-07-29 15:19:33,852 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl | |
| 2014-07-29 15:19:33,852 WARN [main] conf.Configuration (Configuration.java:warnOnceIfDeprecated(808)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum | |
| Exception in thread "main" java.lang.reflect.InvocationTargetException | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:51) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.util.RunJar.main(RunJar.java:208) | |
| Caused by: java.io.IOException: java.lang.RuntimeException: java.io.IOException: No such file or directory | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:521) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:472) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:438) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:381) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:318) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:288) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:271) | |
| at org.apache.hadoop.hbase.mapreduce.Import.createSubmittableJob(Import.java:177) | |
| at org.apache.hadoop.hbase.mapreduce.Import.main(Import.java:205) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) | |
| at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) | |
| ... 10 more | |
| Caused by: java.lang.RuntimeException: java.io.IOException: No such file or directory | |
| at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:164) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) | |
| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) | |
| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) | |
| at java.lang.reflect.Method.invoke(Method.java:606) | |
| at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:518) | |
| ... 24 more | |
| Caused by: java.io.IOException: No such file or directory | |
| at java.io.UnixFileSystem.createFileExclusively(Native Method) | |
| at java.io.File.createNewFile(File.java:1006) | |
| at java.io.File.createTempFile(File.java:1989) | |
| at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:156) | |
| ... 29 more | |
| _________________________________________________________________________________________________________________________ | |
| [root@rhel1 hadoop-hdfs]# sudo -u hdfs hadoop fs -ls hdfs://golden-apple/user/hdfs/AuthorDetailsQA/ | |
| Found 24 items | |
| -rw-r--r-- 2 hdfs hadoop 0 2014-07-29 13:29 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/_SUCCESS | |
| -rw-r--r-- 2 hdfs hadoop 180965137 2014-07-29 13:29 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00000 | |
| -rw-r--r-- 2 hdfs hadoop 181553539 2014-07-29 13:29 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00001 | |
| -rw-r--r-- 2 hdfs hadoop 90520357 2014-07-29 13:30 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00002 | |
| -rw-r--r-- 2 hdfs hadoop 90479815 2014-07-29 13:30 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00003 | |
| -rw-r--r-- 2 hdfs hadoop 91040402 2014-07-29 13:30 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00004 | |
| -rw-r--r-- 2 hdfs hadoop 90582485 2014-07-29 13:30 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00005 | |
| -rw-r--r-- 2 hdfs hadoop 182002287 2014-07-29 13:31 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00006 | |
| -rw-r--r-- 2 hdfs hadoop 90845248 2014-07-29 13:32 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00007 | |
| -rw-r--r-- 2 hdfs hadoop 91168650 2014-07-29 13:32 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00008 | |
| -rw-r--r-- 2 hdfs hadoop 90939724 2014-07-29 13:32 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00009 | |
| -rw-r--r-- 2 hdfs hadoop 90790546 2014-07-29 13:32 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00010 | |
| -rw-r--r-- 2 hdfs hadoop 90753741 2014-07-29 13:32 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00011 | |
| -rw-r--r-- 2 hdfs hadoop 90776949 2014-07-29 13:33 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00012 | |
| -rw-r--r-- 2 hdfs hadoop 181214034 2014-07-29 13:33 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00013 | |
| -rw-r--r-- 2 hdfs hadoop 181594729 2014-07-29 13:34 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00014 | |
| -rw-r--r-- 2 hdfs hadoop 181197255 2014-07-29 13:35 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00015 | |
| -rw-r--r-- 2 hdfs hadoop 181616369 2014-07-29 13:35 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00016 | |
| -rw-r--r-- 2 hdfs hadoop 181440247 2014-07-29 13:36 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00017 | |
| -rw-r--r-- 2 hdfs hadoop 181516484 2014-07-29 13:36 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00018 | |
| -rw-r--r-- 2 hdfs hadoop 91033142 2014-07-29 13:36 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00019 | |
| -rw-r--r-- 2 hdfs hadoop 90942425 2014-07-29 13:36 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00020 | |
| -rw-r--r-- 2 hdfs hadoop 91071853 2014-07-29 13:37 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00021 | |
| -rw-r--r-- 2 hdfs hadoop 90623828 2014-07-29 13:37 hdfs://golden-apple/user/hdfs/AuthorDetailsQA/part-m-00022 | |
| ________________________________________________________________________________________________________________________ | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
hbase org.apache.hadoop.hbase.mapreduce.Import AuthorDetailsMD5 hdfs://golden-apple/AuthorDetailsQA