Skip to content

Instantly share code, notes, and snippets.

@myui

myui/autoconvertjoin_bug

Last active August 29, 2015 14:16
Show Gist options
  • Save myui/be4674a62e83923e77bd to your computer and use it in GitHub Desktop.
Save myui/be4674a62e83923e77bd to your computer and use it in GitHub Desktop.
Download ZIP
Raw
autoconvertjoin_bug
2015-02-24 20:13:52,028 INFO [TezChild] exec.MapOperator: Initializing Self MAP[20]
2015-02-24 20:13:52,028 INFO [TezChild] exec.TableScanOperator: Initializing Self TS[8]
2015-02-24 20:13:52,029 INFO [TezChild] exec.TableScanOperator: Operator 8 TS initialized
2015-02-24 20:13:52,029 INFO [TezChild] exec.TableScanOperator: Initializing children of 8 TS
2015-02-24 20:13:52,029 INFO [TezChild] exec.FilterOperator: Initializing child 9 FIL
2015-02-24 20:13:52,029 INFO [TezChild] exec.FilterOperator: Initializing Self FIL[9]
2015-02-24 20:13:52,029 INFO [TezChild] exec.FilterOperator: Operator 9 FIL initialized
2015-02-24 20:13:52,029 INFO [TezChild] exec.FilterOperator: Initializing children of 9 FIL
2015-02-24 20:13:52,029 INFO [TezChild] exec.SelectOperator: Initializing child 10 SEL
2015-02-24 20:13:52,029 INFO [TezChild] exec.SelectOperator: Initializing Self SEL[10]
2015-02-24 20:13:52,029 INFO [TezChild] exec.SelectOperator: SELECT struct<gid:bigint,userid:int,movieid:int,rating:int>
2015-02-24 20:13:52,029 INFO [TezChild] exec.SelectOperator: Operator 10 SEL initialized
2015-02-24 20:13:52,029 INFO [TezChild] exec.SelectOperator: Initializing children of 10 SEL
2015-02-24 20:13:52,029 INFO [TezChild] exec.MapJoinOperator: Initializing child 11 MAPJOIN
2015-02-24 20:13:52,029 INFO [TezChild] exec.SelectOperator: Initialization Done 10 SEL
2015-02-24 20:13:52,029 INFO [TezChild] exec.FilterOperator: Initialization Done 9 FIL
2015-02-24 20:13:52,029 INFO [TezChild] exec.TableScanOperator: Initialization Done 8 TS
2015-02-24 20:13:52,029 INFO [TezChild] exec.MapOperator: Initialization Done 20 MAP
2015-02-24 20:13:52,029 INFO [TezChild] exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[18]
2015-02-24 20:13:52,030 INFO [TezChild] exec.HashTableDummyOperator: Operator 18 HASHTABLEDUMMY initialized
2015-02-24 20:13:52,030 INFO [TezChild] exec.HashTableDummyOperator: Initializing children of 18 HASHTABLEDUMMY
2015-02-24 20:13:52,030 INFO [TezChild] exec.MapJoinOperator: Initializing child 13 MAPJOIN
2015-02-24 20:13:52,030 INFO [TezChild] exec.HashTableDummyOperator: Initialization Done 18 HASHTABLEDUMMY
2015-02-24 20:13:52,030 INFO [TezChild] exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[19]
2015-02-24 20:13:52,030 INFO [TezChild] exec.HashTableDummyOperator: Operator 19 HASHTABLEDUMMY initialized
2015-02-24 20:13:52,030 INFO [TezChild] exec.HashTableDummyOperator: Initializing children of 19 HASHTABLEDUMMY
2015-02-24 20:13:52,030 INFO [TezChild] exec.MapJoinOperator: Initializing child 11 MAPJOIN
2015-02-24 20:13:52,030 INFO [TezChild] exec.MapJoinOperator: Initializing Self MAPJOIN[11]
2015-02-24 20:13:52,036 INFO [TezChild] exec.CommonJoinOperator: JOIN struct<_col1:int,_col2:int,_col4:array<float>,_col6:double> totalsz = 4
2015-02-24 20:13:52,036 INFO [TezChild] exec.MapJoinOperator: Operator 11 MAPJOIN initialized
2015-02-24 20:13:52,036 INFO [TezChild] exec.MapJoinOperator: Initializing children of 11 MAPJOIN
2015-02-24 20:13:52,037 INFO [TezChild] exec.SelectOperator: Initializing child 12 SEL
2015-02-24 20:13:52,037 INFO [TezChild] exec.SelectOperator: Initializing Self SEL[12]
2015-02-24 20:13:52,037 INFO [TezChild] exec.SelectOperator: SELECT struct<_col1:int,_col2:int,_col4:array<float>,_col6:double>
2015-02-24 20:13:52,037 INFO [TezChild] exec.SelectOperator: Operator 12 SEL initialized
2015-02-24 20:13:52,037 INFO [TezChild] exec.SelectOperator: Initializing children of 12 SEL
2015-02-24 20:13:52,037 INFO [TezChild] exec.MapJoinOperator: Initializing child 13 MAPJOIN
2015-02-24 20:13:52,037 INFO [TezChild] exec.MapJoinOperator: Initializing Self MAPJOIN[13]
2015-02-24 20:13:52,038 INFO [TezChild] exec.CommonJoinOperator: JOIN struct<_col2:int,_col3:array<float>,_col4:double,_col7:array<float>,_col9:double> totalsz = 5
2015-02-24 20:13:52,038 INFO [TezChild] exec.MapJoinOperator: Operator 13 MAPJOIN initialized
2015-02-24 20:13:52,039 INFO [TezChild] exec.MapJoinOperator: Initializing children of 13 MAPJOIN
2015-02-24 20:13:52,039 INFO [TezChild] exec.SelectOperator: Initializing child 14 SEL
2015-02-24 20:13:52,039 INFO [TezChild] exec.SelectOperator: Initializing Self SEL[14]
2015-02-24 20:13:52,040 INFO [TezChild] exec.SelectOperator: SELECT struct<_col2:int,_col3:array<float>,_col4:double,_col7:array<float>,_col9:double>
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: Operator 14 SEL initialized
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: Initializing children of 14 SEL
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: Initializing child 15 SEL
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: Initializing Self SEL[15]
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: SELECT struct<_col0:int,_col1:float>
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: Operator 15 SEL initialized
2015-02-24 20:13:52,041 INFO [TezChild] exec.SelectOperator: Initializing children of 15 SEL
2015-02-24 20:13:52,041 INFO [TezChild] exec.GroupByOperator: Initializing child 16 GBY
2015-02-24 20:13:52,041 INFO [TezChild] exec.GroupByOperator: Initializing Self GBY[16]
2015-02-24 20:13:52,042 INFO [TezChild] exec.GroupByOperator: Operator 16 GBY initialized
2015-02-24 20:13:52,042 INFO [TezChild] exec.GroupByOperator: Initializing children of 16 GBY
2015-02-24 20:13:52,042 INFO [TezChild] exec.ReduceSinkOperator: Initializing child 17 RS
2015-02-24 20:13:52,042 INFO [TezChild] exec.ReduceSinkOperator: Initializing Self RS[17]
2015-02-24 20:13:52,042 INFO [TezChild] exec.ReduceSinkOperator: Using tag = -1
2015-02-24 20:13:52,043 INFO [TezChild] exec.ReduceSinkOperator: Operator 17 RS initialized
2015-02-24 20:13:52,043 INFO [TezChild] exec.ReduceSinkOperator: Initialization Done 17 RS
2015-02-24 20:13:52,043 INFO [TezChild] exec.GroupByOperator: Initialization Done 16 GBY
2015-02-24 20:13:52,043 INFO [TezChild] exec.SelectOperator: Initialization Done 15 SEL
2015-02-24 20:13:52,043 INFO [TezChild] exec.SelectOperator: Initialization Done 14 SEL
2015-02-24 20:13:52,044 INFO [TezChild] exec.MapJoinOperator: Try to retrieve from cache
2015-02-24 20:13:52,044 INFO [TezChild] exec.MapJoinOperator: Did not find tables in cache
2015-02-24 20:13:52,044 INFO [TezChild] exec.MapJoinOperator: Initialization Done 13 MAPJOIN
2015-02-24 20:13:52,044 INFO [TezChild] exec.SelectOperator: Initialization Done 12 SEL
2015-02-24 20:13:52,044 INFO [TezChild] exec.MapJoinOperator: Try to retrieve from cache
2015-02-24 20:13:52,044 INFO [TezChild] exec.MapJoinOperator: Did not find tables in cache
2015-02-24 20:13:52,044 INFO [TezChild] exec.MapJoinOperator: Initialization Done 11 MAPJOIN
2015-02-24 20:13:52,044 INFO [TezChild] exec.HashTableDummyOperator: Initialization Done 19 HASHTABLEDUMMY
2015-02-24 20:13:52,044 INFO [TezChild] exec.OperatorUtils: Setting output collector: RS[17] --> Reducer 3
2015-02-24 20:13:52,044 INFO [TezChild] log.PerfLogger: </PERFLOG method=TezInitializeOperators start=1424776431584 end=1424776432044 duration=460 from=org.apache.hadoop.hive.ql.exec.tez.RecordProcessor>
2015-02-24 20:13:52,048 INFO [TezChild] log.PerfLogger: <PERFLOG method=LoadHashtable from=org.apache.hadoop.hive.ql.exec.MapJoinOperator>
2015-02-24 20:13:52,051 INFO [TezChild] persistence.HashMapWrapper: Key count from statistics is 500104; setting map size to 666806
2015-02-24 20:13:52,061 INFO [TezChild] persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
2015-02-24 20:13:52,160 INFO [TezChild] impl.SimpleFetchedInputAllocator: Used memory after freeing 380542 : 0
2015-02-24 20:13:52,160 INFO [TezChild] readers.UnorderedKVReader: Num Records read: 6041
2015-02-24 20:13:52,161 INFO [TezChild] tez.HashTableLoader: Is this a bucket map join: false
2015-02-24 20:13:52,161 INFO [TezChild] tez.ObjectCache: Adding CACHED_INPUTS to cache with value []
2015-02-24 20:13:52,161 INFO [TezChild] tez.HashTableLoader: Setting Input: Reducer 47 as cached
2015-02-24 20:13:52,161 INFO [TezChild] exec.MapJoinOperator: This is not bucket map join, so cache
2015-02-24 20:13:52,161 INFO [TezChild] tez.ObjectCache: Adding __HASH_MAP_MAPJOIN_400_container to cache with value [Lorg.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer;@59a13986
2015-02-24 20:13:52,161 INFO [TezChild] tez.ObjectCache: Adding __HASH_MAP_MAPJOIN_400_serde to cache with value [Lorg.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainerSerDe;@67c7ba62
2015-02-24 20:13:52,161 INFO [TezChild] log.PerfLogger: </PERFLOG method=LoadHashtable start=1424776432048 end=1424776432161 duration=113 from=org.apache.hadoop.hive.ql.exec.MapJoinOperator>
2015-02-24 20:13:52,162 INFO [TezChild] log.PerfLogger: <PERFLOG method=LoadHashtable from=org.apache.hadoop.hive.ql.exec.MapJoinOperator>
2015-02-24 20:13:52,162 INFO [TezChild] persistence.HashMapWrapper: Key count from statistics is 500104; setting map size to 666806
2015-02-24 20:13:52,167 INFO [TezChild] persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
2015-02-24 20:13:52,227 INFO [TezChild] impl.SimpleFetchedInputAllocator: Used memory after freeing 270468 : 0
2015-02-24 20:13:52,227 INFO [TezChild] readers.UnorderedKVReader: Num Records read: 6041
2015-02-24 20:13:52,227 INFO [TezChild] tez.HashTableLoader: Is this a bucket map join: false
2015-02-24 20:13:52,227 INFO [TezChild] tez.ObjectCache: Found CACHED_INPUTS in cache with value: [Reducer 47]
2015-02-24 20:13:52,227 INFO [TezChild] tez.HashTableLoader: Setting Input: Reducer 13 as cached
2015-02-24 20:13:52,227 INFO [TezChild] exec.MapJoinOperator: This is not bucket map join, so cache
2015-02-24 20:13:52,227 INFO [TezChild] tez.ObjectCache: Adding __HASH_MAP_MAPJOIN_410_container to cache with value [Lorg.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer;@e6476d3
2015-02-24 20:13:52,227 INFO [TezChild] tez.ObjectCache: Adding __HASH_MAP_MAPJOIN_410_serde to cache with value [Lorg.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainerSerDe;@65b51e06
2015-02-24 20:13:52,227 INFO [TezChild] log.PerfLogger: </PERFLOG method=LoadHashtable start=1424776432162 end=1424776432227 duration=65 from=org.apache.hadoop.hive.ql.exec.MapJoinOperator>
2015-02-24 20:13:52,228 INFO [TezChild] exec.MapOperator: MAP[20]: records read - 1
2015-02-24 20:13:52,229 INFO [TezChild] exec.MapOperator: MAP[20]: records read - 10
2015-02-24 20:13:52,229 INFO [TezChild] exec.MapOperator: MAP[20]: records read - 100
2015-02-24 20:13:52,237 INFO [TezChild] exec.MapOperator: MAP[20]: records read - 1000
2015-02-24 20:13:52,250 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,275 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,301 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,326 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,335 INFO [TezChild] exec.MapOperator: MAP[20]: records read - 10000
2015-02-24 20:13:52,350 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,375 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,402 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,416 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,428 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,438 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,447 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,453 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,457 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,462 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,466 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,470 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,475 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,480 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,484 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,487 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,490 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,494 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,497 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,501 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,504 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,508 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,511 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,514 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,517 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,521 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,524 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,527 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,530 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,536 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,549 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,553 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,556 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,560 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,564 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,567 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,571 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,576 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,580 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,582 INFO [TezChild] exec.MapOperator: MAP[20]: records read - 100000
2015-02-24 20:13:52,584 INFO [TezChild] io.HiveContextAwareRecordReader: Processing file hdfs://dm01:9000/user/hive/warehouse/movielens.db/ratings_groupded/000000_0
2015-02-24 20:13:52,588 ERROR [TezChild] exec.MapJoinOperator: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.serde2.objectinspector.StandardListObjectInspector.getListLength(StandardListObjectInspector.java:90)
at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:312)
at org.apache.hadoop.hive.ql.exec.JoinUtil.computeValues(JoinUtil.java:193)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.getFilteredValue(CommonJoinOperator.java:408)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:295)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:638)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genAllOneUniqueJoinObject(CommonJoinOperator.java:670)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:748)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:299)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:120)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:95)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:157)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:493)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:83)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:294)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:163)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
2015-02-24 20:13:52,607 ERROR [TezChild] exec.MapJoinOperator: Unexpected exception: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:638)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genAllOneUniqueJoinObject(CommonJoinOperator.java:670)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:748)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:299)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:120)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:95)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:157)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:493)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:83)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:294)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:163)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.serde2.objectinspector.StandardListObjectInspector.getListLength(StandardListObjectInspector.java:90)
at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:312)
at org.apache.hadoop.hive.ql.exec.JoinUtil.computeValues(JoinUtil.java:193)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.getFilteredValue(CommonJoinOperator.java:408)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:295)
... 33 more
2015-02-24 20:13:52,610 FATAL [TezChild] tez.MapRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"gid":1,"userid":4422,"movieid":1213,"rating":5}
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:503)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:83)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:294)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:163)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:120)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:95)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:157)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:493)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:638)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genAllOneUniqueJoinObject(CommonJoinOperator.java:670)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:748)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:299)
... 26 more
Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.serde2.objectinspector.StandardListObjectInspector.getListLength(StandardListObjectInspector.java:90)
at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:312)
at org.apache.hadoop.hive.ql.exec.JoinUtil.computeValues(JoinUtil.java:193)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.getFilteredValue(CommonJoinOperator.java:408)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:295)
... 33 more
2015-02-24 20:13:52,610 INFO [TezChild] exec.MapOperator: 20 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.MapOperator: RECORDS_IN_Map_20:100112
2015-02-24 20:13:52,610 INFO [TezChild] exec.MapOperator: DESERIALIZE_ERRORS:0
2015-02-24 20:13:52,610 INFO [TezChild] exec.TableScanOperator: 8 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.FilterOperator: 9 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.SelectOperator: 10 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.SelectOperator: 10 Close done
2015-02-24 20:13:52,610 INFO [TezChild] exec.FilterOperator: 9 Close done
2015-02-24 20:13:52,610 INFO [TezChild] exec.TableScanOperator: 8 Close done
2015-02-24 20:13:52,610 INFO [TezChild] exec.MapOperator: 20 Close done
2015-02-24 20:13:52,610 INFO [TezChild] exec.HashTableDummyOperator: 18 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.HashTableDummyOperator: 18 Close done
2015-02-24 20:13:52,610 INFO [TezChild] exec.HashTableDummyOperator: 19 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.MapJoinOperator: 11 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] persistence.BytesBytesMultiHashMap: Map metrics: keys allocated 1048576, keys assigned 6041, write conflict 17, write max dist 1, expanded 0 times in 0us
2015-02-24 20:13:52,610 INFO [TezChild] exec.SelectOperator: 12 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] exec.MapJoinOperator: 13 finished. closing...
2015-02-24 20:13:52,610 INFO [TezChild] persistence.BytesBytesMultiHashMap: Map metrics: keys allocated 1048576, keys assigned 6041, write conflict 17, write max dist 1, expanded 0 times in 0us
2015-02-24 20:13:52,611 INFO [TezChild] exec.SelectOperator: 14 finished. closing...
2015-02-24 20:13:52,611 INFO [TezChild] exec.SelectOperator: 15 finished. closing...
2015-02-24 20:13:52,611 INFO [TezChild] exec.GroupByOperator: 16 finished. closing...
2015-02-24 20:13:52,611 INFO [TezChild] exec.ReduceSinkOperator: keys are [] num distributions: 0
2015-02-24 20:13:52,611 INFO [TezChild] exec.ReduceSinkOperator: RS[17]: records written - 1
2015-02-24 20:13:52,611 INFO [TezChild] exec.ReduceSinkOperator: 17 finished. closing...
2015-02-24 20:13:52,611 INFO [TezChild] exec.ReduceSinkOperator: RS[17]: records written - 1
2015-02-24 20:13:52,611 INFO [TezChild] exec.ReduceSinkOperator: RECORDS_OUT_INTERMEDIATE_Map_20:1
2015-02-24 20:13:52,611 INFO [TezChild] exec.ReduceSinkOperator: 17 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.GroupByOperator: 16 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.SelectOperator: 15 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.SelectOperator: 14 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.MapJoinOperator: 13 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.SelectOperator: 12 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.MapJoinOperator: 11 Close done
2015-02-24 20:13:52,611 INFO [TezChild] exec.HashTableDummyOperator: 19 Close done
2015-02-24 20:13:52,612 ERROR [TezChild] tez.TezProcessor: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"gid":1,"userid":4422,"movieid":1213,"rating":5}
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:91)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:294)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:163)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"gid":1,"userid":4422,"movieid":1213,"rating":5}
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:503)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:83)
... 17 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:120)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:95)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:157)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:493)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:638)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genAllOneUniqueJoinObject(CommonJoinOperator.java:670)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:748)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:299)
... 26 more
Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.serde2.objectinspector.StandardListObjectInspector.getListLength(StandardListObjectInspector.java:90)
at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:312)
at org.apache.hadoop.hive.ql.exec.JoinUtil.computeValues(JoinUtil.java:193)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.getFilteredValue(CommonJoinOperator.java:408)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:295)
... 33 more
2015-02-24 20:13:52,612 INFO [TezChild] task.TezTaskRunner: Encounted an error while executing task: attempt_1424704867400_0007_1_49_000000_3
java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"gid":1,"userid":4422,"movieid":1213,"rating":5}
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:186)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"gid":1,"userid":4422,"movieid":1213,"rating":5}
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:91)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:294)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:163)
... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"gid":1,"userid":4422,"movieid":1213,"rating":5}
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:503)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:83)
... 17 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:120)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:95)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:157)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:493)
... 18 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected exception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:311)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:638)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genAllOneUniqueJoinObject(CommonJoinOperator.java:670)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:748)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:299)
... 26 more
Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast to [Ljava.lang.Object;
at org.apache.hadoop.hive.serde2.objectinspector.StandardListObjectInspector.getListLength(StandardListObjectInspector.java:90)
at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:312)
at org.apache.hadoop.hive.ql.exec.JoinUtil.computeValues(JoinUtil.java:193)
at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.getFilteredValue(CommonJoinOperator.java:408)
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:295)
... 33 more
2015-02-24 20:13:52,671 INFO [TezChild] runtime.LogicalIOProcessorRuntimeTask: Final Counters : Counters: 37 [[File System Counters FILE_BYTES_READ=0, FILE_BYTES_WRITTEN=0, FILE_READ_OPS=0, FILE_LARGE_READ_OPS=0, FILE_WRITE_OPS=0, HDFS_BYTES_READ=2949120, HDFS_BYTES_WRITTEN=0, HDFS_READ_OPS=45, HDFS_LARGE_READ_OPS=0, HDFS_WRITE_OPS=0][org.apache.tez.common.counters.TaskCounter SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=2, NUM_FAILED_SHUFFLE_INPUTS=0, GC_TIME_MILLIS=158, CPU_MILLISECONDS=2790, PHYSICAL_MEMORY_BYTES=1383550976, VIRTUAL_MEMORY_BYTES=2958921728, COMMITTED_HEAP_BYTES=1745027072, INPUT_RECORDS_PROCESSED=112195, OUTPUT_RECORDS=1, OUTPUT_BYTES=2, OUTPUT_BYTES_WITH_OVERHEAD=0, OUTPUT_BYTES_PHYSICAL=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_BYTES=513504, SHUFFLE_BYTES_DECOMPRESSED=651010, SHUFFLE_BYTES_TO_MEM=513504, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=0, SHUFFLE_PHASE_TIME=143, FIRST_EVENT_RECEIVED=105, LAST_EVENT_RECEIVED=105][HIVE DESERIALIZE_ERRORS=0, RECORDS_IN_Map_20=100112, RECORDS_OUT_INTERMEDIATE_Map_20=1]]
2015-02-24 20:13:52,672 INFO [main] impl.MetricsSystemImpl: Stopping TezTask metrics system...
2015-02-24 20:13:52,672 INFO [main] impl.MetricsSystemImpl: TezTask metrics system stopped.
2015-02-24 20:13:52,673 INFO [main] impl.MetricsSystemImpl: TezTask metrics system shutdown complete.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment