Skip to content

Instantly share code, notes, and snippets.

@prongs
Created July 21, 2015 13:28
Show Gist options
  • Save prongs/d0d6e68034a4220cb3c5 to your computer and use it in GitHub Desktop.
Save prongs/d0d6e68034a4220cb3c5 to your computer and use it in GitHub Desktop.
2015-07-21 18:53:39,998 WARN [main]: common.LogUtils (LogUtils.java:logConfigLocation(145)) - hive-site.xml not found on CLASSPATH
2015-07-21 18:53:40,011 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - Execution log at: /var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T//rajat.khandelwal/rajat.khandelwal_20150721185353_1289f2f0-6bd8-4df7-9a9d-3c21220bf425.log
2015-07-21 18:53:40,254 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=deserializePlan from=org.apache.hadoop.hive.ql.exec.Utilities>
2015-07-21 18:53:40,255 INFO [main]: exec.Utilities (Utilities.java:deserializePlan(819)) - Deserializing MapredWork via kryo
2015-07-21 18:53:40,590 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=deserializePlan start=1437485020254 end=1437485020590 duration=336 from=org.apache.hadoop.hive.ql.exec.Utilities>
2015-07-21 18:53:40,625 INFO [main]: mr.ExecDriver (ExecDriver.java:execute(285)) - Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2015-07-21 18:53:40,630 INFO [main]: mr.ExecDriver (ExecDriver.java:execute(307)) - adding libjars: file:///Users/rajat.khandelwal/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-commons-1.0.50-hdp.jar,file:///Users/rajat.khandelwal/Git/hive/metastore/target/hive-metastore-0.13.4-inm-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/joda-time-2.0.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-proto-lib-1.0.50.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-yoda-1.1.19-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:40,633 INFO [main]: exec.Utilities (Utilities.java:getInputPaths(2994)) - Processing alias rrcube
2015-07-21 18:53:40,633 INFO [main]: exec.Utilities (Utilities.java:getInputPaths(3011)) - Adding input file file:/Users/rajat.khandelwal/2015-07-18-02
2015-07-21 18:53:40,633 INFO [main]: exec.Utilities (Utilities.java:isEmptyPath(2340)) - Content Summary not cached for file:/Users/rajat.khandelwal/2015-07-18-02
2015-07-21 18:53:40,647 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=serializePlan from=org.apache.hadoop.hive.ql.exec.Utilities>
2015-07-21 18:53:40,648 INFO [main]: exec.Utilities (Utilities.java:serializePlan(792)) - Serializing MapWork via kryo
2015-07-21 18:53:40,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=serializePlan start=1437485020647 end=1437485020753 duration=106 from=org.apache.hadoop.hive.ql.exec.Utilities>
2015-07-21 18:53:40,790 INFO [main]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-07-21 18:53:40,791 INFO [main]: jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-07-21 18:53:40,844 INFO [main]: jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2015-07-21 18:53:40,864 INFO [main]: exec.Utilities (Utilities.java:getBaseWork(360)) - No plan file found: file:/var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T/rajat.khandelwal/hive_2015-07-21_18-53-40_601_363257168476583723-1/-mr-10001/2b043438-27f9-4313-ada9-99f68e872203/reduce.xml
2015-07-21 18:53:41,082 WARN [main]: mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2015-07-21 18:53:41,517 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=getSplits from=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat>
2015-07-21 18:53:41,808 INFO [main]: io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(404)) - CombineHiveInputSplit creating pool for file:/Users/rajat.khandelwal/2015-07-18-02; using filter path file:/Users/rajat.khandelwal/2015-07-18-02
2015-07-21 18:53:41,823 INFO [main]: input.FileInputFormat (FileInputFormat.java:listStatus(281)) - Total input paths to process : 1
2015-07-21 18:53:41,845 INFO [main]: input.CombineFileInputFormat (CombineFileInputFormat.java:createSplits(413)) - DEBUG: Terminated node allocation with : CompletedNodes: 1, size left: 0
2015-07-21 18:53:41,848 INFO [main]: io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(459)) - number of splits 1
2015-07-21 18:53:41,848 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=getSplits start=1437485021517 end=1437485021848 duration=331 from=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat>
2015-07-21 18:53:41,879 INFO [main]: mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:1
2015-07-21 18:53:42,028 INFO [main]: mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_local2017936282_0001
2015-07-21 18:53:42,580 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/opencsv-2.3.jar
2015-07-21 18:53:42,650 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar
2015-07-21 18:53:42,858 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:42,870 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:42,871 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar
2015-07-21 18:53:42,884 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar
2015-07-21 18:53:42,884 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/yoda-commons-1.0.50-hdp.jar
2015-07-21 18:53:42,894 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-commons-1.0.50-hdp.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar
2015-07-21 18:53:42,927 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/hive-metastore-0.13.4-inm-SNAPSHOT.jar
2015-07-21 18:53:42,935 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/hive/metastore/target/hive-metastore-0.13.4-inm-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar
2015-07-21 18:53:42,935 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:42,942 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:42,943 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/joda-time-2.0.jar
2015-07-21 18:53:42,949 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/joda-time-2.0.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar
2015-07-21 18:53:42,950 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/yoda-proto-lib-1.0.50.jar
2015-07-21 18:53:42,957 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-proto-lib-1.0.50.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar
2015-07-21 18:53:42,957 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-yoda-1.1.19-SNAPSHOT.jar
2015-07-21 18:53:42,965 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-yoda-1.1.19-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar
2015-07-21 18:53:42,966 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:42,973 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:43,149 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar
2015-07-21 18:53:43,149 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar
2015-07-21 18:53:43,151 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar
2015-07-21 18:53:43,151 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar
2015-07-21 18:53:43,151 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar
2015-07-21 18:53:43,159 INFO [main]: mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://localhost:8080/
2015-07-21 18:53:43,161 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config org.apache.hadoop.hive.shims.HadoopShimsSecure$NullOutputCommitter
2015-07-21 18:53:43,162 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.hive.shims.HadoopShimsSecure$NullOutputCommitter
2015-07-21 18:53:43,166 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - Job running in-process (local Hadoop)
2015-07-21 18:53:43,240 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2015-07-21 18:53:43,245 INFO [LocalJobRunner Map Task Executor #0]: mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2017936282_0001_m_000000_0
2015-07-21 18:53:43,291 INFO [LocalJobRunner Map Task Executor #0]: util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2015-07-21 18:53:43,292 INFO [LocalJobRunner Map Task Executor #0]: mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : null
2015-07-21 18:53:43,301 INFO [LocalJobRunner Map Task Executor #0]: mapred.MapTask (MapTask.java:updateJobWithSplit(482)) - Processing split: Paths:/Users/rajat.khandelwal/2015-07-18-02/part-00029:0+125738200InputFormatClass: org.apache.hadoop.hive.ql.io.RCFileInputFormat
2015-07-21 18:53:43,337 INFO [LocalJobRunner Map Task Executor #0]: io.CodecPool (CodecPool.java:getDecompressor(126)) - Got brand-new decompressor
2015-07-21 18:53:43,350 INFO [LocalJobRunner Map Task Executor #0]: io.CodecPool (CodecPool.java:getDecompressor(126)) - Got brand-new decompressor
2015-07-21 18:53:43,352 INFO [LocalJobRunner Map Task Executor #0]: io.HiveContextAwareRecordReader (HiveContextAwareRecordReader.java:initIOContext(168)) - Processing file file:/Users/rajat.khandelwal/2015-07-18-02/part-00029
2015-07-21 18:53:43,352 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - map.input.file is deprecated. Instead, use mapreduce.map.input.file
2015-07-21 18:53:43,352 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - map.input.start is deprecated. Instead, use mapreduce.map.input.start
2015-07-21 18:53:43,353 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - map.input.length is deprecated. Instead, use mapreduce.map.input.length
2015-07-21 18:53:43,353 INFO [LocalJobRunner Map Task Executor #0]: mapred.MapTask (MapTask.java:runOldMapper(436)) - numReduceTasks: 0
2015-07-21 18:53:43,367 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(87)) - maximum memory = 477102080
2015-07-21 18:53:43,367 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(92)) - conf classpath = [file:/var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T/hadoop-unjar8423227006782307916/, file:/Users/rajat.khandelwal/Git/hive/packaging/target/apache-hive-0.13.4-inm-SNAPSHOT-bin/apache-hive-0.13.4-inm-SNAPSHOT-bin/lib/hive-common-0.13.4-inm-SNAPSHOT.jar, file:/var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T/hadoop-unjar8423227006782307916/classes, file:/Users/rajat.khandelwal/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-commons-1.0.50-hdp.jar, file:/Users/rajat.khandelwal/Git/hive/metastore/target/hive-metastore-0.13.4-inm-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/joda-time-2.0.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-proto-lib-1.0.50.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-yoda-1.1.19-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar]
2015-07-21 18:53:43,368 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(94)) - thread classpath = [file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar]
2015-07-21 18:53:43,371 INFO [LocalJobRunner Map Task Executor #0]: mr.ObjectCache (ObjectCache.java:retrieve(41)) - Ignoring retrieval request: __MAP_PLAN__
2015-07-21 18:53:43,371 INFO [LocalJobRunner Map Task Executor #0]: mr.ObjectCache (ObjectCache.java:cache(36)) - Ignoring cache key: __MAP_PLAN__
2015-07-21 18:53:43,413 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (MapOperator.java:setChildren(387)) - dump TS struct<impression_id:string,request_ad_formatter:string,request_ad_logic:string,request_ad_format:string,adgroup_id:string,ad_inc_id:int,unused6:string,unused7:string,adv_account_guid:string,rq_campgnidbig:string,country_carrier_id:bigint,unused11:string,unused12:string,request_code_version:int,request_handset_user_agent:string,handset_device_id:bigint,request_host:string,unused17:string,request_market:string,request_nfr:string,request_nodeinfo:string,request_orig_handset:string,request_page_url:string,site_guid:string,request_time:timestamp,age:string,gender:string,request_version:bigint,request_ip:string,request_x_user_agent:string,request_x_header:string,click_x_real_ip:string,page_requests:double,valid_page_requests:double,total_ad_requests:double,valid_ad_requests:double,served_impressions:double,page_impressions:double,request_mkcpcadserved:double,click_ccid:int,unused40:string,click_fraud:string,click_fraudset:string,click_handsetid:string,click_jc:string,cl_rq_ccid:bigint,click_request_device_id:bigint,cl_rq_site_inc_id:bigint,cl_rq_ua:string,click_terminated:string,click_time:timestamp,click_version:bigint,click_uid:string,billed_status:string,billed_createdon:string,unused55:string,unused56:string,billing_impression_type:string,unused58:string,unused59:string,bl_loggingtime:timestamp,unused61:string,bl_siteid:string,bl_adgrpid:string,click:double,total_burn:double,agency_revenue:double,pub_revenue:double,request_slot_id:bigint,request_slot_served:bigint,request_uid:string,unused71:string,unused72:string,rq_loc_src:string,request_geo_city:bigint,rq_geo_region:string,unused76:string,unused77:string,unused78:string,bl_overbill_revenue:double,cl_overbill_cpc_clicks:double,download_time:timestamp,matched_conversions:double,request_intg_method:string,request_intg_version:string,request_intg_origin:string,request_intg_family:string,integration_direct:string,dl_app_id:string,download_u_id:string,unused90:string,unused91:string,download_hash_type:string,joined_click_hash_type:string,non_billable_impressions:double,rq_overbill_cpm_adimp:double,non_billable_cpc_clicks:double,terminated_clicks:double,fraud_clicks:double,nofund_revenue:double,download_source:string,rq_udid_type:string,request_adtype:string,download_goal:string,dl_impid:string,download_joined_count:double,download_unjoined_count:double,download_duplicate_count:double,dl_udid_type:string,cl_udid_type:string,dl_terminated:string,cl_id:string,ad_response_format:string,unused113:string,dcp_page_requests:double,dcp_valid_page_requests:double,dcp_ad_requests:double,dcp_valid_ad_requests:double,dcp_page_impressions:double,dcp_cpc_impressions:double,dcp_total_clicks:double,dcp_fraud_clicks:double,dcp_billed_cpc_clicks:double,dcp_non_billable_cpc_clicks:double,dcp_cpm_impressions:double,dcp_non_billable_cpm_impressions:double,dcp_total_burn:double,dcp_pub_revenue:double,dcp_agency_revenue:double,dcp_cpm_clicks:double,dcp_cpc_beacon_count:double,dcp_cpm_beacon_count:double,user_optout:string,user_unique_count_internal:double,user_valid_page_requests:double,user_valid_ad_requests:double,user_ad_impressions:double,user_page_impressions:double,user_custom_segment_id_segment_retargeting:bigint,user_segment_valid_ad_requests:double,user_segment_unique_count:double,rm_sprout_id:string,rm_time:string,rm_source_name:string,rm_expand_count:double,rm_dismiss_count:double,rm_cta_count:double,rm_media_play_count:double,rm_media_auto_play_count:double,rm_media_start_count:double,rm_media_q1_count:double,rm_media_q2_count:double,rm_media_q3_count:double,rm_media_end_count:double,rm_dwell_time:double,rm_start_millis:string,rm_end_millis:string,rm_total:double,rm_views:double,rm_dls_count:double,rm_dlf_count:double,request_csid:string,cl_final_landing_page:string,rq_aud_seg_ids:string,rq_conceptual_rollover:string,rq_conceptual_ron:string,rq_concept_persona_id:string,rq_blinded_site_id:string,rq_tagged_user:string,rq_u_aid:string,rq_inventory_type:string,unused171:string,unused172:string,request_is_geo_enabled:string,request_geo_fence:string,cp_user_frequency:string,cp_user_unique_count_internal:double,is_impression_geo_targeted:string,geo_targeting_constituent:string,request_system_latlon:string,rq_served_city:string,rq_geo_state:string,rq_geo_zip:string,nondiscounted_burn:double,request_ref_tag:string,down_carrier_region_id:string,down_carrier_city_id:int,request_selected_uid_type:string,request_all_uid_type:string,request_uparams:string,request_uid_params:string,unused191:string,ci_ret_event_type:string,ci_ret_adgroup_id:bigint,ci_ret_unique_count:double,ci_ret_ad_request:double,ci_ret_ad_impressions:double,ci_ret_page_request:double,ci_ret_page_impressions:double,app_ret_app_id:string,app_ret_unique_count:double,app_ret_ad_requests:double,app_ret_ad_impressions:double,app_ret_page_request:double,app_ret_page_impressions:double,user_sig_unique_count:double,user_signal_ad_impressions:double,user_signal_clicks:double,user_signal_ download:double,user_signal_revenue:double,user_signal_ publisher_revenue:double,user_signal_ agency_revenue:double,user_life_span:string,user_life_unique_count:double,dcp_fraud_beacons:double,request_derived_latlon:string,request_custom_region_fence:string,volume_discount:double,creative_charges:double,io_discount:double,withhold_taxes:double,bl_fund_source_id:int,user_site_visited_count:double,user_app_dist_unique_count:double,request_geo_type:string,budget_tier_id:bigint,served_ad_format:string,request_conv_factor:double,segment_id:bigint,rq_optout:string,bc_id:string,beacon_time:timestamp,bc_terminated:string,bc_terminationreason:string,bc_fraud:string,beacon_fraudset:string,bc_total_pings:double,bc_valid_pings:double,bc_fraud_pings:double,bc_terminated_pings:double,bc_click_no_pings:double,rq_id:string,event_time:timestamp,predicted_clicks:double,rq_adgrpincid:string,request_muh:double,request_mul:double,request_mucons:double,request_ecpm_goalseek:double,request_muest:double,async_type:string,async_method:string,unused252:string,template_id:bigint,demand_capabilities_ids:string,request_creative_inc_id:int,effective_slot_width:double,effective_slot_height:double,creative_height:double,creative_width:double,bl_data_seller_id:int,bl_data_provider_id:int,data_enrichment_cost:double,cpm_billed_beacons:double,rq_yob:string,rq_interests:string,rq_user_country:string,rq_user_city:string,rq_user_zip:string,rq_user_loc_type:string,rq_rtbs_pub_id:string,rq_rtbs_site_name:string,rq_rtbs_site_url:string,rq_rtbs_site_platform:string,supply_source_type:string,participated_impressions:double,cbp_segment_id:bigint,device_orientation:string,device_localization:string,device_networktype:string,request_discarded_u_id_params:string,request_ad_frequency:string,request_ad_recency:string,request_adgroup_frequency:string,request_adgroup_recency:string,rq_int_orientation:string,bl_data_event_type:string,request_apbssid:string,request_req_dst:string,request_fill_dst:string,request_served_dst:string,predicted_ecpm:double,request_learning_auction_type:string,rq_auction_conv_factor:double,request_placement_id:bigint,custom_segment_id:string,user_factual_unique_count:double,user_factual_valid_ad_requests:double,install_count:double,normalized_user_id:string,rq_user_profile_version:string,rq_app_affinity_version:string,rq_user_features:string,auto_computed_lambda:double,user_lambda:double,lambda_used:double,normal_burn:double,risky_burn:double,is_predicted_cvr_null:boolean,is_super_tier:string,learning_phase:string,request_predicted_engagement_map:string,request_predicted_expand_rate:double,request_poi_map:string,impression_poi_map:string,request_cat_distance:double,rq_category:string,cl_event_state:string,click_other_invalidset:string,accidental_clicks:double,custom_ad_unit_id:int,same_adv_second_adid:string,same_adv_second_advid:string,user_location_context:double,user_location_context_ad_req:double,user_location_context_page_req:string,user_location_context_unique_count:double,rq_asm_segment_id:string,diff_adv_second_adid:string,diff_adv_second_advid:string,diff_adv_second_ranks:string,num_candidate_ads:string,num_candidate_adgroups:string,num_candidate_advs:string,same_adv_second_ranks:string,cl_conv_factor:double,rq_geoseg_type:string,user_enrich_pg_req:double,user_enrich_pg_imp:double,user_enrich_valid_clicks:double,user_enrich_total_burn:double,rq_deal_id:int,rq_highest_bid:double,rq_bid_floor:double,rq_highbid_dst:string,rq_predicted_media_quartile:double,rq_predicted_cta:double,rm_custom_count:double,rm_media_stop_value:double,rm_custom_value:double,rm_media_stop_count:double,rm_media_error_count:double,rm_media_id:string,rm_media_type:string,rm_custom_action:string,rm_custom_label:string,rm_custom_catgeory:string,rq_device_modelid:string,rq_is_vbssid:boolean,dl_confident_install:double,dl_confident_conversion:double,rq_target_cpd:double,rq_geodata_vendor_id:string,rq_serving_cpc_floor:double,rq_concept_id:string,segmentdemand_served_imp:double,segmentdemand_valid_clicks:double,segmentdemand_download_installs:double,segmentdemand_total_burn:double,segmentdemand_rendered_imp:double,rq_is_adgroup_subsidized:boolean,rq_adgroup_stage:string,rq_is_subsidy_impression:boolean,rq_is_muest_null:boolean,rq_is_derived_site_placement_id:boolean,rq_site_placement_id:string,rm_unique_media_play_count:double,rm_unique_media_auto_play_count:double,rm_unique_media_start_count:double,rm_unique_media_q1_count:double,rm_unique_media_q2_count:double,rm_unique_media_q3_count:double,rm_unique_media_complete_count:double,rm_form_submit_success_count:double,rm_form_submit_failure_count:double,rm_form_submit_attempt_count:double,rm_unique_form_submit_success_count:double,rm_unique_form_submit_failure_count:double,rm_unique_form_submit_attempt_count:double,rq_served_location_source:string,rq_served_location_level_of_targeting:string,rq_served_location_id:string,rq_primary_cities:string,ltv_event_time:timestamp,ltv_event_name:string,ltv_event_value:double,ltv_event_count:double,pub_account_guid:string,site_inc_id:string,operating_system_id:string,device_type_id_cube:string,ltv_manufacturer_id:string,country_id:string,ltv_click:double,ltv_install:double,ltv_valid_click:double,ltv_impression:double,ltv_unique_install_event_count:double,ltv_is_confident_install:string,rq_qualifying_flp_count:double,rq_participant_flp_count:double,it:string,colo:string>
2015-07-21 18:53:43,414 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(124)) -
<MAP>Id =4
<Children>
<TS>Id =0
<Children>
<FIL>Id =1
<Children>
<SEL>Id =2
<Children>
<FS>Id =3
<Children>
<\Children>
<Parent>Id = 2 null<\Parent>
<\FS>
<\Children>
<Parent>Id = 1 null<\Parent>
<\SEL>
<\Children>
<Parent>Id = 0 null<\Parent>
<\FIL>
<\Children>
<Parent>Id = 4 null<\Parent>
<\TS>
<\Children>
<Parent><\Parent>
<\MAP>
2015-07-21 18:53:43,417 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:initialize(337)) - Initializing Self 4 MAP
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initialize(337)) - Initializing Self 0 TS
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initializeChildren(410)) - Operator 0 TS initialized
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initializeChildren(414)) - Initializing children of 0 TS
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initialize(449)) - Initializing child 1 FIL
2015-07-21 18:53:43,420 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initialize(337)) - Initializing Self 1 FIL
2015-07-21 18:53:44,028 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initializeChildren(410)) - Operator 1 FIL initialized
2015-07-21 18:53:44,029 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initializeChildren(414)) - Initializing children of 1 FIL
2015-07-21 18:53:44,029 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initialize(449)) - Initializing child 2 SEL
2015-07-21 18:53:44,029 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initialize(337)) - Initializing Self 2 SEL
2015-07-21 18:53:44,033 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (SelectOperator.java:initializeOp(63)) - SELECT struct<impression_id:string,request_ad_formatter:string,request_ad_logic:string,request_ad_format:string,adgroup_id:string,ad_inc_id:int,unused6:string,unused7:string,adv_account_guid:string,rq_campgnidbig:string,country_carrier_id:bigint,unused11:string,unused12:string,request_code_version:int,request_handset_user_agent:string,handset_device_id:bigint,request_host:string,unused17:string,request_market:string,request_nfr:string,request_nodeinfo:string,request_orig_handset:string,request_page_url:string,site_guid:string,request_time:timestamp,age:string,gender:string,request_version:bigint,request_ip:string,request_x_user_agent:string,request_x_header:string,click_x_real_ip:string,page_requests:double,valid_page_requests:double,total_ad_requests:double,valid_ad_requests:double,served_impressions:double,page_impressions:double,request_mkcpcadserved:double,click_ccid:int,unused40:string,click_fraud:string,click_fraudset:string,click_handsetid:string,click_jc:string,cl_rq_ccid:bigint,click_request_device_id:bigint,cl_rq_site_inc_id:bigint,cl_rq_ua:string,click_terminated:string,click_time:timestamp,click_version:bigint,click_uid:string,billed_status:string,billed_createdon:string,unused55:string,unused56:string,billing_impression_type:string,unused58:string,unused59:string,bl_loggingtime:timestamp,unused61:string,bl_siteid:string,bl_adgrpid:string,click:double,total_burn:double,agency_revenue:double,pub_revenue:double,request_slot_id:bigint,request_slot_served:bigint,request_uid:string,unused71:string,unused72:string,rq_loc_src:string,request_geo_city:bigint,rq_geo_region:string,unused76:string,unused77:string,unused78:string,bl_overbill_revenue:double,cl_overbill_cpc_clicks:double,download_time:timestamp,matched_conversions:double,request_intg_method:string,request_intg_version:string,request_intg_origin:string,request_intg_family:string,integration_direct:string,dl_app_id:string,download_u_id:string,unused90:string,unused91:string,download_hash_type:string,joined_click_hash_type:string,non_billable_impressions:double,rq_overbill_cpm_adimp:double,non_billable_cpc_clicks:double,terminated_clicks:double,fraud_clicks:double,nofund_revenue:double,download_source:string,rq_udid_type:string,request_adtype:string,download_goal:string,dl_impid:string,download_joined_count:double,download_unjoined_count:double,download_duplicate_count:double,dl_udid_type:string,cl_udid_type:string,dl_terminated:string,cl_id:string,ad_response_format:string,unused113:string,dcp_page_requests:double,dcp_valid_page_requests:double,dcp_ad_requests:double,dcp_valid_ad_requests:double,dcp_page_impressions:double,dcp_cpc_impressions:double,dcp_total_clicks:double,dcp_fraud_clicks:double,dcp_billed_cpc_clicks:double,dcp_non_billable_cpc_clicks:double,dcp_cpm_impressions:double,dcp_non_billable_cpm_impressions:double,dcp_total_burn:double,dcp_pub_revenue:double,dcp_agency_revenue:double,dcp_cpm_clicks:double,dcp_cpc_beacon_count:double,dcp_cpm_beacon_count:double,user_optout:string,user_unique_count_internal:double,user_valid_page_requests:double,user_valid_ad_requests:double,user_ad_impressions:double,user_page_impressions:double,user_custom_segment_id_segment_retargeting:bigint,user_segment_valid_ad_requests:double,user_segment_unique_count:double,rm_sprout_id:string,rm_time:string,rm_source_name:string,rm_expand_count:double,rm_dismiss_count:double,rm_cta_count:double,rm_media_play_count:double,rm_media_auto_play_count:double,rm_media_start_count:double,rm_media_q1_count:double,rm_media_q2_count:double,rm_media_q3_count:double,rm_media_end_count:double,rm_dwell_time:double,rm_start_millis:string,rm_end_millis:string,rm_total:double,rm_views:double,rm_dls_count:double,rm_dlf_count:double,request_csid:string,cl_final_landing_page:string,rq_aud_seg_ids:string,rq_conceptual_rollover:string,rq_conceptual_ron:string,rq_concept_persona_id:string,rq_blinded_site_id:string,rq_tagged_user:string,rq_u_aid:string,rq_inventory_type:string,unused171:string,unused172:string,request_is_geo_enabled:string,request_geo_fence:string,cp_user_frequency:string,cp_user_unique_count_internal:double,is_impression_geo_targeted:string,geo_targeting_constituent:string,request_system_latlon:string,rq_served_city:string,rq_geo_state:string,rq_geo_zip:string,nondiscounted_burn:double,request_ref_tag:string,down_carrier_region_id:string,down_carrier_city_id:int,request_selected_uid_type:string,request_all_uid_type:string,request_uparams:string,request_uid_params:string,unused191:string,ci_ret_event_type:string,ci_ret_adgroup_id:bigint,ci_ret_unique_count:double,ci_ret_ad_request:double,ci_ret_ad_impressions:double,ci_ret_page_request:double,ci_ret_page_impressions:double,app_ret_app_id:string,app_ret_unique_count:double,app_ret_ad_requests:double,app_ret_ad_impressions:double,app_ret_page_request:double,app_ret_page_impressions:double,user_sig_unique_count:double,user_signal_ad_impressions:double,user_signal_clicks:double,user_signal_ download:double,user_signal_revenue:double,user_signal_ publisher_revenue:double,user_signal_ agency_revenue:double,user_life_span:string,user_life_unique_count:double,dcp_fraud_beacons:double,request_derived_latlon:string,request_custom_region_fence:string,volume_discount:double,creative_charges:double,io_discount:double,withhold_taxes:double,bl_fund_source_id:int,user_site_visited_count:double,user_app_dist_unique_count:double,request_geo_type:string,budget_tier_id:bigint,served_ad_format:string,request_conv_factor:double,segment_id:bigint,rq_optout:string,bc_id:string,beacon_time:timestamp,bc_terminated:string,bc_terminationreason:string,bc_fraud:string,beacon_fraudset:string,bc_total_pings:double,bc_valid_pings:double,bc_fraud_pings:double,bc_terminated_pings:double,bc_click_no_pings:double,rq_id:string,event_time:timestamp,predicted_clicks:double,rq_adgrpincid:string,request_muh:double,request_mul:double,request_mucons:double,request_ecpm_goalseek:double,request_muest:double,async_type:string,async_method:string,unused252:string,template_id:bigint,demand_capabilities_ids:string,request_creative_inc_id:int,effective_slot_width:double,effective_slot_height:double,creative_height:double,creative_width:double,bl_data_seller_id:int,bl_data_provider_id:int,data_enrichment_cost:double,cpm_billed_beacons:double,rq_yob:string,rq_interests:string,rq_user_country:string,rq_user_city:string,rq_user_zip:string,rq_user_loc_type:string,rq_rtbs_pub_id:string,rq_rtbs_site_name:string,rq_rtbs_site_url:string,rq_rtbs_site_platform:string,supply_source_type:string,participated_impressions:double,cbp_segment_id:bigint,device_orientation:string,device_localization:string,device_networktype:string,request_discarded_u_id_params:string,request_ad_frequency:string,request_ad_recency:string,request_adgroup_frequency:string,request_adgroup_recency:string,rq_int_orientation:string,bl_data_event_type:string,request_apbssid:string,request_req_dst:string,request_fill_dst:string,request_served_dst:string,predicted_ecpm:double,request_learning_auction_type:string,rq_auction_conv_factor:double,request_placement_id:bigint,custom_segment_id:string,user_factual_unique_count:double,user_factual_valid_ad_requests:double,install_count:double,normalized_user_id:string,rq_user_profile_version:string,rq_app_affinity_version:string,rq_user_features:string,auto_computed_lambda:double,user_lambda:double,lambda_used:double,normal_burn:double,risky_burn:double,is_predicted_cvr_null:boolean,is_super_tier:string,learning_phase:string,request_predicted_engagement_map:string,request_predicted_expand_rate:double,request_poi_map:string,impression_poi_map:string,request_cat_distance:double,rq_category:string,cl_event_state:string,click_other_invalidset:string,accidental_clicks:double,custom_ad_unit_id:int,same_adv_second_adid:string,same_adv_second_advid:string,user_location_context:double,user_location_context_ad_req:double,user_location_context_page_req:string,user_location_context_unique_count:double,rq_asm_segment_id:string,diff_adv_second_adid:string,diff_adv_second_advid:string,diff_adv_second_ranks:string,num_candidate_ads:string,num_candidate_adgroups:string,num_candidate_advs:string,same_adv_second_ranks:string,cl_conv_factor:double,rq_geoseg_type:string,user_enrich_pg_req:double,user_enrich_pg_imp:double,user_enrich_valid_clicks:double,user_enrich_total_burn:double,rq_deal_id:int,rq_highest_bid:double,rq_bid_floor:double,rq_highbid_dst:string,rq_predicted_media_quartile:double,rq_predicted_cta:double,rm_custom_count:double,rm_media_stop_value:double,rm_custom_value:double,rm_media_stop_count:double,rm_media_error_count:double,rm_media_id:string,rm_media_type:string,rm_custom_action:string,rm_custom_label:string,rm_custom_catgeory:string,rq_device_modelid:string,rq_is_vbssid:boolean,dl_confident_install:double,dl_confident_conversion:double,rq_target_cpd:double,rq_geodata_vendor_id:string,rq_serving_cpc_floor:double,rq_concept_id:string,segmentdemand_served_imp:double,segmentdemand_valid_clicks:double,segmentdemand_download_installs:double,segmentdemand_total_burn:double,segmentdemand_rendered_imp:double,rq_is_adgroup_subsidized:boolean,rq_adgroup_stage:string,rq_is_subsidy_impression:boolean,rq_is_muest_null:boolean,rq_is_derived_site_placement_id:boolean,rq_site_placement_id:string,rm_unique_media_play_count:double,rm_unique_media_auto_play_count:double,rm_unique_media_start_count:double,rm_unique_media_q1_count:double,rm_unique_media_q2_count:double,rm_unique_media_q3_count:double,rm_unique_media_complete_count:double,rm_form_submit_success_count:double,rm_form_submit_failure_count:double,rm_form_submit_attempt_count:double,rm_unique_form_submit_success_count:double,rm_unique_form_submit_failure_count:double,rm_unique_form_submit_attempt_count:double,rq_served_location_source:string,rq_served_location_level_of_targeting:string,rq_served_location_id:string,rq_primary_cities:string,ltv_event_time:timestamp,ltv_event_name:string,ltv_event_value:double,ltv_event_count:double,pub_account_guid:string,site_inc_id:string,operating_system_id:string,device_type_id_cube:string,ltv_manufacturer_id:string,country_id:string,ltv_click:double,ltv_install:double,ltv_valid_click:double,ltv_impression:double,ltv_unique_install_event_count:double,ltv_is_confident_install:string,rq_qualifying_flp_count:double,rq_participant_flp_count:double,it:string,colo:string>
2015-07-21 18:53:44,049 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initializeChildren(410)) - Operator 2 SEL initialized
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initializeChildren(414)) - Initializing children of 2 SEL
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initialize(449)) - Initializing child 3 FS
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initialize(337)) - Initializing Self 3 FS
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2015-07-21 18:53:44,129 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-07-21 18:53:44,130 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initializeChildren(410)) - Operator 3 FS initialized
2015-07-21 18:53:44,130 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initialize(385)) - Initialization Done 3 FS
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initialize(385)) - Initialization Done 2 SEL
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initialize(385)) - Initialization Done 1 FIL
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initialize(385)) - Initialization Done 0 TS
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:initialize(385)) - Initialization Done 4 MAP
2015-07-21 18:53:44,164 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (MapOperator.java:cleanUpInputFileChangedOp(480)) - Processing alias rrcube for file file:/Users/rajat.khandelwal/2015-07-18-02
2015-07-21 18:53:44,264 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - Hadoop job information for null: number of mappers: 0; number of reducers: 0
2015-07-21 18:53:44,320 WARN [main]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2015-07-21 18:53:44,320 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - 2015-07-21 18:53:44,316 null map = 0%, reduce = 0%
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_conceptual_rollover
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_conceptual_ron
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_tagged_user
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_inventory_type
2015-07-21 18:53:44,658 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_id
2015-07-21 18:53:44,658 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_adgrpincid
2015-07-21 18:53:44,659 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_user_features
2015-07-21 18:53:44,660 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_is_muEst_null
2015-07-21 18:53:44,661 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (FileSinkOperator.java:createBucketForFileIdx(470)) - Final Path: FS file:/tmp/hive-rajat.khandelwal/hive_2015-07-21_18-53-36_782_7786845390666999875-2/_tmp.-ext-10002/000000_0
2015-07-21 18:53:44,661 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (FileSinkOperator.java:createBucketForFileIdx(472)) - Writing to temp file: FS file:/tmp/hive-rajat.khandelwal/hive_2015-07-21_18-53-36_782_7786845390666999875-2/_task_tmp.-ext-10002/_tmp.000000_0
2015-07-21 18:53:44,662 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (FileSinkOperator.java:createBucketForFileIdx(487)) - New Final Path: FS file:/tmp/hive-rajat.khandelwal/hive_2015-07-21_18-53-36_782_7786845390666999875-2/_tmp.-ext-10002/000000_0
2015-07-21 18:53:44,712 FATAL [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:map(194)) - org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:550)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41)
at org.apache.hadoop.hive.serde2.lazy.LazyUtils.writePrimitiveUTF8(LazyUtils.java:189)
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:486)
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serializeField(LazySimpleSerDe.java:439)
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:423)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:583)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:137)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:92)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:540)
... 10 more
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:close(574)) - 4 finished. closing...
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:logStats(838)) - DESERIALIZE_ERRORS:0
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:close(574)) - 0 finished. closing...
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:close(574)) - 1 finished. closing...
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:logStats(838)) - FILTERED:0
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:logStats(838)) - PASSED:0
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:close(574)) - 2 finished. closing...
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:close(574)) - 3 finished. closing...
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:close(591)) - 3 Close done
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:close(591)) - 2 Close done
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:close(591)) - 1 Close done
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:close(591)) - 0 Close done
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:close(591)) - 4 Close done
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:close(249)) - ExecMapper: processed 0 rows: used memory = 131967800
2015-07-21 18:53:44,726 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2015-07-21 18:53:44,727 WARN [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local2017936282_0001
java.lang.Exception: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:195)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
]
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:550)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177)
... 9 more
Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41)
at org.apache.hadoop.hive.serde2.lazy.LazyUtils.writePrimitiveUTF8(LazyUtils.java:189)
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:486)
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serializeField(LazySimpleSerDe.java:439)
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:423)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:583)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:137)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:92)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:540)
... 10 more
2015-07-21 18:53:45,365 WARN [main]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2015-07-21 18:53:45,366 ERROR [main]: mr.ExecDriver (SessionState.java:printError(572)) - Ended Job = job_local2017936282_0001 with errors
2015-07-21 18:53:45,368 ERROR [Thread-259]: mr.ExecDriver (SessionState.java:printError(572)) - Error during job, obtaining debugging information...
2015-07-21 18:53:45,368 INFO [Thread-259]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment