Navigation Menu

Skip to content

Instantly share code, notes, and snippets.

@pvillard31
Created February 2, 2017 16:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save pvillard31/9a08650f9a80ef0fa7e161d71c0d9e9b to your computer and use it in GitHub Desktop.
Save pvillard31/9a08650f9a80ef0fa7e161d71c0d9e9b to your computer and use it in GitHub Desktop.
2017-02-02 15:17:39,342 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting the hadoop caller context to f4f2c170-dafc-487b-8e72-2f0da7cf6188 for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,343 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=compile from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,343 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:compile(417)) - We are setting the hadoop caller context from HIVE_SSN_ID:f4f2c170-dafc-487b-8e72-2f0da7cf6188 to hive_20170202151739_dd052a5e-0de3-44a0-b8fc-bf9a7b134c6e
2017-02-02 15:17:39,344 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=parse from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,344 INFO [HiveServer2-Handler-Pool: Thread-14784]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: LOAD DATA INPATH '/tmp/AYX170201a327cc8faf8e562f5eb86225dd1fbf57' INTO TABLE tmp.testpierre
2017-02-02 15:17:39,344 INFO [HiveServer2-Handler-Pool: Thread-14784]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed
2017-02-02 15:17:39,344 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=parse start=1486045059344 end=1486045059344 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,344 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=semanticAnalyze from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,344 INFO [HiveServer2-Handler-Pool: Thread-14784]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(747)) - 797: get_table : db=tmp tbl=testpierre
2017-02-02 15:17:39,345 INFO [HiveServer2-Handler-Pool: Thread-14784]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=10208h ip=unknown-ip-addr cmd=get_table : db=tmp tbl=testpierre
2017-02-02 15:17:39,363 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:compile(468)) - Semantic Analysis Completed
2017-02-02 15:17:39,363 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=semanticAnalyze start=1486045059344 end=1486045059363 duration=19 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:getSchema(248)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=compile start=1486045059343 end=1486045059364 duration=21 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:compile(545)) - We are resetting the hadoop caller context to HIVE_SSN_ID:f4f2c170-dafc-487b-8e72-2f0da7cf6188
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=Driver.run from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=TimeToSubmit from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:checkConcurrency(168)) - Concurrency mode is disabled, not creating a lock manager
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:execute(1390)) - Setting caller context to query id hive_20170202151739_dd052a5e-0de3-44a0-b8fc-bf9a7b134c6e
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:execute(1393)) - Starting command(queryId=hive_20170202151739_dd052a5e-0de3-44a0-b8fc-bf9a7b134c6e): LOAD DATA INPATH '/tmp/AYX170201a327cc8faf8e562f5eb86225dd1fbf57' INTO TABLE tmp.testpierre
2017-02-02 15:17:39,364 INFO [HiveServer2-Handler-Pool: Thread-14784]: hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook
2017-02-02 15:17:39,365 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=PreHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,365 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=PreHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1486045059365 end=1486045059365 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,365 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=TimeToSubmit start=1486045059364 end=1486045059365 duration=1 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,365 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=runTasks from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,365 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=task.MOVE.Stage-0 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,366 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:launchTask(1718)) - Starting task [Stage-0:MOVE] in serial mode
2017-02-02 15:17:39,366 INFO [HiveServer2-Handler-Pool: Thread-14784]: exec.Task (SessionState.java:printInfo(923)) - Loading data to table tmp.testpierre from hdfs://hadoopPROD/tmp/AYX170201a327cc8faf8e562f5eb86225dd1fbf57
2017-02-02 15:17:39,366 INFO [HiveServer2-Handler-Pool: Thread-14784]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(747)) - 797: get_table : db=tmp tbl=testpierre
2017-02-02 15:17:39,366 INFO [HiveServer2-Handler-Pool: Thread-14784]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=10208h ip=unknown-ip-addr cmd=get_table : db=tmp tbl=testpierre
2017-02-02 15:17:39,387 INFO [HiveServer2-Handler-Pool: Thread-14784]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(747)) - 797: get_table : db=tmp tbl=testpierre
2017-02-02 15:17:39,387 INFO [HiveServer2-Handler-Pool: Thread-14784]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=10208h ip=unknown-ip-addr cmd=get_table : db=tmp tbl=testpierre
2017-02-02 15:17:39,407 INFO [HiveServer2-Handler-Pool: Thread-14784]: metadata.Hive (Hive.java:moveFile(2689)) - Renaming src: hdfs://hadoopPROD/tmp/AYX170201a327cc8faf8e562f5eb86225dd1fbf57, dest: hdfs://hadoopPROD/apps/hive/warehouse/tmp.db/testpierre/AYX170201a327cc8faf8e562f5eb86225dd1fbf57, Status:true
2017-02-02 15:17:39,411 INFO [HiveServer2-Handler-Pool: Thread-14784]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(747)) - 797: alter_table: db=tmp tbl=testpierre newtbl=testpierre
2017-02-02 15:17:39,411 INFO [HiveServer2-Handler-Pool: Thread-14784]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=10208h ip=unknown-ip-addr cmd=alter_table: db=tmp tbl=testpierre newtbl=testpierre
2017-02-02 15:17:39,435 INFO [HiveServer2-Handler-Pool: Thread-14784]: hive.log (MetaStoreUtils.java:updateUnpartitionedTableStatsFast(217)) - Updating table stats fast for testpierre
2017-02-02 15:17:39,435 INFO [HiveServer2-Handler-Pool: Thread-14784]: hive.log (MetaStoreUtils.java:updateUnpartitionedTableStatsFast(219)) - Updated size of table testpierre to 156239
2017-02-02 15:17:39,446 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=runTasks start=1486045059365 end=1486045059446 duration=81 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,446 INFO [HiveServer2-Handler-Pool: Thread-14784]: hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook
2017-02-02 15:17:39,446 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1486045059446 end=1486045059447 duration=1 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (Driver.java:execute(1621)) - Resetting the caller context to HIVE_SSN_ID:f4f2c170-dafc-487b-8e72-2f0da7cf6188
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=Driver.execute start=1486045059364 end=1486045059447 duration=83 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: ql.Driver (SessionState.java:printInfo(923)) - OK
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=releaseLocks start=1486045059447 end=1486045059447 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=Driver.run start=1486045059364 end=1486045059447 duration=83 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,447 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,450 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting the hadoop caller context to f4f2c170-dafc-487b-8e72-2f0da7cf6188 for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,450 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,450 WARN [HiveServer2-Handler-Pool: Thread-14784]: thrift.ThriftCLIService (ThriftCLIService.java:GetResultSetMetadata(662)) - Error getting result set metadata:
java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
at com.sun.proxy.$Proxy39.getResultSetMetadata(Unknown Source)
at org.apache.hive.service.cli.CLIService.getResultSetMetadata(CLIService.java:435)
at org.apache.hive.service.cli.thrift.ThriftCLIService.GetResultSetMetadata(ThriftCLIService.java:658)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$GetResultSetMetadata.getResult(TCLIService.java:1537)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$GetResultSetMetadata.getResult(TCLIService.java:1522)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.hive.service.cli.TableSchema.<init>(TableSchema.java:51)
at org.apache.hive.service.cli.TableSchema.<init>(TableSchema.java:57)
at org.apache.hive.service.cli.operation.SQLOperation.getResultSetSchema(SQLOperation.java:324)
at org.apache.hive.service.cli.operation.OperationManager.getOperationResultSetSchema(OperationManager.java:212)
at org.apache.hive.service.cli.session.HiveSessionImpl.getResultSetMetadata(HiveSessionImpl.java:704)
at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
... 18 more
2017-02-02 15:17:39,451 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting the hadoop caller context to f4f2c170-dafc-487b-8e72-2f0da7cf6188 for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,451 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,451 WARN [HiveServer2-Handler-Pool: Thread-14784]: thrift.ThriftCLIService (ThriftCLIService.java:FetchResults(681)) - Error fetching results:
java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:83)
at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
at com.sun.proxy.$Proxy39.fetchResults(Unknown Source)
at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:454)
at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:672)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1557)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1542)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.hive.service.cli.RowBasedSet.<init>(RowBasedSet.java:40)
at org.apache.hive.service.cli.RowSetFactory.create(RowSetFactory.java:32)
at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:336)
at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:223)
at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:716)
at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
... 18 more
2017-02-02 15:17:39,453 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting the hadoop caller context to f4f2c170-dafc-487b-8e72-2f0da7cf6188 for thread HiveServer2-Handler-Pool: Thread-14784
2017-02-02 15:17:39,453 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,453 INFO [HiveServer2-Handler-Pool: Thread-14784]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=releaseLocks start=1486045059453 end=1486045059453 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2017-02-02 15:17:39,453 INFO [HiveServer2-Handler-Pool: Thread-14784]: session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-14784
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment