Skip to content

Instantly share code, notes, and snippets.

@bashir2
Created May 25, 2023 06:31
Show Gist options
  • Save bashir2/434c11324fc2df2535a0cf658864390e to your computer and use it in GitHub Desktop.
Save bashir2/434c11324fc2df2535a0cf658864390e to your computer and use it in GitHub Desktop.
New Thrift server errors
spark-thriftserver | 23/05/25 06:27:37 INFO ThriftCLIService: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V10
spark-thriftserver | 23/05/25 06:27:37 INFO HiveSessionImpl: Operation log session directory is created: /tmp/spark/operation_logs/b6724ed8-d0ad-47fd-8376-e20b2a8e5a7d
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 5: get_database: default
spark-thriftserver | 23/05/25 06:27:37 INFO audit: ugi=spark ip=unknown-ip-addr cmd=get_database: default
spark-thriftserver | 23/05/25 06:27:37 WARN HiveConf: HiveConf of name hive.stats.jdbc.timeout does not exist
spark-thriftserver | 23/05/25 06:27:37 WARN HiveConf: HiveConf of name hive.stats.retries.wait does not exist
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 5: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
spark-thriftserver | 23/05/25 06:27:37 INFO ObjectStore: ObjectStore, initialize called
spark-thriftserver | 23/05/25 06:27:37 INFO MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY
spark-thriftserver | 23/05/25 06:27:37 INFO ObjectStore: Initialized ObjectStore
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Submitting query 'show tables' with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Running query with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 6: get_database: default
spark-thriftserver | 23/05/25 06:27:37 INFO audit: ugi=hive ip=unknown-ip-addr cmd=get_database: default
spark-thriftserver | 23/05/25 06:27:37 WARN HiveConf: HiveConf of name hive.stats.jdbc.timeout does not exist
spark-thriftserver | 23/05/25 06:27:37 WARN HiveConf: HiveConf of name hive.stats.retries.wait does not exist
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 6: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
spark-thriftserver | 23/05/25 06:27:37 INFO ObjectStore: ObjectStore, initialize called
spark-thriftserver | 23/05/25 06:27:37 INFO MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY
spark-thriftserver | 23/05/25 06:27:37 INFO ObjectStore: Initialized ObjectStore
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 6: get_database: default
spark-thriftserver | 23/05/25 06:27:37 INFO audit: ugi=hive ip=unknown-ip-addr cmd=get_database: default
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 6: get_tables: db=default pat=*
spark-thriftserver | 23/05/25 06:27:37 INFO audit: ugi=hive ip=unknown-ip-addr cmd=get_tables: db=default pat=*
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Result Schema: StructType(StructField(namespace,StringType,false),StructField(tableName,StringType,false),StructField(isTemporary,BooleanType,false))
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Received getNextRowSet request order=FETCH_NEXT and maxRowsL=1000 with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Returning result set with 24 rows from offsets [0, 24) with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Received getNextRowSet request order=FETCH_NEXT and maxRowsL=1000 with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Received getNextRowSet request order=FETCH_NEXT and maxRowsL=1000 with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO DAGScheduler: Asked to cancel job group 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO SparkExecuteStatementOperation: Close statement with 65ca8fc5-3ebb-4094-a18e-5c945792afa8
spark-thriftserver | 23/05/25 06:27:37 INFO ObjectStore: ObjectStore, initialize called
spark-thriftserver | 23/05/25 06:27:37 INFO MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY
spark-thriftserver | 23/05/25 06:27:37 INFO ObjectStore: Initialized ObjectStore
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 5: Cleaning up thread local RawStore...
spark-thriftserver | 23/05/25 06:27:37 INFO audit: ugi=hive ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
spark-thriftserver | 23/05/25 06:27:37 INFO HiveMetaStore: 5: Done cleaning up thread local RawStore
spark-thriftserver | 23/05/25 06:27:37 INFO audit: ugi=hive ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
spark-thriftserver | 23/05/25 06:27:37 ERROR TThreadPoolServer: Thrift error occurred during processing of message.
spark-thriftserver | org.apache.thrift.transport.TTransportException
spark-thriftserver | at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
spark-thriftserver | at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
spark-thriftserver | at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:374)
spark-thriftserver | at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:451)
spark-thriftserver | at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:433)
spark-thriftserver | at org.apache.thrift.transport.TSaslServerTransport.read(TSaslServerTransport.java:43)
spark-thriftserver | at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
spark-thriftserver | at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)
spark-thriftserver | at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)
spark-thriftserver | at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)
spark-thriftserver | at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
spark-thriftserver | at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:52)
spark-thriftserver | at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
spark-thriftserver | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
spark-thriftserver | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
spark-thriftserver | at java.base/java.lang.Thread.run(Thread.java:833)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment