Skip to content

Instantly share code, notes, and snippets.

spec:
clusterConfig:
listenerClass: null
nameNodes:
config:
listenerClass: external-unstable
dataNodes:
config:
listenerClass: external-unstable
@razvan
razvan / Error listing
Created November 3, 2020 14:53
spark-sql-streaming-jdbc 2.11 2.4.0 cannot handle Date and Timestamp objects
JdbcStreamWriteSuite:
- Basic Write *** FAILED ***
org.apache.spark.sql.streaming.StreamingQueryException: Query [id = 64724d7c-f563-40bf-b482-361d71ff2159, runId = 8cac0bc9-a2e5-4956-b9c8-4376ccde7f7f] terminated with exception: Writing job aborted.
at org.apache.spark.sql.execution.streaming.StreamExecution.org$apache$spark$sql$execution$streaming$StreamExecution$$runStream(StreamExecution.scala:295)
at org.apache.spark.sql.execution.streaming.StreamExecution$$anon$1.run(StreamExecution.scala:189)
...
Cause: org.apache.spark.SparkException: Writing job aborted.
at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec.doExecute(WriteToDataSourceV2Exec.scala:92)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)