Skip to content

Instantly share code, notes, and snippets.

@M2shad0w

M2shad0w/spark_package$TreeNodeException: execute

Created February 2, 2016 06:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save M2shad0w/9823834270a80eeeb743 to your computer and use it in GitHub Desktop.
Save M2shad0w/9823834270a80eeeb743 to your computer and use it in GitHub Desktop.
Download ZIP
spark sql error
Raw
spark_package$TreeNodeException: execute
Caused by: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree:
TungstenExchange hashpartitioning(additional#3,200), None
+- TungstenAggregate(key=[additional#3], functions=[(count(additional#3),mode=Partial,isDistinct=false)], output=[additional#3,count#81L])
+- Project [additional#3]
+- Filter (((created_at#0 >= 2016-01-25) && (created_at#0 < 2016-01-26)) && (action#2 = search))
+- InMemoryColumnarTableScan [additional#3,created_at#0,action#2], [(created_at#0 >= 2016-01-25),(created_at#0 < 2016-01-26),(action#2 = search)], InMemoryRelation [created_at#0,eventable_type#1,action#2,additional#3,track_id#4,device#5,city_code#6], true, 10000, StorageLevel(true, true, false, true, 1), ConvertToUnsafe, Some(tracklogs)
at org.apache.spark.sql.catalyst.errors.package$.attachTree(package.scala:49)
@M2shad0w
Copy link
Author

M2shad0w commented Feb 3, 2016

because the sc.textFile is null

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment