Skip to content

Instantly share code, notes, and snippets.

@paulfryzel
Created September 3, 2020 18:23
Show Gist options
  • Save paulfryzel/1462eb3b2fae5e3abdb80f4ef0b86f75 to your computer and use it in GitHub Desktop.
Save paulfryzel/1462eb3b2fae5e3abdb80f4ef0b86f75 to your computer and use it in GitHub Desktop.
$ sbt clean compile
[info] welcome to sbt 1.3.13 (Private Build Java 1.8.0_265)
[info] loading global plugins from /home/pfryzel/.sbt/1.0/plugins
[info] loading settings for project sparksql-scalapb-build from plugins.sbt ...
[info] loading project definition from /home/pfryzel/workspace/github/sparksql-scalapb/project
[info] loading settings for project root from version.sbt,build.sbt,sonatype.sbt ...
[info] set current project to root (in build file:/home/pfryzel/workspace/github/sparksql-scalapb/)
[info] Executing in batch mode. For better performance use sbt's shell
[success] Total time: 0 s, completed Sep 3, 2020 2:20:15 PM
[info] Compiling 9 Scala sources to /home/pfryzel/workspace/github/sparksql-scalapb/sparksql-scalapb/target/scala-2.12/classes ...
[error] /home/pfryzel/workspace/github/sparksql-scalapb/sparksql-scalapb/src/main/scala/scalapb/spark/FromCatalystHelpers.scala:185:81: parameter 'nullable' is already specified at parameter position 3
[error] val keyLoopVar = LambdaVariable(keyLoopValue, "", mapType.keyType, nullable = false)
[error] ^
[error] /home/pfryzel/workspace/github/sparksql-scalapb/sparksql-scalapb/src/main/scala/scalapb/spark/FromCatalystHelpers.scala:192:55: type mismatch;
[error] found : String
[error] required: org.apache.spark.sql.types.DataType
[error] val valueLoopVar = LambdaVariable(valueLoopValue, valueLoopIsNull, mapType.valueType)
[error] ^
[error] /home/pfryzel/workspace/github/sparksql-scalapb/sparksql-scalapb/src/main/scala/scalapb/spark/FromCatalystHelpers.scala:192:80: type mismatch;
[error] found : org.apache.spark.sql.types.DataType
[error] required: Boolean
[error] val valueLoopVar = LambdaVariable(valueLoopValue, valueLoopIsNull, mapType.valueType)
[error] ^
[error] /home/pfryzel/workspace/github/sparksql-scalapb/sparksql-scalapb/src/main/scala/scalapb/spark/FromCatalystHelpers.scala:193:5: overloaded method value apply with alternatives:
[error] (keyLoopVar: org.apache.spark.sql.catalyst.expressions.objects.LambdaVariable,keyLambdaFunction: org.apache.spark.sql.catalyst.expressions.Expression,valueLoopVar: org.apache.spark.sql.catalyst.expressions.objects.LambdaVariable,valueLambdaFunction: org.apache.spark.sql.catalyst.expressions.Expression,inputData: org.apache.spark.sql.catalyst.expressions.Expression,collClass: Class[_])org.apache.spark.sql.catalyst.expressions.objects.CatalystToExternalMap <and>
[error] (u: org.apache.spark.sql.catalyst.expressions.objects.UnresolvedCatalystToExternalMap)org.apache.spark.sql.catalyst.expressions.objects.CatalystToExternalMap
[error] cannot be applied to (String, org.apache.spark.sql.catalyst.expressions.Expression, String, String, org.apache.spark.sql.catalyst.expressions.Expression, org.apache.spark.sql.catalyst.expressions.Expression, Class[_$4])
[error] CatalystToExternalMap(
[error] ^
[error] four errors found
[error] (sparkSqlScalaPB / Compile / compileIncremental) Compilation failed
[error] Total time: 5 s, completed Sep 3, 2020 2:20:20 PM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment