Skip to content

Instantly share code, notes, and snippets.

@maropu
Last active August 24, 2021 04:31
Show Gist options
  • Save maropu/b3b1cf026dad9b1edade7c1c279bf49c to your computer and use it in GitHub Desktop.
Save maropu/b3b1cf026dad9b1edade7c1c279bf49c to your computer and use it in GitHub Desktop.
$ ./build/mvn clean test -DmemoryFiles=rerun.txt
$ cat
TestFailed Some(org.apache.spark.api.python.RepairSuite) org.apache.spark.api.python.RepairSuite None
TestFailed Some(org.apache.spark.api.python.DepGraphSuite) org.apache.spark.api.python.DepGraphSuite Some(computeFunctionalDepMap)
$ ./build/mvn clean test -DtestsFiles=rerun.txt
Run starting. Expected test count is: 5
DepGraphSuite:
13:29:58.598 WARN org.apache.spark.util.Utils: Your hostname, maropus-MacBook-Pro.local resolves to a loopback address: 127.0.0.1; using 192.168.3.2 instead (on interface en0)
13:29:58.599 WARN org.apache.spark.util.Utils: Set SPARK_LOCAL_IP if you need to bind to another address
13:29:58.878 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
- generateDepGraph *** FAILED ***
org.scalatest.exceptions.TestFailedException was thrown. (DepGraphSuite.scala:42)
- graph image generation *** FAILED ***
org.scalatest.exceptions.TestFailedException was thrown. (DepGraphSuite.scala:165)
- computeFunctionalDeps *** FAILED ***
org.scalatest.exceptions.TestFailedException was thrown. (DepGraphSuite.scala:198)
- computeFunctionalDepMap *** FAILED ***
org.scalatest.exceptions.TestFailedException was thrown. (DepGraphSuite.scala:219)
13:30:00.902 WARN org.apache.spark.api.python.DepGraphSuite:
===== POSSIBLE THREAD LEAK IN SUITE o.a.s.api.python.DepGraphSuite, thread names: rpc-boss-3-1, shuffle-boss-6-1 =====
RepairSuite:
- convertToDiscretizedTable *** FAILED ***
org.apache.spark.sql.AnalysisException: Can not create the managed table('`hospital`'). The associated location('file:/Users/maropu/Repositories/spark/spark-data-repair-plugin/spark-warehouse/org.apache.spark.api.python.RepairSuite/hospital') already exists.
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.validateTableLocation(SessionCatalog.scala:357)
at org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:170)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:108)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:106)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.doExecute(commands.scala:131)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:180)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:218)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:215)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:176)
...
13:30:04.215 WARN org.apache.spark.api.python.RepairSuite:
===== POSSIBLE THREAD LEAK IN SUITE o.a.s.api.python.RepairSuite, thread names: rpc-boss-9-1, shuffle-boss-12-1 =====
Run completed in 5 seconds, 988 milliseconds.
Total number of tests run: 5
Suites: completed 2, aborted 0
Tests: succeeded 0, failed 5, canceled 0, ignored 0, pending 0
*** 5 TESTS FAILED ***
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment