Skip to content

Instantly share code, notes, and snippets.

@risyomei
Created June 28, 2023 12:18
Show Gist options
  • Save risyomei/d602a86d14f4d72170701dadb528559a to your computer and use it in GitHub Desktop.
Save risyomei/d602a86d14f4d72170701dadb528559a to your computer and use it in GitHub Desktop.
./build/mvn install ${MVN_OPT} -pl externals/kyuubi-spark-sql-engine -Pspark-3.2 -Dsuites=org.apache.kyuubi.engine.spark.operation.SparkOperationSuite
[INFO] --- scalatest-maven-plugin:2.2.0:test (test) @ kyuubi-spark-sql-engine_2.12 ---
[INFO] ScalaTest report directory: /Users/lxm/projects/kyuubi/externals/kyuubi-spark-sql-engine/target/surefire-reports
Run starting. Expected test count is: 62
SparkOperationSuite:
ANTLR Tool version 4.8 used for code generation does not match the current runtime version 4.9.3
ANTLR Runtime version 4.8 used for parser compilation does not match the current runtime version 4.9.3
ANTLR Tool version 4.8 used for code generation does not match the current runtime version 4.9.3
ANTLR Runtime version 4.8 used for parser compilation does not match the current runtime version 4.9.3
- get catalogs
- get schemas
- get tables
- get type info
- get tables - hive catalog
- audit Kyuubi Hive JDBC connection common MetaData
- execute statement - select null
- execute statement - select boolean
- execute statement - select tinyint
- execute statement - select smallint
- execute statement - select int
- execute statement - select long
- execute statement - select float
- execute statement - select double
- execute statement - select string
- execute statement - select binary
- execute statement - select date
- execute statement - select timestamp - second
- execute statement - select timestamp - millisecond
- execute statement - select timestamp - overflow
- execute statement - select timestamp_ntz !!! CANCELED !!!
3.2 was not greater than or equal to "3.4" (SparkDataTypeTests.scala:203)
- execute statement - select daytime interval
- execute statement - select year/month interval
- execute statement - select array
- execute statement - select map
- execute statement - select struct
- execute statement - analysis exception
- execute statement - select with variable substitution
- execute statement - select with builtin functions
- query time out shall respect client-side if no server-side control
- kyuubi defined function - kyuubi_version
- kyuubi defined function - engine_name
- kyuubi defined function - engine_id
- KYUUBI #1059: Plan only operations
- execute simple scala code
- execute simple scala code with result returned
- incomplete scala code block will fail
- scala code compile error will fail
- scala code with console output
import java.io.{BufferedOutputStream, File, FileOutputStream}
dir: String = /Users/lxm/projects/kyuubi/externals/kyuubi-spark-sql-engine/target/tmp/spark-f3ee8e4d-5ac7-4c23-bb01-2f04ab97d739/repl-1ac474e6-fb03-47dc-a5e9-a89ab4c145d0
jarFile: java.io.File = /Users/lxm/projects/kyuubi/externals/kyuubi-spark-sql-engine/target/tmp/spark-f3ee8e4d-5ac7-4c23-bb01-2f04ab97d739/repl-1ac474e6-fb03-47dc-a5e9-a89ab4c145d0/test-function-93ae854b-3464-45f9-be6e-83d2df61fdb2.jar
bos: java.io.BufferedOutputStream = java.io.BufferedOutputStream@7a4f7042
path: String = UEsDBBQACAgIADmp3FYAAAAAAAAAAAAAAAAVAAQAdGVzdC91dGlscy9NYXRoLmNsYXNz/soAAF1QTW/TQBCdsbN2neZrAwGSiqKWCjWg1FgNEW2EkJPSyCihOKFIIHEY25vUxbHVxEb0wD/ixKEHDvwAfhRiU8SlKz3Nm9mnN5r3+8/PXwDQhgZCORXL1MzSMFqaI0rPdECEyjl9ITOieGaeeOfCT3VQEcyVtDUVwus8pWnL6/jUaj/f329R4IkWta1gGpDf9judvaVPESFsDq+JuRDTSLqYk1U3CWcxpdlCdBGYdylNEa40/HbgYk81lKbl4pGsz2wXj5Epp7Zrr+onw956Z2XuY07UQ+3zeDiI72sKZ1u2+fEw0xG3qY8ltcb/6d5wbucM9YETcmSa8pA1reSDNe8/4pbKFF09HO4+abSV4sXr2d5G92WTuZxsSzjjOgaDMmcvnGoPS5wVHVHaZNpBEYs4QOViu0kBElrM4BUElYJAnrHrOE0HAb9KXMr8boS6o0MRQR+dHJ0OX+0gVIc3Bd0ClKFiQAl4AQzI5yW7hZDrJ4GQfiORniXBW1rQXKRiIRPLT5Js4YvjMJL/9XEWp+FcvA+XoRcJO46TlNIwiaVw7X/oYIECOVg9lCvkEtnXZFcDVTIA4wdUGxtXcPv7tejOaqTAOlSgIKHCXTlQgME9WdelhyahL2EN6nKgMoC/UEsHCP7r26vfAQAAWAIAAFBLAwQUAAgICAA5qdxWAAAAAAAAAAAAAAAAFgAAAHRlc3QvdX...
jarPath: String = /Users/lxm/projects/kyuubi/externals/kyuubi-spark-sql-engine/target/tmp/spark-f3ee8e4d-5ac7-4c23-bb01-2f04ab97d739/repl-1ac474e6-fb03-47dc-a5e9-a89ab4c145d0/test-function-93ae854b-3464-45f9-be6e-83d2df61fdb2.jar
fileSize: Long = 1186
- scala code with loading external package at runtime
- kyuubi #3311: Operation language with an incorrect value
- operation metadata hint - __kyuubi_operation_result_format__
- get table types
- audit Spark engine MetaData
- get columns operation
- get columns operation should handle interval column properly
- handling null in view for get columns operations
- get functions
- execute statement - select decimal
- execute statement - select column name with dots
- test fetch orientation
- test fetch orientation with incremental collect mode
- get operation status
- basic open | execute | close
- set session conf
- set session conf - static and core
- set session conf - wrong database
- not allow to operate closed session or operation
- env:* variables can not be set
- test variable substitution
- cancel operation
- send credentials by TRenewDelegationTokenReq
Run completed in 27 seconds, 912 milliseconds.
Total number of tests run: 61
Suites: completed 1, aborted 0
Tests: succeeded 61, failed 0, canceled 1, ignored 0, pending 0
All tests passed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment