Skip to content

Instantly share code, notes, and snippets.

@hiimivantang

hiimivantang/dbsql_endpoint.config

Last active January 23, 2022 01:25
Show Gist options
  • Save hiimivantang/9deea016c415c6927d1e765d8ed4e485 to your computer and use it in GitHub Desktop.
Save hiimivantang/9deea016c415c6927d1e765d8ed4e485 to your computer and use it in GitHub Desktop.
Download ZIP
External Hive metastore configuration for DBSQL
Raw
dbsql_endpoint.config
spark.hadoop.javax.jdo.option.ConnectionURL jdbc:sqlserver://hiimivantang-azure-sql.database.windows.net:1433;database=hivemetastore;encrypt=true;trustServerCertificate=false;hostNameInCertificate=*.database.windows.net;loginTimeout=30;
spark.hadoop.javax.jdo.option.ConnectionUserName {{secrets/external-hms/mssql-user}}
spark.hadoop.javax.jdo.option.ConnectionPassword {{secrets/external-hms/mssql-password}}
spark.hadoop.javax.jdo.option.ConnectionDriverName com.microsoft.sqlserver.jdbc.SQLServerDriver
spark.sql.hive.metastore.version 2.3.0
spark.sql.hive.metastore.jars maven
@hiimivantang
Copy link
Author

SQL server needs to be initialized with Hive'sschematool.

./schematool -dbType mssql -initSchemaTo 2.3.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment