Skip to content

Instantly share code, notes, and snippets.

Databricks Migration Utility Support


Credentials Setup

Before running the migration, you must configure the storage credentials so that Unity Catalog can access your ADLS path. The migration utility uses these credentials when creating External Locations.

Follow the steps below to ensure the correct credential is applied:

Steps:

Loading report from /Workspace/Users/tharun.chinnam@modak.com/databricks-migration-utility-git/01_hms_migration/assets/external_location_credential.csv (rows=1)
Scanning HMS external locations and privileges...
Wrote: /Workspace/Users/tharun.chinnam@modak.com/databricks-migration-utility-git/01_hms_migration/assets/external_location_credential.csv (rows=1)
Credentials report updated at: /Workspace/Users/tharun.chinnam@modak.com/databricks-migration-utility-git/01_hms_migration/assets/external_location_credential.csv
[SC][grants][warn] Failed to check grants on `fafef` for `tharun.chinnam@modak.com`: [NO_SUCH_STORAGE_CREDENTIAL_EXCEPTION] The storage credential 'fafef' does not exist. Please verify that the storage credential name is spelled correctly and matches the name of a valid existing storage credential and then retry the query or command again.
JVM stacktrace:
org.apache.spark.sql.catalyst.analysis.NoSuchStorageCredentialException
at com.databricks.managedcatalog.ManagedCatalogClientImpl.$anonfun$get

Hive Metastore to Unity Catalog Migration Utility

Overview

This utility migrates Hive Metastore objects (managed tables, external tables, and views) into Databricks Unity Catalog (UC).

It ensures:

  • Managed tables are converted to UC external tables stored under a user-provided ADLS parent path.
  • External tables are recreated in UC, reusing or creating External Locations (ELs).