Sung Won Chung sungchun12
🧃
sungchun12
/ Dockerfile
Created
May 10, 2023 08:05
Simple quickstart to dbt Core DAG with bashoperator using BigQuery
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| FROM quay.io/astronomer/astro-runtime:7.4.2 | |
| # Install apache-airflow-providers-google package | |
| RUN pip install apache-airflow-providers-google | |
| # Switch to root user for installing git | |
| USER root | |
| # Install git | |
| RUN apt-get update && apt-get install -y git |
sungchun12
/ xdb_diff_demo.py
Created
January 8, 2024 22:55
Demo script to run a Datafold Cloud xdb data diff between Databricks and Snowflake with simple API calls
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Demo script to run a xdb data diff between Databricks and Snowflake with simple API calls | |
| """ | |
| import os | |
| import time | |
| from pydantic import BaseModel | |
| from typing import Any, List, Optional | |
| import requests | |
| from tabulate import tabulate |
OlderNewer