Skip to content

Instantly share code, notes, and snippets.

@robert8138

robert8138/toy_example_hive_to_mysql.py

Created January 21, 2018 02:05
Show Gist options
  • Save robert8138/dc3a377fb58cd7c138ac1c1a21b24195 to your computer and use it in GitHub Desktop.
Save robert8138/dc3a377fb58cd7c138ac1c1a21b24195 to your computer and use it in GitHub Desktop.
Download ZIP
A toy example to transfer data from Hive to MySQL
Raw
toy_example_hive_to_mysql.py
HiveToMySqlTransfer(
task_id='data_to_mysql_transfer',
sql="SELECT * FROM robert.dim_bitcoin_revenue WHERE ds = '{{ ds }}'",
mysql_conn_id='robert_mysql',
mysql_table='dim_bitcoin_revenue',
hiveserver2_conn_id='hiveserver2_silver',
dag=dag)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment