Skip to content

Instantly share code, notes, and snippets.

@welly87

welly87/pyspark-mysql.sh

Created October 1, 2020 04:11
Show Gist options
  • Save welly87/29472b1f5fc2200f8ceee3678e361e9a to your computer and use it in GitHub Desktop.
Save welly87/29472b1f5fc2200f8ceee3678e361e9a to your computer and use it in GitHub Desktop.
Download ZIP
@welly87
Copy link
Author

welly87 commented Oct 1, 2020

https://github.com/hackathonBI/CCS

@welly87
Copy link
Author

welly87 commented Oct 1, 2020

https://github.com/hackathonBI/CCS/blob/master/Tasks.md

@welly87
Copy link
Author

welly87 commented Oct 1, 2020 •
edited
Loading

!pip install impyla

@welly87
Copy link
Author

welly87 commented Oct 1, 2020 

from impala.dbapi import connect
from impala.util import as_pandas

conn = connect(host='178.128.112.105', port=21050) 
cursor = conn.cursor()
cursor.execute('SELECT * FROM welly.transactions_1k LIMIT 100')
df = as_pandas(cursor)

df.head()

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment