Skip to content

Instantly share code, notes, and snippets.

@udit-saxena
Last active August 23, 2020 20:08
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save udit-saxena/68abc1120df78f201d960efad679689f to your computer and use it in GitHub Desktop.
Save udit-saxena/68abc1120df78f201d960efad679689f to your computer and use it in GitHub Desktop.
Data Conversion
%spark
val kq_game_logs = myquery966
kq_game_logs.createOrReplaceTempView("df_temp")
-------------------------------
%spark.pyspark
import matplotlib
matplotlib.use('Agg')
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
from pyspark.sql import DataFrame
from datetime import datetime
dfp = DataFrame(z.get("df_temp"), sqlContext)
df = dfp.toPandas()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment