Skip to content

Instantly share code, notes, and snippets.

View matthewseddon's full-sized avatar

Matthew Seddon matthewseddon

View GitHub Profile

Keybase proof

I hereby claim:

  • I am matthewseddon on github.
  • I am matthewseddon (https://keybase.io/matthewseddon) on keybase.
  • I have a public key whose fingerprint is CF80 DCE5 16FF F199 6BFC E22F 98D0 D759 FB84 6E8A

To claim this, I am signing this object:

@matthewseddon
matthewseddon / concat_pyspark.py
Created March 22, 2017 10:58
Concatenate two dfs in pyspark
"""Concatenate two dataframes in pyspark.
run as spark-submit concat_pyspark.py --py-files
"""
from __future__ import print_function
import pyspark
from pyspark import SparkContext
from pyspark.sql import SQLContext