Skip to content

Instantly share code, notes, and snippets.

View TariqAbughofa's full-sized avatar

tariq-abughofa TariqAbughofa

2 followers · 0 following
View GitHub Profile
@TariqAbughofa
TariqAbughofa / keybase.md
Created September 12, 2019 15:51

Keybase proof

I hereby claim:

  • I am tariqabughofa on github.
  • I am tabughofa (https://keybase.io/tabughofa) on keybase.
  • I have a public key ASAOowVE7O_t-2nYHFv7MHmdy_fA1tZoSPfhzvoBUs9nJQo

To claim this, I am signing this object:

@TariqAbughofa
TariqAbughofa / test.md
Last active July 23, 2018 02:43
Assesment

I used mainly python for the whole exerciese. I also created a sample data to test all the code snippet in pyspark and spark-shell.

Create Sample Data

sc = SparkContext()
sqlContext = SQLContext(sc)
part_df = sqlContext.createDataFrame([
        (1, 'bob', '2015-01-13', 14),
        (2, 'alice', '2015-04-23', 10),