Skip to content

Instantly share code, notes, and snippets.

@Mageswaran1989

Mageswaran1989/spark_dataset.ipynb

Created January 30, 2020 03:24
Show Gist options
  • Save Mageswaran1989/847c3193c9dd5910cb6d350a5d6cdebc to your computer and use it in GitHub Desktop.
Save Mageswaran1989/847c3193c9dd5910cb6d350a5d6cdebc to your computer and use it in GitHub Desktop.
Download ZIP
A gentele introduction to Spark Datasets
Display the source blob
Display the rendered blob
Raw
spark_dataset.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@Mageswaran1989
Copy link
Author

StarWars.csv

"name";"height";"weight";"eyecolor";"haircolor";"jedi";"species"
"Anakin Skywalker";188;84;"blue";"blond";"jedi";"human"
"Padme Amidala";165;45;"brown";"brown";"no_jedi";"human"
"Luke Skywalker";172;77;"blue";"blond";"jedi";"human"
"Leia Skywalker";150;49;"brown";"brown";"no_jedi";"human"
"Qui-Gon Jinn";193;89;"blue";"brown";"jedi";"human"
"Obi-Wan Kenobi";182;77;"bluegray";"auburn";"jedi";"human"
"Han Solo";180;80;"brown";"brown";"no_jedi";"human"
"Sheev Palpatine";173;75;"blue";"red";"no_jedi";"human"
"R2-D2";96;32;;;"no_jedi";"droid"
"C-3PO";167;75;;;"no_jedi";"droid"
"Yoda";66;17;"brown";"brown";"jedi";"yoda"
"Darth Maul";175;80;"yellow";"none";"no_jedi";"dathomirian"
"Dooku";193;86;"brown";"brown";"jedi";"human"
"Chewbacca";228;112;"blue";"brown";"no_jedi";"wookiee"
"Jabba";390;;"yellow";"none";"no_jedi";"hutt"
"Lando Calrissian";178;79;"brown";"blank";"no_jedi";"human"
"Boba Fett";183;78;"brown";"black";"no_jedi";"human"
"Jango Fett";183;79;"brown";"black";"no_jedi";"human"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment