Skip to content

Instantly share code, notes, and snippets.

@rustyrazorblade

rustyrazorblade/gist:d4b2b048c4bd88e538ce

Created August 9, 2015 21:53
Show Gist options
  • Save rustyrazorblade/d4b2b048c4bd88e538ce to your computer and use it in GitHub Desktop.
Save rustyrazorblade/d4b2b048c4bd88e538ce to your computer and use it in GitHub Desktop.
Download ZIP
working migration
Raw
gistfile1.txt
from pyspark.sql import SQLContext
sql = SQLContext(sc)
mysql_movies = sql.read.jdbc("jdbc:mysql://127.0.0.1:3307/movielens?user=root", "movielens.movies")
mysql_movies.write.format("org.apache.spark.sql.cassandra").options(table="movies", keyspace="lens").save(mode="append")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment