Skip to content

Instantly share code, notes, and snippets.

@qingniufly
qingniufly / parquet_spark.scala
Created March 1, 2017 10:10
spark read and write parquet files
// read
val filePath = "file:///path/to/spark/examples/src/main/resources/users.parquet"
val users = sqlContext.read.load(filePath)
// write
val personJsonFile = "file:///path/to/spark/examples/src/main/resources/people.json"
val personDF = sqlContext.read.json(personJsonFile)
personDF.select("name", "age").write.format("parquet").save("file:///tmp/new_people.parquet")
@qingniufly
qingniufly / gist:fbb6165e17e095e59ff7b3120aca314f
Created February 13, 2017 08:48 — forked from Bouke/gist:10454272
Install FreeTDS, unixODBC and pyodbc on OS X

First, install the following libraries:

$ brew install unixodbc
$ brew install freetds --with-unixodbc

FreeTDS should already work now, without configuration:

$ tsql -S [IP or hostname] -U [username] -P [password]
locale is "en_US.UTF-8"

locale charset is "UTF-8"