Skip to content

Instantly share code, notes, and snippets.

View debugger87's full-sized avatar

Chaozhong Yang debugger87

  • Bytedance Inc.
  • Beijing, China
View GitHub Profile
@debugger87
debugger87 / SparkRowConverter.scala
Last active July 6, 2017 11:06
Convert Array[org.apache.spark.sql.Row] to Array[Map[String, Any]]
import org.apache.spark.sql.catalyst.expressions.Row
import org.apache.spark.sql.catalyst.types._
import scala.collection.mutable.{ArrayBuffer}
object SparkRowFormatter {
def formatRowsWithSchema(rowArr: Array[Row], schema: StructType) = {
rowArr.map(r => formatStruct(schema.fields, r))
}