Skip to content

Instantly share code, notes, and snippets.

@rehans516
rehans516 / stats
Last active February 13, 2019 10:04
tile_1 stats
+---------+-----------+-------------------+-----------------+-------------------+----------------+
|dataCells|noDataCells| min| max| mean| variance|
+---------+-----------+-------------------+-----------------+-------------------+----------------+
| 1022576| 0|-31.488306045532227|26.06804084777832|-15.371907429269672|9.13460216911102|
+---------+-----------+-------------------+-----------------+-------------------+----------------+
tile_2 stats
+---------+-----------+-------------------+------------------+-----------------+------------------+
Exception in thread "main" org.apache.spark.SparkException: Exception thrown in awaitResult:
at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
at org.apache.spark.ml.tuning.CrossValidator$$anonfun$4$$anonfun$6.apply(CrossValidator.scala:164)
at org.apache.spark.ml.tuning.CrossValidator$$anonfun$4$$anonfun$6.apply(CrossValidator.scala:164)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)
@rehans516
rehans516 / ml code
Last active February 11, 2019 16:21
import org.apache.spark.sql._
import org.apache.spark.sql.functions.max
import geotrellis.raster.io.geotiff._
import geotrellis.spark.io._
import geotrellis.spark._
import geotrellis.raster._
import geotrellis.raster.render._
import geotrellis.proj4._
import biggis.landuse.spark.hdfs.vector._
import geotrellis.vector._