Skip to content

Instantly share code, notes, and snippets.

Avatar

Romaine C Martin rcmiii

  • Grovo
  • New York, New York
View GitHub Profile
@rcmiii
rcmiii / generate_reccs.scala
Created May 23, 2017
View generate_reccs.scala
spark-shell --jars ~/dev/hadoop-aws-2.7.0.jar --conf 'spark.driver.extraJavaOptions=-Ddata-warehouse-url-read=s3n://grovo-data-warehouse-dev'
import com.grovo.data.common.dao.CsvReportDao
import com.grovo.data.common.domain.TimePeriod
import com.grovo.data.cubes.enterprise.dao.EnterpriseAggregateDao
import com.grovo.data.snapshots.enterprise.dao.EnterpriseDataSnapshotsDao
import org.apache.spark.sql.{SaveMode, SparkSession}
import com.grovo.data.common.etl.SnapshotBuilder
import com.grovo.data.common.util.Config.SNAPSHOT_TASKS_PARALLELISM
import com.grovo.data.common.util.DateConversions.processingHours
@rcmiii
rcmiii / keybase.md
Created Feb 13, 2017
keybase.md
View keybase.md

Keybase proof

I hereby claim:

  • I am rcmiii on github.
  • I am rcmiii (https://keybase.io/rcmiii) on keybase.
  • I have a public key ASD9CNsV64y5o71VY46fEgywGGcCUbYaHU7wZeSaagsWYQo

To claim this, I am signing this object: