axdotl

master:
  useSecurity: true
  adminUser: "admin"
  
  fsGroup: 1000
  runAsUser: 1000

  serviceType: ClusterIP

  installPlugins:

timvw

    val groupId = "demo-consumer"
    val bootstrapServers = "localhost:9092"

    val spark = SparkSession
      .builder()
      .master("local[*]")
      .appName("demo")
      //.config("spark.sql.streaming.stateStore.maintenanceInterval", "10s")
      //.config("spark.sql.streaming.metricsEnabled", true)
      .config("spark.sql.streaming.minBatchesToRetain", 2)

ashrafuzzaman

CREATE EXTERNAL TABLE events (
    name string,
    user string,
    variation string,
    referrer string,
    timestamp string,
    metadata string
)
ROW FORMAT  serde 'org.openx.data.jsonserde.JsonSerDe'
with serdeproperties ( 'paths'='name, user, variation, referrer, timestamp, metadata' )

MarcDiethelm

This text now lives at https://github.com/MarcDiethelm/contributing/blob/master/README.md. I turned it into a Github repo so you can, you know, contribute to it by making pull requests.

---

Contributing

If you want to contribute to a project and make it better, your help is very welcome. Contributing is also a great way to learn more about social coding on Github, new technologies and and their ecosystems and how to make constructive, helpful bug reports, feature requests and the noblest of all contributions: a good, clean pull request.

dropwhile

Data Size:
  Input:  2074
  LZ4:    758 (0.37)
  Snappy: 676 (0.33)
  LZF:    697 (0.34)
  ZLIB:   510 (0.25)
  LZ4 / Snappy: 1.121302
  LZ4 / LZF:    1.087518
  LZ4 / ZLIB:   1.486275
Benchmark: 50000 calls