Skip to content

Instantly share code, notes, and snippets.

View f1yegor's full-sized avatar

Yegor Andreenko f1yegor

  • Amsterdam, The Netherlands
View GitHub Profile
@HeartSaVioR
HeartSaVioR / EventTimeSessionWindowImplementationViaFlatMapGroupsWithState.scala
Last active November 15, 2020 09:15
Implementation of session window with event time and watermark via flatMapGroupsWithState, and SPARK-10816
case class SessionInfo(sessionStartTimestampMs: Long,
sessionEndTimestampMs: Long,
numEvents: Int) {
/** Duration of the session, between the first and last events + session gap */
def durationMs: Long = sessionEndTimestampMs - sessionStartTimestampMs
}
case class SessionUpdate(id: String,
sessionStartTimestampSecs: Long,
@sanchezzzhak
sanchezzzhak / clickhouse-get-tables-size.sql
Created January 18, 2018 13:43
clickhouse get tables size
SELECT table,
formatReadableSize(sum(bytes)) as size,
min(min_date) as min_date,
max(max_date) as max_date
FROM system.parts
WHERE active
GROUP BY table
@lomik
lomik / build_ch.sh
Created April 28, 2017 12:13
Сборщик rpm clickhouse
#!/bin/bash
set -x
set -e
IMAGE="Докер образ с centos7, rpmbuild, fpm"
# Докер-образ строится примерно такой командой (возможно что-то забыто):
# RUN yum install -y rpm-build ruby ruby-devel rubygems && gem install fpm && yum clean all
docker run --rm -ti $IMAGE bash -c '