JungMIn Oh TimidLion
HeartSaVioR
/ EventTimeSessionWindowImplementationViaFlatMapGroupsWithState.scala
Last active
November 15, 2020 09:15
Implementation of session window with event time and watermark via flatMapGroupsWithState, and SPARK-10816
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| case class SessionInfo(sessionStartTimestampMs: Long, | |
| sessionEndTimestampMs: Long, | |
| numEvents: Int) { | |
| /** Duration of the session, between the first and last events + session gap */ | |
| def durationMs: Long = sessionEndTimestampMs - sessionStartTimestampMs | |
| } | |
| case class SessionUpdate(id: String, | |
| sessionStartTimestampSecs: Long, |