Skip to content

Instantly share code, notes, and snippets.

View wfaria's full-sized avatar

Waldecir Faria wfaria

View GitHub Profile
@wfaria
wfaria / HeartbeatStreaming.py
Created August 23, 2018 17:36
Spark Streaming with Kafka example for a Medium article using Python
from pyspark import SparkContext
from pyspark.sql import SparkSession
from pyspark.streaming import StreamingContext
from pyspark.streaming.kafka import KafkaUtils
def main():
# Task configuration.
topic = "heartbeat"
brokerAddresses = "localhost:9092"
batchTime = 20