Skip to content

Instantly share code, notes, and snippets.

@bbejeck
bbejeck / generate-confluent-cloud.sh
Last active October 20, 2022 21:03
Script for creating a Kafka Cluster on Confluent Cloud, enables Schema Registry, generates API keys, and emits configs for Java client
echo "Enter the name for your cluster"
read CLUSTER_NAME;
echo "Enter the cloud (aws, azure, gcp)"
read CLOUD;
echo "Enter the region"
read REGION;
echo "Enter the geo location (us for now)"
read GEO;
@bbejeck
bbejeck / tmux-kafka.sh
Created December 11, 2015 18:40
A script for using tmux with kafka
#!/bin/sh
KAFKA_DIR=/usr/local/kafka_2.11-0.9.0.0-SNAPSHOT
START_ZK="./bin/zookeeper-server-start.sh"
ZK_PROPS="config/zookeeper.properties"
START_KAFKA="./bin/kafka-server-start.sh"
KAFKA_PROPS="config/server.properties"

Keybase proof

I hereby claim:

  • I am bbejeck on github.
  • I am terpsdad (https://keybase.io/terpsdad) on keybase.
  • I have a public key ASCyvUZxKkXxViUw26zdemp5hRPxzRAdg1PCBTJw42TU5Ao

To claim this, I am signing this object:

/*
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
* The ASF licenses this file to You under the Apache License, Version 2.0
* (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
/*
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
* The ASF licenses this file to You under the Apache License, Version 2.0
* (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
/*
* Licensed to the Apache Software Foundation (ASF) under one or more
* contributor license agreements. See the NOTICE file distributed with
* this work for additional information regarding copyright ownership.
* The ASF licenses this file to You under the Apache License, Version 2.0
* (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
@bbejeck
bbejeck / AggregateByKey.scala
Created July 31, 2015 18:19
Sample code for the Spark PairRDDFunctions - AggregateByKey
package bbejeck.grouping
import org.apache.log4j.{Level, Logger}
import org.apache.spark.{SparkConf, SparkContext}
import scala.collection.mutable
/**
* Created by bbejeck on 7/31/15.
*
@bbejeck
bbejeck / mappingValues.java
Last active July 25, 2019 23:54
Mapping the Values with Prediction
dataByAirportStream.join(regressionsByAirPortTable,
(k, v) -> k,
DataRegression::new)
.mapValues(Predictor::predict)
@bbejeck
bbejeck / ThrowingFunction.java
Created March 13, 2015 01:42
Simple approach to being able to use the Function interface with checked Exceptions.
/*
* *
*
*
* Copyright 2015 Bill Bejeck
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
// imports and license left out for clarity
public class OptimizedStreams {
public static void main(String[] args) {
final Properties properties = new Properties();
properties.setProperty(StreamsConfig.APPLICATION_ID_CONFIG, "test-application");
properties.setProperty(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092 ");
properties.setProperty(StreamsConfig.TOPOLOGY_OPTIMIZATION, StreamsConfig.OPTIMIZE);
properties.setProperty(StreamsConfig.DEFAULT_KEY_SERDE_CLASS_CONFIG, Serdes.String().getClass().getName());