yagizdemirsoy

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>kafkastream</groupId>
    <artifactId>kafkastream</artifactId>
    <version>1.0-SNAPSHOT</version>
    <build>

yagizdemirsoy

Create Kafka Topic

kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic product-raw-data

Update Kafka Topic Configuration

kafka-configs.sh --zookeeper localhost:2181 --entity-type topics --entity-name product-raw-data --alter --add-config max.message.bytes=1000000

yagizdemirsoy

Define alias to local ip and redirect localhost:{port} to defined ip.

sudo ifconfig lo0 10.0.0.1 alias

echo "rdr pass on lo0 inet proto tcp from any to 10.0.0.1 port 80 -> 127.0.0.1 port 9000" | sudo pfctl -ef -

yagizdemirsoy

Find process using port on Mac OS X

lsof -i tcp:3000 

yagizdemirsoy

Add new field to mongo document and set incremental values

var cursor = db.getCollection("FacetTest").find();

var i = 1;
cursor.forEach(function(x){
    db.getCollection("FacetTest").update({_id: x._id}, {$set:{Order: NumberInt(i)}}, {
 upsert: false,

yagizdemirsoy

import simplejson as json
import json

def main():
    with open('input.json', encoding='utf-8') as json_data:
        data = json.load(json_data)
    d = capitalize(data)
    print(json.dumps(d, indent=4, sort_keys=True))
    
def capitalize(x):