Skip to content

Instantly share code, notes, and snippets.

@carllerche

carllerche/jnettop Secret

Last active August 29, 2015 13:56
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save carllerche/4f2cf0f0f6d1e891f482 to your computer and use it in GitHub Desktop.
Save carllerche/4f2cf0f0f6d1e891f482 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
jnettop
ip-10-42-0-153.ec2.internal <-> ip-10-42-1-220.ec2.internal 167K/s 44.7M/s 44.9M/s
10.42.0.153 37075 TCP 10.42.1.220 9092 3.67M 0.98G 0.99G
ip-10-42-0-153.ec2.internal <-> ip-10-42-2-112.ec2.internal 143K/s 38.1M/s 38.2M/s
10.42.0.153 40484 TCP 10.42.2.112 9092 3.12M 854M 857M
ip-10-42-0-153.ec2.internal <-> ip-10-42-1-220.ec2.internal 3.29K/s 174K/s 178K/s
10.42.0.153 7000 TCP 10.42.1.220 33724 73.2K 3.55M 3.62M
ip-10-42-0-153.ec2.internal <-> ip-10-42-2-112.ec2.internal 3.18K/s 170K/s 174K/s
10.42.0.153 7000 TCP 10.42.2.112 46187 72.1K 3.47M 3.55M
ip-10-42-0-153.ec2.internal <-> ip-10-42-2-112.ec2.internal 148K/s 5.81K/s 154K/s
10.42.0.153 40864 TCP 10.42.2.112 7000 3.20M 121K 3.32M
ip-10-42-0-153.ec2.internal <-> ip-10-42-1-220.ec2.internal 147K/s 5.38K/s 153K/s
10.42.0.153 40549 TCP 10.42.1.220 7000 3.18M 120K 3.30M
ip-10-42-0-153.ec2.internal <-> ip-10-42-1-220.ec2.internal 133K/s 11.7K/s 145K/s
10.42.0.153 44450 TCP 10.42.1.220 9042 2.79M 266K 3.05M
ip-10-42-0-153.ec2.internal <-> ip-10-42-2-112.ec2.internal 131K/s 11.8K/s 143K/s
10.42.0.153 39430 TCP 10.42.2.112 9042 2.54M 261K 2.79M
ip-10-42-0-153.ec2.internal <-> ip-10-42-1-220.ec2.internal 121K/s 10.4K/s 131K/s
10.42.0.153 44451 TCP 10.42.1.220 9042 2.39M 233K 2.62M
ip-10-42-0-153.ec2.internal <-> ip-10-42-2-112.ec2.internal 118K/s 10.6K/s 128K/s
10.42.0.153 39431 TCP 10.42.2.112 9042 2.61M 236K 2.84M
ip-10-42-0-153.ec2.internal <-> ip-10-42-2-112.ec2.internal 7.93K/s 89.9K/s 97.8K/s
10.42.0.153 41047 TCP 10.42.2.112 9092 44.1K 536K 580K
Raw
kafka.cfg
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# see kafka.server.KafkaConfig for additional details and defaults
############################# Server Basics #############################
# The id of the broker. This must be set to a unique integer for each broker.
broker.id=0
auto.create.topics.enable = false
############################# Socket Server Settings #############################
# The port the socket server listens on
port=9092
# Hostname the broker will bind to and advertise to producers and consumers.
# If not set, the server will bind to all interfaces and advertise the value returned from
# from java.net.InetAddress.getCanonicalHostName().
host.name=ec2-54-209-155-191.compute-1.amazonaws.com
# The number of threads handling network requests
num.network.threads=2
# The number of threads doing disk I/O
num.io.threads=2
# The send buffer (SO_SNDBUF) used by the socket server
socket.send.buffer.bytes=1048576
# The receive buffer (SO_RCVBUF) used by the socket server
socket.receive.buffer.bytes=1048576
# The maximum size of a request that the socket server will accept (protection against OOM)
socket.request.max.bytes=104857600
############################# Log Basics #############################
# A comma seperated list of directories under which to store log files
log.dirs=/var/direwolf/kafka/data
# The number of logical partitions per topic per server. More partitions allow greater parallelism
# for consumption, but also mean more files.
num.partitions=2
############################# Log Flush Policy #############################
# The following configurations control the flush of data to disk. This is among the most
# important performance knob in kafka.
# There are a few important trade-offs here:
# 1. Durability: Unflushed data may be lost if you are not using replication.
# 2. Latency: Very large flush intervals may lead to latency spikes when the flush does occur as there will be a lot of data to flush.
# 3. Throughput: The flush is generally the most expensive operation, and a small flush interval may lead to exceessive seeks.
# The settings below allow one to configure the flush policy to flush data after a period of time or
# every N messages (or both). This can be done globally and overridden on a per-topic basis.
# The number of messages to accept before forcing a flush of data to disk
log.flush.interval.messages=10000
# The maximum amount of time a message can sit in a log before we force a flush
log.flush.interval.ms=1000
# Per-topic overrides for log.flush.interval.ms
#log.flush.intervals.ms.per.topic=topic1:1000, topic2:3000
############################# Log Retention Policy #############################
# The following configurations control the disposal of log segments. The policy can
# be set to delete segments after a period of time, or after a given size has accumulated.
# A segment will be deleted whenever *either* of these criteria are met. Deletion always happens
# from the end of the log.
# The minimum age of a log file to be eligible for deletion
log.retention.hours=24
# A size-based retention policy for logs. Segments are pruned from the log as long as the remaining
# segments don't drop below log.retention.bytes.
log.retention.bytes=17179869184
# The maximum size of a log segment file. When this size is reached a new log segment will be created.
log.segment.bytes=536870912
# The interval at which log segments are checked to see if they can be deleted according
# to the retention policies
log.cleanup.interval.mins=1
############################# Zookeeper #############################
# Zookeeper connection string (see zookeeper docs for details).
# This is a comma separated host:port pairs, each corresponding to a zk
# server. e.g. "127.0.0.1:3000,127.0.0.1:3001,127.0.0.1:3002".
# You can also append an optional chroot string to the urls to specify the
# root directory for all kafka znodes.
zookeeper.connect=ec2-54-209-155-191.compute-1.amazonaws.com:2181,ec2-54-209-111-170.compute-1.amazonaws.com:2181,ec2-54-209-187-119.compute-1.amazonaws.com:2181
# Timeout in ms for connecting to zookeeper
zookeeper.connection.timeout.ms=1000000
############################# Messages #############################
# The maximum size of a message that the server can receive. It is important that this property be
# in sync with the maximum fetch size your consumers use or else an unruly consumer will be able to
# publish messages too large for consumers to consume.
message.max.bytes=2000000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment