Skip to content

Instantly share code, notes, and snippets.

@yangl
Last active April 1, 2018 17:03
Show Gist options
  • Save yangl/c45e7c906fc60c960ea1fe0f4db990a1 to your computer and use it in GitHub Desktop.
Save yangl/c45e7c906fc60c960ea1fe0f4db990a1 to your computer and use it in GitHub Desktop.
########### These MUST be filled in for a storm configuration
storm.zookeeper.servers:
- "10.10.74.41"
- "10.10.74.42"
- "10.10.74.43"
storm.zookeeper.root: "/jstorm"
cluster.name: "jstorm-uxin"
#nimbus.host/nimbus.host.start.supervisor is being used by $JSTORM_HOME/bin/start.sh
#it only support IP, please don't set hostname
# For example
nimbus.host: "10.10.74.41, 10.10.74.42, 10.10.74.43"
#nimbus.host: "localhost"
nimbus.host.start.supervisor: true
# %JSTORM_HOME% is the jstorm home directory
storm.local.dir: "%JSTORM_HOME%/data"
# please set absolute path, default path is JSTORM_HOME/logs
# jstorm.log.dir: "absolute path"
# java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"
# if supervisor.slots.ports is null,
# the port list will be generated by cpu cores and system memory size
# for example,
# there are cpu_num = system_physical_cpu_num/supervisor.slots.port.cpu.weight
# there are mem_num = system_physical_memory_size/(worker.memory.size * supervisor.slots.port.mem.weight)
# The final port number is min(cpu_num, mem_num)
# supervisor.slots.ports.base: 6800
# supervisor.slots.port.cpu.weight: 1.2
# supervisor.slots.port.mem.weight: 0.7
# supervisor.slots.ports: null
supervisor.slots.ports:
- 6800
- 6801
- 6802
- 6803
- 6804
- 6805
- 6806
# Default disable user-define classloader
# If there are jar conflict between jstorm and application,
# please enable it
# topology.enable.classloader: false
# enable supervisor use cgroup to make resource isolation
# Before enable it, you should make sure:
# 1. Linux version (>= 2.6.18)
# 2. Have installed cgroup (check the file's existence:/proc/cgroups)
# 3. You should start your supervisor on root
# You can get more about cgroup:
# http://t.cn/8s7nexU
# supervisor.enable.cgroup: false
### Netty will send multiple messages in one batch
### Setting true will improve throughput, but more latency
storm.messaging.netty.transfer.async.batch: true
### default worker memory size, unit is byte
# worker.memory.size: 2147483648
# Metrics Monitor
# topology.performance.metrics: it is the switch flag for performance
# purpose. When it is disabled, the data of timer and histogram metrics
# will not be collected.
# topology.alimonitor.metrics.post: If it is disable, metrics data
# will only be printed to log. If it is enabled, the metrics data will be
# posted to alimonitor besides printing to log.
# topology.performance.metrics: true
# topology.alimonitor.metrics.post: false
# UI MultiCluster
# Following is an example of multicluster UI configuration
# ui.clusters:
# - {
# name: "jstorm",
# zkRoot: "/jstorm",
# zkServers:
# [ "localhost"],
# zkPort: 2181,
# }
nimbus及supervisor安装:
1.下载解压 unzip jstorm-2.2.1.zip
2.软链,方便升级 ln -s jstorm-2.2.1/ jstorm
3.修改storm.yaml配置文件
4.添加环境变量及path;
export JSTORM_HOME=/data/soft/jstorm
export PATH=.:$PATH:$JSTORM_HOME/bin
4.执行bin/start.sh
ui安装:
1.下载解压至tomcat的webapps/ROOT下
2.拷贝storm.yaml至~/.jstorm/目录下
3.启动tomcat即可
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment