Hello Samza output log

gistfile1.txt

$ deploy/samza/bin/run-job.sh --config-factory=org.apache.samza.config.factories.PropertiesConfigFactory --config-path=file://$PWD/deploy/samza/config/wikipedia-feed.properties
java version "1.8.0_40"
Java(TM) SE Runtime Environment (build 1.8.0_40-b25)
Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
java -Dlog4j.configuration=file:deploy/samza/bin/log4j-console.xml -Dsamza.log.dir=/Users/andychambers/workspace/hello-samza/deploy/samza -Djava.io.tmpdir=/Users/andychambers/workspace/hello-samza/deploy/samza/tmp -Xmx768M -XX:+PrintGCDateStamps -Xloggc:/Users/andychambers/workspace/hello-samza/deploy/samza/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10241024 -d64 -cp /Users/andychambers/.samza/conf:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/activation-1.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/akka-actor_2.10-2.1.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/aopalliance-1.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/asm-3.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/avro-1.7.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-beanutils-1.7.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-beanutils-core-1.8.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-cli-1.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-codec-1.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-collections-3.2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-compress-1.4.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-configuration-1.6.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-daemon-1.0.13.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-digester-1.8.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-el-1.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-httpclient-3.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-io-2.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-lang-2.6.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-logging-1.1.3.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-math3-3.1.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/commons-net-3.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/config-1.0.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/grizzled-slf4j_2.10-1.0.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/guava-11.0.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/guice-3.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/guice-servlet-3.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-annotations-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-auth-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-common-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-hdfs-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-yarn-api-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-yarn-client-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hadoop-yarn-common-2.4.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/hello-samza-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/httpclient-4.1.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/httpcore-4.1.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/irclib-1.10.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jackson-core-asl-1.8.5.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jackson-jaxrs-1.8.5.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jackson-mapper-asl-1.8.5.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jackson-xc-1.8.3.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jasper-compiler-5.5.23.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jasper-runtime-5.5.23.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/java-xmlbuilder-0.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/javax.inject-1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/javax.servlet-3.0.0.v201112011016.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jaxb-api-2.2.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jaxb-impl-2.2.3-1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jersey-client-1.9.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jersey-core-1.9.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jersey-guice-1.9.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jersey-json-1.9.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jersey-server-1.9.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jets3t-0.9.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jettison-1.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-6.1.26.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-continuation-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-http-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-io-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-security-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-server-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-servlet-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-util-6.1.26.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-util-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-webapp-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jetty-xml-8.1.8.v20121106.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jline-0.9.94.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/joda-convert-1.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/joda-time-2.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jopt-simple-3.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jsch-0.1.42.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jsp-api-2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/jsr305-1.3.9.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/junit-3.8.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/juniversalchardet-1.0.3.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/kafka-clients-0.8.2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/kafka_2.10-0.8.2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/log4j-1.2.17.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/lz4-1.2.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/metrics-core-2.2.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/mime-util-2.1.3.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/paranamer-2.3.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/protobuf-java-2.5.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/rl_2.10-0.4.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/rocksdbjni-3.5.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-api-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-core_2.10-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-kafka_2.10-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-kv-rocksdb_2.10-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-kv_2.10-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-log4j-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/samza-yarn_2.10-0.9.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scala-compiler-2.10.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scala-library-2.10.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scala-reflect-2.10.4.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scalate-core_2.10-1.6.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scalate-util_2.10-1.6.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scalatra-common_2.10-2.2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scalatra-scalate_2.10-2.2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/scalatra_2.10-2.2.1.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/servlet-api-2.5.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/slf4j-api-1.6.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/slf4j-log4j12-1.6.2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/snappy-java-1.1.1.6.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/stax-api-1.0-2.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/xmlenc-0.52.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/xz-1.0.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/zkclient-0.3.jar:/Users/andychambers/workspace/hello-samza/deploy/samza/lib/zookeeper-3.3.4.jar org.apache.samza.job.JobRunner --config-factory=org.apache.samza.config.factories.PropertiesConfigFactory --config-path=file:///Users/andychambers/workspace/hello-samza/deploy/samza/config/wikipedia-feed.properties
2015-07-15 14:04:24 JobRunner [INFO] job factory: org.apache.samza.job.yarn.YarnJobFactory
2015-07-15 14:04:24 ClientHelper [INFO] trying to connect to RM 127.0.0.1:8032
2015-07-15 14:04:24 RMProxy [INFO] Connecting to ResourceManager at /127.0.0.1:8032
2015-07-15 14:04:24 NativeCodeLoader [WARN] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-07-15 14:04:25 ClientHelper [INFO] preparing to request resources for app id application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set environment variables to Map(SAMZA_CONFIG -> {\"systems.kafka.consumer.zookeeper.connect\":\"localhost:2181/\",\"systems.kafka.samza.factory\":\"org.apache.samza.system.kafka.KafkaSystemFactory\",\"systems.wikipedia.port\":\"6667\",\"task.inputs\":\"wikipedia.#en.wikipedia,wikipedia.#en.wiktionary,wikipedia.#en.wikinews\",\"systems.wikipedia.host\":\"irc.wikimedia.org\",\"yarn.package.path\":\"file:///Users/andychambers/Projects/hello-samza/target/hello-samza-0.9.1-dist.tar.gz\",\"job.factory.class\":\"org.apache.samza.job.yarn.YarnJobFactory\",\"task.class\":\"samza.examples.wikipedia.task.WikipediaFeedStreamTask\",\"systems.kafka.samza.msg.serde\":\"json\",\"job.name\":\"wikipedia-feed\",\"serializers.registry.json.class\":\"org.apache.samza.serializers.JsonSerdeFactory\",\"systems.kafka.producer.bootstrap.servers\":\"localhost:9092\",\"systems.wikipedia.samza.factory\":\"samza.examples.wikipedia.system.WikipediaSystemFactory\"}, JAVA_OPTS -> ) for application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set package url to scheme: "file" port: -1 file: "/Users/andychambers/Projects/hello-samza/target/hello-samza-0.9.1-dist.tar.gz" for application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set package size to 85583311 for application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set memory request to 1024 for application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set cpu core request to 1 for application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set command to List(export SAMZA_LOG_DIR=<LOG_DIR> && ln -sfn <LOG_DIR> logs && exec ./__package/bin/run-am.sh 1>logs/stdout 2>logs/stderr) for application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] set app ID to application_1436994089530_0001
2015-07-15 14:04:25 ClientHelper [INFO] submitting application request for application_1436994089530_0001
2015-07-15 14:04:25 YarnClientImpl [INFO] Submitted application application_1436994089530_0001
2015-07-15 14:04:25 JobRunner [INFO] waiting for job to start
2015-07-15 14:04:25 JobRunner [INFO] job started successfully - Running
2015-07-15 14:04:25 JobRunner [INFO] exiting

andychambers at C02NW2M7G3QT in ~/workspace/hello-samza on master
$ deploy/kafka/bin/kafka-console-consumer.sh  --zookeeper localhost:2181 --topic wikipedia-raw
[2015-07-15 14:04:47,399] WARN [console-consumer-86496_C02NW2M7G3QT.local-1436994286990-a1b45713], no brokers found when trying to rebalance. (kafka.consumer.ZookeeperConsumerConnector)