Skip to content

Instantly share code, notes, and snippets.

@say2sankalp
Created April 3, 2018 09:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save say2sankalp/3d47b59b1fb66533126d182d49e9351d to your computer and use it in GitHub Desktop.
Save say2sankalp/3d47b59b1fb66533126d182d49e9351d to your computer and use it in GitHub Desktop.
kafka shell thread diagnosis
fucking loosers like me, ever faced problem in tracking the worker thread
netstat and ps -aux are very useful, any clever stealth app could be tracked from this
./bin/connect-standalone etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/quickstart-elasticsearch.properties
sudo vim /etc/schema-registry/connect-avro-standalone.properties
588 /usr/bin/connect-standalone etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
589 /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
590 sudo vim /etc/schema-registry/connect-avro-standalone.properties
591 sudo vim /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
592 /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
593 sudo netstat -plnt |grep 8083
594 sudo kill -9 3092
595 /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
596 sudo vim /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
597 sudo vim /etc/schema-registry/connect-avro-standalone.properties
598 sudo netstat -plnt |grep 8083
599 ps -aux | grep 8083
600 ps -aux | grep 3082
601 sudo /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
602 confluent log connect
603 sudo /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
604 grep -r "rest.port = 8083" /home/
605 sudo grep -r "rest.port = 8083" /home/
606 sudo grep -r "rest.port = 8083" /
607 confluent stop
608 sudonetstat -plnt | grep 8083
609 sudo netstat -plnt | grep 8083
610 sudo netstat -plnt | grep 808
611 sudo netstat -plnt | grep 808*
612 sudo /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
613 confluent log connect
614 sudo vim /etc/schema-registry/connect-avro-standalone.properties
/usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
/usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-elasticsearch/config/elasticsearch-connect.properties
sudo dpkg -l | grep confluent-common tells the package location
/usr/bin/connect-standalone /etc/kafka/connect-standalone.properties config/quickstart-elasticsearch.properties
kafka working
https://softwaremill.com/import-export-through-kafka-connectors/
sudo /usr/bin/zookeeper-server-start /etc/kafka/zookeeper.properties
sudo /usr/bin/kafka-server-start /etc/kafka/server.properties
/usr/bin/connect-standalone /etc/kafka/connect-standalone.properties /etc/kafka/connect-file-source.properties /etc/kafka/connect-file-sink.properties
bin/kafka-console-producer.sh --topic logs --broker-list localhost:9092
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment