Skip to content

Instantly share code, notes, and snippets.

@patsevanton
Created October 11, 2022 15:17
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save patsevanton/663027a4040057011f743f3142d039f3 to your computer and use it in GitHub Desktop.
Save patsevanton/663027a4040057011f743f3142d039f3 to your computer and use it in GitHub Desktop.
┌ Waiting for resources to become ready
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ my-elasticsearch-master 1/1 0 1
│ │ RESOURCE NAMESPACE CONDITION: CURRENT (DESIRED)
│ │ Service/my-elasticsearch-coordinating-hl elasticsearch -
│ │ Service/my-elasticsearch-data-hl elasticsearch -
│ │ Service/my-elasticsearch-ingest-hl elasticsearch -
│ │ Service/my-elasticsearch-master-hl elasticsearch -
│ │ Service/my-elasticsearch-metrics elasticsearch -
│ │ Service/my-elasticsearch elasticsearch -
│ └ Status progress
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ elasticsearch 15:04:05.86
│ │ elasticsearch 15:04:05.86 Welcome to the Bitnami elasticsearch container
│ │ elasticsearch 15:04:05.87 Subscribe to project updates by watching https://github.com/bitnami/containers
│ │ elasticsearch 15:04:05.87 Submit issues and feature requests at https://github.com/bitnami/containers/issues
│ │ elasticsearch 15:04:05.87
│ │ elasticsearch 15:04:05.87 INFO ==> ** Starting Elasticsearch setup **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ │ elasticsearch 15:04:06.00
│ │ elasticsearch 15:04:06.00 Welcome to the Bitnami elasticsearch container
│ │ elasticsearch 15:04:06.01 Subscribe to project updates by watching https://github.com/bitnami/containers
│ │ elasticsearch 15:04:06.02 Submit issues and feature requests at https://github.com/bitnami/containers/issues
│ │ elasticsearch 15:04:06.03
│ │ elasticsearch 15:04:06.03 INFO ==> ** Starting Elasticsearch setup **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ │ elasticsearch 15:04:07.79 INFO ==> Configuring/Initializing Elasticsearch...
│ │ elasticsearch 15:04:07.83 INFO ==> Setting default configuration
│ │ elasticsearch 15:04:07.91 INFO ==> Configuring Elasticsearch cluster settings...
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ elasticsearch 15:04:09.96 INFO ==> Configuring/Initializing Elasticsearch...
│ │ elasticsearch 15:04:10.00 INFO ==> Setting default configuration
│ │ elasticsearch 15:04:10.08 INFO ==> Configuring Elasticsearch cluster settings...
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ │ elasticsearch 15:04:07.04
│ │ elasticsearch 15:04:07.04 Welcome to the Bitnami elasticsearch container
│ │ elasticsearch 15:04:07.04 Subscribe to project updates by watching https://github.com/bitnami/containers
│ │ elasticsearch 15:04:07.04 Submit issues and feature requests at https://github.com/bitnami/containers/issues
│ │ elasticsearch 15:04:07.04
│ │ elasticsearch 15:04:07.05 INFO ==> ** Starting Elasticsearch setup **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ │ elasticsearch 15:04:09.91 INFO ==> Configuring/Initializing Elasticsearch...
│ │ elasticsearch 15:04:09.96 INFO ==> Setting default configuration
│ │ elasticsearch 15:04:10.02 INFO ==> Configuring Elasticsearch cluster settings...
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=info ts=2022-10-11T15:04:05.308936967Z caller=clusterinfo.go:214 msg="triggering initial cluster info call"
│ │ level=info ts=2022-10-11T15:04:05.308994463Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
│ │ level=error ts=2022-10-11T15:04:10.313720652Z caller=clusterinfo.go:267 msg="failed to get cluster info" err="Get \"http://my-elasticsearch:9200/\": context deadline exceeded (Client.Timeout ↵
│ │ exceeded while awaiting headers)"
│ │ level=error ts=2022-10-11T15:04:10.313826277Z caller=clusterinfo.go:188 msg="failed to retrieve cluster info from ES" err="Get \"http://my-elasticsearch:9200/\": context deadline exceeded ↵
│ │ (Client.Timeout exceeded while awaiting headers)"
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ │ elasticsearch 15:04:14.74 INFO ==> ** Elasticsearch setup finished! **
│ │
│ │ elasticsearch 15:04:14.77 INFO ==> ** Starting Elasticsearch **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=info ts=2022-10-11T15:04:15.310414297Z caller=main.go:250 msg="initial cluster info call timed out"
│ │ level=info ts=2022-10-11T15:04:15.507931269Z caller=main.go:285 msg="starting elasticsearch_exporter" addr=:9114
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ │ elasticsearch 15:04:17.84 INFO ==> ** Elasticsearch setup finished! **
│ │
│ │ elasticsearch 15:04:17.89 INFO ==> ** Starting Elasticsearch **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ elasticsearch 15:04:19.35 INFO ==> ** Elasticsearch setup finished! **
│ │
│ │ elasticsearch 15:04:19.39 INFO ==> ** Starting Elasticsearch **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ └ Status progress
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=warn ts=2022-10-11T15:04:24.033310219Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get ↵
│ │ \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=warn ts=2022-10-11T15:04:24.033405703Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from ↵
│ │ http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=error ts=2022-10-11T15:04:24.119989536Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.6849680999999999 err="Get \"http://my-elasticsearch:9200\": dial ↵
│ │ tcp 10.96.148.213:9200: connect: connection refused"
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ │ [2022-10-11T15:04:24,650][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] version[8.4.2], pid[410], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], ↵
│ │ OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
│ │ [2022-10-11T15:04:24,656][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
│ │ [2022-10-11T15:04:24,656][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, ↵
│ │ -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, ↵
│ │ -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, ↵
│ │ -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-6186163818757226148, -XX:+HeapDumpOnOutOfMemoryError, ↵
│ │ -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, ↵
│ │ -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, ↵
│ │ --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Init:0/1 Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ │ [2022-10-11T15:04:28,717][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] version[8.4.2], pid[409], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], ↵
│ │ OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
│ │ [2022-10-11T15:04:28,726][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] JVM home [/opt/bitnami/java], using bundled JDK [false]
│ │ [2022-10-11T15:04:28,726][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, ↵
│ │ -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, ↵
│ │ -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, ↵
│ │ -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-15935614464025066869, -XX:+HeapDumpOnOutOfMemoryError, ↵
│ │ -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, ↵
│ │ -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, ↵
│ │ --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ │ [2022-10-11T15:04:31,358][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-ingest-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, ↵
│ │ jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ elasticsearch 15:04:31.91
│ │ elasticsearch 15:04:31.91 Welcome to the Bitnami elasticsearch container
│ │ elasticsearch 15:04:31.92 Subscribe to project updates by watching https://github.com/bitnami/containers
│ │ elasticsearch 15:04:31.93 Submit issues and feature requests at https://github.com/bitnami/containers/issues
│ │ elasticsearch 15:04:31.93
│ │ elasticsearch 15:04:31.93 INFO ==> ** Starting Elasticsearch setup **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ elasticsearch 15:04:31.85
│ │ elasticsearch 15:04:31.86 Welcome to the Bitnami elasticsearch container
│ │ elasticsearch 15:04:31.87 Subscribe to project updates by watching https://github.com/bitnami/containers
│ │ elasticsearch 15:04:31.88 Submit issues and feature requests at https://github.com/bitnami/containers/issues
│ │ elasticsearch 15:04:31.88
│ │ elasticsearch 15:04:31.89 INFO ==> ** Starting Elasticsearch setup **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Init:0/1->Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Init:0/1->Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ [2022-10-11T15:04:33,298][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] version[8.4.2], pid[410], ↵
│ │ build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
│ │ [2022-10-11T15:04:33,307][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
│ │ [2022-10-11T15:04:33,308][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, ↵
│ │ -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, ↵
│ │ -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, ↵
│ │ -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-16969385154403698343, -XX:+HeapDumpOnOutOfMemoryError, ↵
│ │ -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, ↵
│ │ -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, ↵
│ │ --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=warn ts=2022-10-11T15:04:34.062529375Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from ↵
│ │ http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=warn ts=2022-10-11T15:04:34.218665593Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get ↵
│ │ \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=error ts=2022-10-11T15:04:34.506572953Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.752322547 err="Get \"http://my-elasticsearch:9200\": dial tcp ↵
│ │ 10.96.148.213:9200: connect: connection refused"
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ elasticsearch 15:04:35.87 INFO ==> Configuring/Initializing Elasticsearch...
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ elasticsearch 15:04:35.88 INFO ==> Configuring/Initializing Elasticsearch...
│ │ elasticsearch 15:04:35.94 INFO ==> Setting default configuration
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ elasticsearch 15:04:35.94 INFO ==> Setting default configuration
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ elasticsearch 15:04:36.03 INFO ==> Configuring Elasticsearch cluster settings...
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ elasticsearch 15:04:36.04 INFO ==> Configuring Elasticsearch cluster settings...
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ [2022-10-11T15:04:41,476][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-coordinating-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, ↵
│ │ jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ │ [2022-10-11T15:04:42,957][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-ingest-1] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, ↵
│ │ jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=warn ts=2022-10-11T15:04:43.477408021Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from ↵
│ │ http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=error ts=2022-10-11T15:04:43.502339572Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.067865119 err="Get \"http://my-elasticsearch:9200\": dial tcp ↵
│ │ 10.96.148.213:9200: connect: connection refused"
│ │ level=warn ts=2022-10-11T15:04:43.504919684Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get ↵
│ │ \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ elasticsearch 15:04:46.18 INFO ==> ** Elasticsearch setup finished! **
│ │
│ │ elasticsearch 15:04:46.22 INFO ==> ** Starting Elasticsearch **
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ elasticsearch 15:04:46.44 INFO ==> ** Elasticsearch setup finished! **
│ │
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ elasticsearch 15:04:46.51 INFO ==> ** Starting Elasticsearch **
│ │ warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ │ [2022-10-11T15:04:47,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [aggs-matrix-stats]
│ │ [2022-10-11T15:04:47,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [analysis-common]
│ │ [2022-10-11T15:04:47,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [constant-keyword]
│ │ [2022-10-11T15:04:47,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [data-streams]
│ │ [2022-10-11T15:04:47,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [frozen-indices]
│ │ [2022-10-11T15:04:47,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-attachment]
│ │ [2022-10-11T15:04:47,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-common]
│ │ [2022-10-11T15:04:47,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-geoip]
│ │ [2022-10-11T15:04:47,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-user-agent]
│ │ [2022-10-11T15:04:47,160][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [kibana]
│ │ [2022-10-11T15:04:47,189][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [lang-expression]
│ │ [2022-10-11T15:04:47,198][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [lang-mustache]
│ │ [2022-10-11T15:04:47,201][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [lang-painless]
│ │ [2022-10-11T15:04:47,209][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [legacy-geo]
│ │ [2022-10-11T15:04:47,215][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [mapper-extras]
│ │ [2022-10-11T15:04:47,221][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [mapper-version]
│ │ [2022-10-11T15:04:47,223][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [old-lucene-versions]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [parent-join]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [percolator]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [rank-eval]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [reindex]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repositories-metering-api]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-azure]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-encrypted]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-gcs]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-s3]
│ │ [2022-10-11T15:04:47,226][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-url]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [runtime-fields-common]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [search-business-rules]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [searchable-snapshots]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [snapshot-based-recoveries]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [snapshot-repo-test-kit]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [spatial]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [transform]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [transport-netty4]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [unsigned-long]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [vector-tile]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [wildcard]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-aggregate-metric]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-analytics]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-async]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-async-search]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-autoscaling]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ccr]
│ │ [2022-10-11T15:04:47,227][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-core]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-deprecation]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-enrich]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-eql]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-fleet]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-graph]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-identity-provider]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ilm]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-logstash]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ml]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-monitoring]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ql]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-rollup]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-security]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-shutdown]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-sql]
│ │ [2022-10-11T15:04:47,228][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-stack]
│ │ [2022-10-11T15:04:47,229][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-text-structure]
│ │ [2022-10-11T15:04:47,229][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-voting-only-node]
│ │ [2022-10-11T15:04:47,229][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-watcher]
│ │ [2022-10-11T15:04:47,229][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] no plugins loaded
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ [2022-10-11T15:04:48,006][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [aggs-matrix-stats]
│ │ [2022-10-11T15:04:48,007][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [analysis-common]
│ │ [2022-10-11T15:04:48,007][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [constant-keyword]
│ │ [2022-10-11T15:04:48,007][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [data-streams]
│ │ [2022-10-11T15:04:48,007][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [frozen-indices]
│ │ [2022-10-11T15:04:48,007][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-attachment]
│ │ [2022-10-11T15:04:48,007][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-common]
│ │ [2022-10-11T15:04:48,008][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-geoip]
│ │ [2022-10-11T15:04:48,008][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-user-agent]
│ │ [2022-10-11T15:04:48,008][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [kibana]
│ │ [2022-10-11T15:04:48,009][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [lang-expression]
│ │ [2022-10-11T15:04:48,010][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [lang-mustache]
│ │ [2022-10-11T15:04:48,010][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [lang-painless]
│ │ [2022-10-11T15:04:48,010][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [legacy-geo]
│ │ [2022-10-11T15:04:48,010][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [mapper-extras]
│ │ [2022-10-11T15:04:48,011][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [mapper-version]
│ │ [2022-10-11T15:04:48,011][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [old-lucene-versions]
│ │ [2022-10-11T15:04:48,012][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [parent-join]
│ │ [2022-10-11T15:04:48,012][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [percolator]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [rank-eval]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [reindex]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repositories-metering-api]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-azure]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-encrypted]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-gcs]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-s3]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-url]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [runtime-fields-common]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [search-business-rules]
│ │ [2022-10-11T15:04:48,013][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [searchable-snapshots]
│ │ [2022-10-11T15:04:48,014][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [snapshot-based-recoveries]
│ │ [2022-10-11T15:04:48,014][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [snapshot-repo-test-kit]
│ │ [2022-10-11T15:04:48,014][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [spatial]
│ │ [2022-10-11T15:04:48,014][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [transform]
│ │ [2022-10-11T15:04:48,014][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [transport-netty4]
│ │ [2022-10-11T15:04:48,017][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [unsigned-long]
│ │ [2022-10-11T15:04:48,017][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [vector-tile]
│ │ [2022-10-11T15:04:48,017][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [wildcard]
│ │ [2022-10-11T15:04:48,018][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-aggregate-metric]
│ │ [2022-10-11T15:04:48,018][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-analytics]
│ │ [2022-10-11T15:04:48,018][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-async]
│ │ [2022-10-11T15:04:48,019][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-async-search]
│ │ [2022-10-11T15:04:48,020][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-autoscaling]
│ │ [2022-10-11T15:04:48,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ccr]
│ │ [2022-10-11T15:04:48,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-core]
│ │ [2022-10-11T15:04:48,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-deprecation]
│ │ [2022-10-11T15:04:48,022][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-enrich]
│ │ [2022-10-11T15:04:48,022][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-eql]
│ │ [2022-10-11T15:04:48,023][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-fleet]
│ │ [2022-10-11T15:04:48,023][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-graph]
│ │ [2022-10-11T15:04:48,024][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-identity-provider]
│ │ [2022-10-11T15:04:48,024][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ilm]
│ │ [2022-10-11T15:04:48,025][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-logstash]
│ │ [2022-10-11T15:04:48,025][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ml]
│ │ [2022-10-11T15:04:48,026][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-monitoring]
│ │ [2022-10-11T15:04:48,026][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ql]
│ │ [2022-10-11T15:04:48,027][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-rollup]
│ │ [2022-10-11T15:04:48,030][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-security]
│ │ [2022-10-11T15:04:48,063][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-shutdown]
│ │ [2022-10-11T15:04:48,063][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-sql]
│ │ [2022-10-11T15:04:48,065][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-stack]
│ │ [2022-10-11T15:04:48,067][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-text-structure]
│ │ [2022-10-11T15:04:48,067][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-voting-only-node]
│ │ [2022-10-11T15:04:48,067][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-watcher]
│ │ [2022-10-11T15:04:48,067][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] no plugins loaded
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=error ts=2022-10-11T15:04:53.830453393Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.395339599 err="Get \"http://my-elasticsearch:9200\": dial tcp ↵
│ │ 10.96.148.213:9200: connect: connection refused"
│ │ level=warn ts=2022-10-11T15:04:53.830633029Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from ↵
│ │ http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=warn ts=2022-10-11T15:04:53.830701442Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get ↵
│ │ \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ │ [2022-10-11T15:04:58,954][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [aggs-matrix-stats]
│ │ [2022-10-11T15:04:58,958][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [analysis-common]
│ │ [2022-10-11T15:04:58,958][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [constant-keyword]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [data-streams]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [frozen-indices]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-attachment]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-common]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-geoip]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-user-agent]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [kibana]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [lang-expression]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [lang-mustache]
│ │ [2022-10-11T15:04:58,959][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [lang-painless]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [legacy-geo]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [mapper-extras]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [mapper-version]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [old-lucene-versions]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [parent-join]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [percolator]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [rank-eval]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [reindex]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repositories-metering-api]
│ │ [2022-10-11T15:04:58,960][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-azure]
│ │ [2022-10-11T15:04:58,961][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-encrypted]
│ │ [2022-10-11T15:04:58,961][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-gcs]
│ │ [2022-10-11T15:04:58,971][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-s3]
│ │ [2022-10-11T15:04:58,998][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-url]
│ │ [2022-10-11T15:04:59,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [runtime-fields-common]
│ │ [2022-10-11T15:04:59,058][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [search-business-rules]
│ │ [2022-10-11T15:04:59,074][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [searchable-snapshots]
│ │ [2022-10-11T15:04:59,150][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [snapshot-based-recoveries]
│ │ [2022-10-11T15:04:59,150][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [snapshot-repo-test-kit]
│ │ [2022-10-11T15:04:59,151][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [spatial]
│ │ [2022-10-11T15:04:59,151][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [transform]
│ │ [2022-10-11T15:04:59,152][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [transport-netty4]
│ │ [2022-10-11T15:04:59,152][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [unsigned-long]
│ │ [2022-10-11T15:04:59,153][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [vector-tile]
│ │ [2022-10-11T15:04:59,153][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [wildcard]
│ │ [2022-10-11T15:04:59,153][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-aggregate-metric]
│ │ [2022-10-11T15:04:59,153][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-analytics]
│ │ [2022-10-11T15:04:59,153][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-async]
│ │ [2022-10-11T15:04:59,153][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-async-search]
│ │ [2022-10-11T15:04:59,156][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-autoscaling]
│ │ [2022-10-11T15:04:59,156][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ccr]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-core]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-deprecation]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-enrich]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-eql]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-fleet]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-graph]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-identity-provider]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ilm]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-logstash]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ml]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-monitoring]
│ │ [2022-10-11T15:04:59,158][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ql]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-rollup]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-security]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-shutdown]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-sql]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-stack]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-text-structure]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-voting-only-node]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-watcher]
│ │ [2022-10-11T15:04:59,159][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] no plugins loaded
│ └ sts/my-elasticsearch-ingest po/my-elasticsearch-ingest-1 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ [2022-10-11T15:05:01,514][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] version[8.4.2], pid[415], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], ↵
│ │ OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
│ │ [2022-10-11T15:05:01,526][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
│ │ [2022-10-11T15:05:01,534][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, ↵
│ │ -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, ↵
│ │ -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, ↵
│ │ -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-13155049647442247097, -XX:+HeapDumpOnOutOfMemoryError, ↵
│ │ -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, ↵
│ │ -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, ↵
│ │ --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ [2022-10-11T15:05:01,985][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] version[8.4.2], pid[407], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], ↵
│ │ OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
│ │ [2022-10-11T15:05:01,995][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
│ │ [2022-10-11T15:05:01,999][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, ↵
│ │ -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, ↵
│ │ -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, ↵
│ │ -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-17527043999422976303, -XX:+HeapDumpOnOutOfMemoryError, ↵
│ │ -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms1024m, ↵
│ │ -Xmx1024m, -XX:MaxDirectMemorySize=536870912, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, ↵
│ │ --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ [2022-10-11T15:05:02,188][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-coordinating-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vda2)]], net usable_space [21.3gb], ↵
│ │ net total_space [31.4gb], types [ext4]
│ │ [2022-10-11T15:05:02,191][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-coordinating-0] heap size [128mb], compressed ordinary object pointers [true]
│ │ [2022-10-11T15:05:02,231][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] node name [my-elasticsearch-coordinating-0], node ID [a7RxTJZAS0at3SxFUanFLg], cluster name [elastic], ↵
│ │ roles []
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ deploy/my-elasticsearch-metrics ERROR: po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics: Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline ↵
│ exceeded (Client.Timeout exceeded while awaiting headers)
│ 1/1 allowed errors occurred for deploy/my-elasticsearch-metrics: continue tracking
│ ┌ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ │ level=warn ts=2022-10-11T15:05:04.202690829Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get ↵
│ │ \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=error ts=2022-10-11T15:05:04.318389899Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.6675448309999998 err="Get \"http://my-elasticsearch:9200\": dial ↵
│ │ tcp 10.96.148.213:9200: connect: connection refused"
│ │ level=warn ts=2022-10-11T15:05:04.35055841Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from ↵
│ │ http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.148.213:9200: connect: connection refused"
│ └ deploy/my-elasticsearch-metrics po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ ┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ │ [2022-10-11T15:05:10,314][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-data-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, ↵
│ │ jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
│ └ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ ┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ │ [2022-10-11T15:05:10,511][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-master-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, ↵
│ │ jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
│ └ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ ┌ Status progress
│ │ DEPLOYMENT REPLICAS AVAILABLE UP-TO-DATE
│ │ my-elasticsearch-metrics 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-metrics-944c9685b-8wrk6 0/1 0 Running Waiting for: available 0->1
│ │ STATEFULSET REPLICAS READY UP-TO-DATE
│ │ my-elasticsearch-coordinating 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-coordinating-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-data 1/1 0 1 ↵
│ │
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-data-0 0/1 0 Running Waiting for: ready 0->1
│ │ my-elasticsearch-ingest 2/2 0 2
│ │ │ POD READY RESTARTS STATUS ---
│ │ ├── elasticsearch-ingest-0 0/1 0 Running Waiting for: ready 0->2
│ │ └── elasticsearch-ingest-1 0/1 0 Running
│ │ my-elasticsearch-master 1/1 0 1
│ │ │ POD READY RESTARTS STATUS ---
│ │ └── elasticsearch-master-0 0/1 0 Running Waiting for: ready 0->1
│ └ Status progress
│ deploy/my-elasticsearch-metrics ERROR: po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics: Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline ↵
│ exceeded (Client.Timeout exceeded while awaiting headers)
│ Allowed failures count for deploy/my-elasticsearch-metrics exceeded 1 errors: stop tracking immediately!
│ ┌ Failed resource deploy/my-elasticsearch-metrics service messages
│ │ added
│ │ rs/my-elasticsearch-metrics-944c9685b added
│ │ po/my-elasticsearch-metrics-944c9685b-8wrk6 added
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": dial tcp 10.112.128.53:9114: connect: connection refused
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting ↵
│ │ headers)
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting ↵
│ │ headers)
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting ↵
│ │ headers)
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting ↵
│ │ headers)
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting ↵
│ │ headers)
│ │ event: po/my-elasticsearch-metrics-944c9685b-8wrk6 Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting ↵
│ │ headers)
│ └ Failed resource deploy/my-elasticsearch-metrics service messages
└ Waiting for resources to become ready (70.82 seconds) FAILED
┌ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
│ [2022-10-11T15:05:16,136][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [aggs-matrix-stats]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [analysis-common]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [constant-keyword]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [data-streams]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [frozen-indices]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-attachment]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-common]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-geoip]
│ [2022-10-11T15:05:16,137][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-user-agent]
│ [2022-10-11T15:05:16,138][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [kibana]
│ [2022-10-11T15:05:16,143][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [lang-expression]
│ [2022-10-11T15:05:16,143][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [lang-mustache]
│ [2022-10-11T15:05:16,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [lang-painless]
│ [2022-10-11T15:05:16,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [legacy-geo]
│ [2022-10-11T15:05:16,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [mapper-extras]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [mapper-version]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [old-lucene-versions]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [parent-join]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [percolator]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [rank-eval]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [reindex]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repositories-metering-api]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-azure]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-encrypted]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-gcs]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-s3]
│ [2022-10-11T15:05:16,171][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-url]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [runtime-fields-common]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [search-business-rules]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [searchable-snapshots]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [snapshot-based-recoveries]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [snapshot-repo-test-kit]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [spatial]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [transform]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [transport-netty4]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [unsigned-long]
│ [2022-10-11T15:05:16,172][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [vector-tile]
│ [2022-10-11T15:05:16,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [wildcard]
│ [2022-10-11T15:05:16,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-aggregate-metric]
│ [2022-10-11T15:05:16,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-analytics]
│ [2022-10-11T15:05:16,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-async]
│ [2022-10-11T15:05:16,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-async-search]
│ [2022-10-11T15:05:16,174][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-autoscaling]
│ [2022-10-11T15:05:16,174][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ccr]
│ [2022-10-11T15:05:16,175][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-core]
│ [2022-10-11T15:05:16,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-deprecation]
│ [2022-10-11T15:05:16,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-enrich]
│ [2022-10-11T15:05:16,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-eql]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-fleet]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-graph]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-identity-provider]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ilm]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-logstash]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ml]
│ [2022-10-11T15:05:16,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-monitoring]
│ [2022-10-11T15:05:16,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ql]
│ [2022-10-11T15:05:16,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-rollup]
│ [2022-10-11T15:05:16,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-security]
│ [2022-10-11T15:05:16,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-shutdown]
│ [2022-10-11T15:05:16,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-sql]
│ [2022-10-11T15:05:16,185][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-stack]
│ [2022-10-11T15:05:16,185][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-text-structure]
│ [2022-10-11T15:05:16,196][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-voting-only-node]
│ [2022-10-11T15:05:16,196][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-watcher]
│ [2022-10-11T15:05:16,196][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] no plugins loaded
└ sts/my-elasticsearch-data po/my-elasticsearch-data-0 container/elasticsearch logs
┌ sts/my-elasticsearch-master po/my-elasticsearch-master-0 container/elasticsearch logs
│ [2022-10-11T15:05:16,439][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [aggs-matrix-stats]
│ [2022-10-11T15:05:16,439][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [analysis-common]
│ [2022-10-11T15:05:16,439][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [constant-keyword]
│ [2022-10-11T15:05:16,439][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [data-streams]
│ [2022-10-11T15:05:16,439][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [frozen-indices]
│ [2022-10-11T15:05:16,439][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-attachment]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-common]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-geoip]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-user-agent]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [kibana]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [lang-expression]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [lang-mustache]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [lang-painless]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [legacy-geo]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [mapper-extras]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [mapper-version]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [old-lucene-versions]
│ [2022-10-11T15:05:16,440][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [parent-join]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [percolator]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [rank-eval]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [reindex]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repositories-metering-api]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-azure]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-encrypted]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-gcs]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-s3]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-url]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [runtime-fields-common]
│ [2022-10-11T15:05:16,441][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [search-business-rules]
│ [2022-10-11T15:05:16,442][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [searchable-snapshots]
│ [2022-10-11T15:05:16,442][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [snapshot-based-recoveries]
│ [2022-10-11T15:05:16,442][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [snapshot-repo-test-kit]
│ [2022-10-11T15:05:16,443][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [spatial]
│ [2022-10-11T15:05:16,443][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [transform]
│ [2022-10-11T15:05:16,444][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [transport-netty4]
│ [2022-10-11T15:05:16,444][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [unsigned-long]
│ [2022-10-11T15:05:16,444][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [vector-tile]
│ [2022-10-11T15:05:16,444][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [wildcard]
│ [2022-10-11T15:05:16,445][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-aggregate-metric]
│ [2022-10-11T15:05:16,449][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-analytics]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-async]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-async-search]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-autoscaling]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ccr]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-core]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-deprecation]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-enrich]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-eql]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-fleet]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-graph]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-identity-provider]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ilm]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-logstash]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ml]
│ [2022-10-11T15:05:16,450][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-monitoring]
│ [2022-10-11T15:05:16,451][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ql]
│ [2022-10-11T15:05:16,451][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-rollup]
│ [2022-10-11T15:05:16,451][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-security]
│ [2022-10-11T15:05:16,451][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-shutdown]
│ [2022-10-11T15:05:16,465][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-sql]
│ [2022-10-11T15:05:16,466][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-stack]
│ [2022-10-11T15:05:16,466][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-text-structure]
│ [2022-10-11T15:05:16,466][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-voting-only-node]
│ [2022-10-11T15:05:16,466][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-watcher]
│ [2022-10-11T15:05:16,466][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] no plugins loaded
│ ┌ Waiting for resources elimination: services/my-elasticsearch-ingest-hl, services/my-elasticsearch-coordinating-hl, services/my-elasticsearch-metrics, services/my-elasticsearch, services/my-elastic ...
│ └ Waiting for resources elimination: services/my-elasticsearch-ingest-hl, services/my-elasticsearch-coordinating-hl, services/my-elasticsearch-metrics, services/my-elasticsearch, services/my-elastic ...
│ ┌ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs
│ │ [2022-10-11T15:05:16,498][INFO ][o.e.x.s.Security ] [my-elasticsearch-coordinating-0] Security is disabled
│ └ sts/my-elasticsearch-coordinating po/my-elasticsearch-coordinating-0 container/elasticsearch logs (0.29 seconds)
│ Error: INSTALLATION FAILED: release my-elasticsearch failed, and has been uninstalled due to atomic being set: error processing rollout phase stage: error tracking resources: deploy/my-elasticsearch-metrics failed: po/my-elasticsearch-metrics-944c9685b-8wrk6 container/metrics: Unhealthy: Readiness probe failed: Get "http://10.112.128.53:9114/metrics": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment