Skip to content

Instantly share code, notes, and snippets.

@patsevanton

patsevanton/full log elasticsearch 19.4.2

Created October 14, 2022 12:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save patsevanton/91ff1d968f708e3731fa36330a2c8b13 to your computer and use it in GitHub Desktop.
Save patsevanton/91ff1d968f708e3731fa36330a2c8b13 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
full log elasticsearch 19.4.2
stern -n elasticsearch .
+ my-elasticsearch-metrics-944c9685b-bpwr5 › metrics
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:10:45.629605717Z caller=clusterinfo.go:214 msg="triggering initial cluster info call"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:10:45.629682109Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:10:46.657634951Z caller=clusterinfo.go:267 msg="failed to get cluster info" err="Get \"http://my-elasticsearch:9200/\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:10:46.657732623Z caller=clusterinfo.go:188 msg="failed to retrieve cluster info from ES" err="Get \"http://my-elasticsearch:9200/\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:10:55.63131254Z caller=main.go:250 msg="initial cluster info call timed out"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:10:55.631564464Z caller=main.go:285 msg="starting elasticsearch_exporter" addr=:9114
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:10:58.401566547Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.026652618 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:10:58.401780172Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:10:58.40185363Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:07.376071987Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:11:07.376048123Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=0.00101082 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:08.385675175Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
+ my-elasticsearch-ingest-1 › elasticsearch
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:08.75
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:08.75 Welcome to the Bitnami elasticsearch container
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:08.76 Subscribe to project updates by watching https://github.com/bitnami/containers
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:08.76 Submit issues and feature requests at https://github.com/bitnami/containers/issues
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:08.76
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:08.77 INFO ==> ** Starting Elasticsearch setup **
my-elasticsearch-ingest-1 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
+ my-elasticsearch-ingest-0 › elasticsearch
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:08.68
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:08.68 Welcome to the Bitnami elasticsearch container
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:08.68 Subscribe to project updates by watching https://github.com/bitnami/containers
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:08.68 Submit issues and feature requests at https://github.com/bitnami/containers/issues
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:08.69
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:08.69 INFO ==> ** Starting Elasticsearch setup **
my-elasticsearch-ingest-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
+ my-elasticsearch-coordinating-0 › elasticsearch
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:09.88
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:09.88 Welcome to the Bitnami elasticsearch container
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:09.89 Subscribe to project updates by watching https://github.com/bitnami/containers
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:09.89 Submit issues and feature requests at https://github.com/bitnami/containers/issues
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:09.89
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:09.89 INFO ==> ** Starting Elasticsearch setup **
my-elasticsearch-coordinating-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
+ my-elasticsearch-master-0 › elasticsearch
+ my-elasticsearch-data-0 › elasticsearch
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:11.57
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:11.57 Welcome to the Bitnami elasticsearch container
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:11.58 Subscribe to project updates by watching https://github.com/bitnami/containers
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:11.58 Submit issues and feature requests at https://github.com/bitnami/containers/issues
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:11.45
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:11.58
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:11.46 Welcome to the Bitnami elasticsearch container
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:11.59 INFO ==> ** Starting Elasticsearch setup **
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:11.46 Subscribe to project updates by watching https://github.com/bitnami/containers
my-elasticsearch-data-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:11.46 Submit issues and feature requests at https://github.com/bitnami/containers/issues
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:11.46
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:11.47 INFO ==> ** Starting Elasticsearch setup **
my-elasticsearch-master-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:13.81 INFO ==> Configuring/Initializing Elasticsearch...
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:13.89 INFO ==> Setting default configuration
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:14.08 INFO ==> Configuring Elasticsearch cluster settings...
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:14.18 INFO ==> Configuring/Initializing Elasticsearch...
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:14.38 INFO ==> Setting default configuration
my-elasticsearch-coordinating-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:14.68 INFO ==> Configuring/Initializing Elasticsearch...
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:14.68 INFO ==> Configuring Elasticsearch cluster settings...
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:14.87 INFO ==> Setting default configuration
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:14.97 INFO ==> Configuring Elasticsearch cluster settings...
my-elasticsearch-ingest-1 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:15.23 INFO ==> Configuring/Initializing Elasticsearch...
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:15.29 INFO ==> Setting default configuration
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:15.36 INFO ==> Configuring Elasticsearch cluster settings...
my-elasticsearch-master-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:15.54 INFO ==> Configuring/Initializing Elasticsearch...
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:15.61 INFO ==> Setting default configuration
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:15.70 INFO ==> Configuring Elasticsearch cluster settings...
my-elasticsearch-ingest-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-data-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-coordinating-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:18.881569339Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:18.901501185Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:11:18.901597319Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.413069712 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-master-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-data-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-coordinating-0 elasticsearch
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:24.05 INFO ==> ** Elasticsearch setup finished! **
my-elasticsearch-coordinating-0 elasticsearch elasticsearch 11:11:24.08 INFO ==> ** Starting Elasticsearch **
my-elasticsearch-coordinating-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:25.67 INFO ==> ** Elasticsearch setup finished! **
my-elasticsearch-master-0 elasticsearch
my-elasticsearch-master-0 elasticsearch elasticsearch 11:11:25.72 INFO ==> ** Starting Elasticsearch **
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:25.76 INFO ==> ** Elasticsearch setup finished! **
my-elasticsearch-data-0 elasticsearch
my-elasticsearch-data-0 elasticsearch elasticsearch 11:11:25.79 INFO ==> ** Starting Elasticsearch **
my-elasticsearch-data-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-master-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-ingest-1 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-ingest-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:28.385545251Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:11:28.385639916Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.009393303 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:28.385697914Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:38,218][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] version[8.4.2], pid[401], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:38,229][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:38,232][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-9690478239106886916, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:38.47928694Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:11:38.488886681Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.111017359 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:38.489024148Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:39.28 INFO ==> ** Elasticsearch setup finished! **
my-elasticsearch-ingest-1 elasticsearch
my-elasticsearch-ingest-1 elasticsearch elasticsearch 11:11:39.38 INFO ==> ** Starting Elasticsearch **
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:39,516][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] version[8.4.2], pid[405], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:39,526][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:39,527][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-4148865464364081092, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
my-elasticsearch-ingest-1 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-ingest-0 elasticsearch
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:39.87 INFO ==> ** Elasticsearch setup finished! **
my-elasticsearch-ingest-0 elasticsearch elasticsearch 11:11:39.91 INFO ==> ** Starting Elasticsearch **
my-elasticsearch-ingest-0 elasticsearch warning: ignoring JAVA_HOME=/opt/bitnami/java; using ES_JAVA_HOME
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:41,782][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] version[8.4.2], pid[413], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:41,783][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:41,783][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-902342518074767436, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms1024m, -Xmx1024m, -XX:MaxDirectMemorySize=536870912, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:45,656][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-coordinating-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:46,919][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-master-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:48.389763702Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:49,303][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-data-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:11:50.489407069Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=3.111809666 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:50.717401566Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,316][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [aggs-matrix-stats]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,329][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [analysis-common]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,329][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [constant-keyword]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,331][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [data-streams]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,331][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [frozen-indices]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,331][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-attachment]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,332][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-common]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,332][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-geoip]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,333][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [ingest-user-agent]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,333][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [kibana]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,334][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [lang-expression]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,334][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [lang-mustache]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,334][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [lang-painless]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [legacy-geo]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [mapper-extras]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [mapper-version]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [old-lucene-versions]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [parent-join]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [percolator]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [rank-eval]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [reindex]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,337][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repositories-metering-api]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-azure]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-encrypted]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-gcs]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-s3]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [repository-url]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [runtime-fields-common]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [search-business-rules]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [searchable-snapshots]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [snapshot-based-recoveries]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [snapshot-repo-test-kit]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [spatial]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [transform]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [transport-netty4]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [unsigned-long]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [vector-tile]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [wildcard]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,338][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-aggregate-metric]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-analytics]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-async]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-async-search]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-autoscaling]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ccr]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-core]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-deprecation]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-enrich]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-eql]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-fleet]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-graph]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-identity-provider]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ilm]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-logstash]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ml]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-monitoring]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,339][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-ql]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-rollup]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-security]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-shutdown]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-sql]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-stack]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-text-structure]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-voting-only-node]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] loaded module [x-pack-watcher]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:11:51,340][INFO ][o.e.p.PluginsService ] [my-elasticsearch-coordinating-0] no plugins loaded
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [aggs-matrix-stats]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [analysis-common]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [constant-keyword]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [data-streams]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [frozen-indices]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-attachment]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-common]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-geoip]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [ingest-user-agent]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [kibana]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [lang-expression]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,242][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [lang-mustache]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [lang-painless]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [legacy-geo]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [mapper-extras]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [mapper-version]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [old-lucene-versions]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [parent-join]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [percolator]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [rank-eval]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [reindex]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repositories-metering-api]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-azure]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-encrypted]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-gcs]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-s3]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [repository-url]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [runtime-fields-common]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [search-business-rules]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [searchable-snapshots]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,243][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [snapshot-based-recoveries]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [snapshot-repo-test-kit]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [spatial]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [transform]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [transport-netty4]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [unsigned-long]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [vector-tile]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [wildcard]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-aggregate-metric]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-analytics]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-async]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-async-search]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-autoscaling]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ccr]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-core]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-deprecation]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-enrich]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-eql]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-fleet]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-graph]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-identity-provider]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,244][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ilm]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-logstash]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ml]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-monitoring]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-ql]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-rollup]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-security]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-shutdown]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-sql]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-stack]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-text-structure]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-voting-only-node]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] loaded module [x-pack-watcher]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:11:52,245][INFO ][o.e.p.PluginsService ] [my-elasticsearch-master-0] no plugins loaded
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:11:52.387355507Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.007634324 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:52.387870029Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: i/o timeout (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:52.485724625Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: i/o timeout (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,654][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [aggs-matrix-stats]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,654][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [analysis-common]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,654][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [constant-keyword]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,654][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [data-streams]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,654][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [frozen-indices]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,654][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-attachment]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-common]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-geoip]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [ingest-user-agent]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [kibana]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [lang-expression]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [lang-mustache]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,655][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [lang-painless]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,656][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [legacy-geo]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,656][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [mapper-extras]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,656][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [mapper-version]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,656][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [old-lucene-versions]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,656][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [parent-join]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,656][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [percolator]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,657][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [rank-eval]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,657][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [reindex]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,657][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repositories-metering-api]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,657][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-azure]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,657][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-encrypted]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,658][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-gcs]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,658][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-s3]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,659][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [repository-url]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,659][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [runtime-fields-common]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,659][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [search-business-rules]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,660][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [searchable-snapshots]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,660][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [snapshot-based-recoveries]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,661][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [snapshot-repo-test-kit]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,661][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [spatial]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,661][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [transform]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,662][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [transport-netty4]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,666][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [unsigned-long]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,666][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [vector-tile]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,667][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [wildcard]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,667][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-aggregate-metric]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,670][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-analytics]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,670][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-async]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,670][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-async-search]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,671][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-autoscaling]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,671][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ccr]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,671][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-core]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,671][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-deprecation]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,671][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-enrich]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,672][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-eql]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,679][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-fleet]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,679][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-graph]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,679][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-identity-provider]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,680][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ilm]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,680][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-logstash]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,680][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ml]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,681][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-monitoring]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,682][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-ql]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,682][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-rollup]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,683][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-security]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,683][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-shutdown]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,683][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-sql]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,683][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-stack]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,683][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-text-structure]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,684][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-voting-only-node]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,684][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] loaded module [x-pack-watcher]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:11:54,685][INFO ][o.e.p.PluginsService ] [my-elasticsearch-data-0] no plugins loaded
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:11:58.597446339Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:00.753478453Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:00.686296777Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=3.136736501 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:02.57263979Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:02.577126824Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.007297438 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:02.657378398Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:04,473][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-coordinating-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vda2)]], net usable_space [21.3gb], net total_space [31.4gb], types [ext4]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:04,497][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-coordinating-0] heap size [128mb], compressed ordinary object pointers [true]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:04,535][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] node name [my-elasticsearch-coordinating-0], node ID [C2b61Vl2Q0SU6vpWYHJVVA], cluster name [elastic], roles []
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:05,357][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-master-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vdb)]], net usable_space [7.7gb], net total_space [7.8gb], types [ext4]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:05,358][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-master-0] heap size [128mb], compressed ordinary object pointers [true]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:05,422][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] node name [my-elasticsearch-master-0], node ID [Lbr5LxCsTjqlwg5jsTSruw], cluster name [elastic], roles [master]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:06,763][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-data-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vdc)]], net usable_space [7.7gb], net total_space [7.8gb], types [ext4]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:06,793][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-data-0] heap size [1gb], compressed ordinary object pointers [true]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:06,814][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] node name [my-elasticsearch-data-0], node ID [0zAOpHP1RDeQD67yUeq7Pw], cluster name [elastic], roles [data]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:08.625454571Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:10.77113021Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:10.856790787Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=3.275036719 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:12.589458483Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: i/o timeout (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:12.677336747Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.093716094 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:12.751999491Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:13,479][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] version[8.4.2], pid[405], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:13,489][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] JVM home [/opt/bitnami/java], using bundled JDK [false]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:13,497][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-12200631421685536003, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:13,887][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] version[8.4.2], pid[402], build[tar/89f8c6d8429db93b816403ee75e5c270b43a940a/2022-09-14T16:26:04.382547801Z], OS[Linux/5.4.0-117-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/17.0.4/17.0.4+8-LTS]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:13,973][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] JVM home [/opt/bitnami/java], using bundled JDK [false]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:13,974][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-13430514916983948835, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms128m, -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/bitnami/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:18,291][INFO ][o.e.x.s.Security ] [my-elasticsearch-coordinating-0] Security is disabled
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:18.475529433Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:19,912][INFO ][o.e.t.n.NettyAllocator ] [my-elasticsearch-coordinating-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=128mb}]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:20,015][INFO ][o.e.i.r.RecoverySettings ] [my-elasticsearch-coordinating-0] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:19,964][INFO ][o.e.x.s.Security ] [my-elasticsearch-data-0] Security is disabled
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:20,112][INFO ][o.e.d.DiscoveryModule ] [my-elasticsearch-coordinating-0] using discovery type [multi-node] and seed hosts providers [settings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:20,468][INFO ][o.e.x.s.Security ] [my-elasticsearch-master-0] Security is disabled
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:20.417643988Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:20.561388533Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:21,338][INFO ][o.e.t.n.NettyAllocator ] [my-elasticsearch-data-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=1gb}]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:21,455][INFO ][o.e.i.r.RecoverySettings ] [my-elasticsearch-data-0] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:21,644][INFO ][o.e.d.DiscoveryModule ] [my-elasticsearch-data-0] using discovery type [multi-node] and seed hosts providers [settings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:22,165][INFO ][o.e.t.n.NettyAllocator ] [my-elasticsearch-master-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=128mb}]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:22,300][INFO ][o.e.i.r.RecoverySettings ] [my-elasticsearch-master-0] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:22,510][INFO ][o.e.d.DiscoveryModule ] [my-elasticsearch-master-0] using discovery type [multi-node] and seed hosts providers [settings]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:22.398498551Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.019800486 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:22.425413369Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.047150813 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:22.473408465Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:24,260][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] initialized
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:24,297][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] starting ...
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:24,320][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [my-elasticsearch-coordinating-0] deprecation component started
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:24,911][INFO ][o.e.t.TransportService ] [my-elasticsearch-coordinating-0] publish_address {my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local/10.112.128.10:9300}, bound_addresses {0.0.0.0:9300}
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:25,351][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] initialized
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:25,354][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] starting ...
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:25,417][INFO ][o.e.x.s.c.f.PersistentCache] [my-elasticsearch-data-0] persistent cache index loaded
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:25,419][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [my-elasticsearch-data-0] deprecation component started
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:25,524][INFO ][o.e.b.BootstrapChecks ] [my-elasticsearch-coordinating-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:25,526][INFO ][o.e.c.c.ClusterBootstrapService] [my-elasticsearch-coordinating-0] this node has not joined a bootstrapped cluster yet; [cluster.initial_master_nodes] is set to []
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:25,839][INFO ][o.e.t.TransportService ] [my-elasticsearch-data-0] publish_address {my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local/10.112.128.11:9300}, bound_addresses {0.0.0.0:9300}
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:26,328][INFO ][o.e.b.BootstrapChecks ] [my-elasticsearch-data-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:26,335][INFO ][o.e.c.c.ClusterBootstrapService] [my-elasticsearch-data-0] this node has not joined a bootstrapped cluster yet; [cluster.initial_master_nodes] is set to []
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:26,534][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] initialized
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:26,535][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] starting ...
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:26,543][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [my-elasticsearch-master-0] deprecation component started
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:27,020][INFO ][o.e.t.TransportService ] [my-elasticsearch-master-0] publish_address {my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local/10.112.128.12:9300}, bound_addresses {0.0.0.0:9300}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:27,942][INFO ][o.e.b.BootstrapChecks ] [my-elasticsearch-master-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:27,946][INFO ][o.e.c.c.ClusterBootstrapService] [my-elasticsearch-master-0] this node has not joined a bootstrapped cluster yet; [cluster.initial_master_nodes] is set to [my-elasticsearch-master-0]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:27,964][INFO ][o.e.c.c.Coordinator ] [my-elasticsearch-master-0] setting initial configuration to VotingConfiguration{Lbr5LxCsTjqlwg5jsTSruw}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:28,619][INFO ][o.e.c.s.MasterService ] [my-elasticsearch-master-0] elected-as-master ([1] nodes joined)[_FINISH_ELECTION_, {my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m} completing election], term: 1, version: 1, delta: master node changed {previous [], current [{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}]}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:28,835][INFO ][o.e.c.c.CoordinationState] [my-elasticsearch-master-0] cluster UUID set to [-Kkm2FY-R2ugtiILPSWkuw]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:28,900][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-master-0] master node changed {previous [], current [{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,013][INFO ][o.e.r.s.FileSettingsService] [my-elasticsearch-master-0] starting file settings watcher ...
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:29,069][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-ingest-1] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,094][INFO ][o.e.c.s.MasterService ] [my-elasticsearch-master-0] node-join[{my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d} joining, {my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300} joining], term: 1, version: 2, delta: added {{my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d}, {my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300}}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,134][INFO ][o.e.h.AbstractHttpServerTransport] [my-elasticsearch-master-0] publish_address {my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local/10.112.128.12:9200}, bound_addresses {0.0.0.0:9200}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,135][INFO ][o.e.n.Node ] [my-elasticsearch-master-0] started {my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,141][INFO ][o.e.r.s.FileSettingsService] [my-elasticsearch-master-0] file settings service up and running [tid=38]
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:29,157][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-coordinating-0] master node changed {previous [], current [{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}]}, added {{my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d}, {my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}}, term: 1, version: 2, reason: ApplyCommitRequest{term=1, version=2, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:29,202][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-data-0] master node changed {previous [], current [{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}]}, added {{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}, {my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300}}, term: 1, version: 2, reason: ApplyCommitRequest{term=1, version=2, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:29,245][INFO ][o.e.h.AbstractHttpServerTransport] [my-elasticsearch-coordinating-0] publish_address {my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local/10.112.128.10:9200}, bound_addresses {0.0.0.0:9200}
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:29,254][INFO ][o.e.n.Node ] [my-elasticsearch-coordinating-0] started {my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300}{xpack.installed=true}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,366][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-master-0] added {{my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d}, {my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300}}, term: 1, version: 2, reason: Publication{term=1, version=2}
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:29,364][INFO ][o.e.h.AbstractHttpServerTransport] [my-elasticsearch-data-0] publish_address {my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local/10.112.128.11:9200}, bound_addresses {0.0.0.0:9200}
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:29,392][INFO ][o.e.n.Node ] [my-elasticsearch-data-0] started {my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d}{xpack.installed=true}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:29,471][INFO ][c.a.c.i.j.JacksonVersion ] [my-elasticsearch-ingest-0] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:29,613][INFO ][o.e.g.GatewayService ] [my-elasticsearch-master-0] recovered [0] indices into cluster_state
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:29.717642827Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=2.136092262 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:30,794][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.watch-history-16] for index patterns [.watcher-history-16*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:30,827][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.slm-history] for index patterns [.slm-history-5*]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:30.723847302Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,010][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [ilm-history] for index patterns [ilm-history-5*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,123][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [.deprecation-indexing-mappings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,192][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [.deprecation-indexing-settings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,214][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [synthetics-mappings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,218][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [metrics-settings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,299][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [data-streams-mappings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,305][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [logs-settings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,307][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [synthetics-settings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,404][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [metrics-mappings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,424][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding component template [logs-mappings]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,812][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.monitoring-beats-mb] for index patterns [.monitoring-beats-8-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:31,920][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.monitoring-kibana-mb] for index patterns [.monitoring-kibana-8-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,091][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.monitoring-logstash-mb] for index patterns [.monitoring-logstash-8-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,103][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-7-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,126][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding template [.monitoring-beats] for index patterns [.monitoring-beats-7-*]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,164][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [aggs-matrix-stats]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,167][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [analysis-common]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,167][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [constant-keyword]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,169][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [data-streams]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [frozen-indices]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-attachment]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-common]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-geoip]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [ingest-user-agent]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,170][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [kibana]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [lang-expression]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [lang-mustache]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [lang-painless]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [legacy-geo]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,173][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [mapper-extras]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,175][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [mapper-version]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,176][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [old-lucene-versions]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,176][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [parent-join]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,176][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [percolator]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,176][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [rank-eval]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,176][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [reindex]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,176][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repositories-metering-api]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-azure]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-encrypted]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-gcs]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-s3]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [repository-url]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [runtime-fields-common]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [search-business-rules]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [searchable-snapshots]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,178][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [snapshot-based-recoveries]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [snapshot-repo-test-kit]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [spatial]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [transform]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,181][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [transport-netty4]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [unsigned-long]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [vector-tile]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [wildcard]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,182][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-aggregate-metric]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-analytics]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-async]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-async-search]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-autoscaling]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ccr]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-core]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-deprecation]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-enrich]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-eql]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-fleet]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-graph]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-identity-provider]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ilm]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-logstash]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ml]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-monitoring]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-ql]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-rollup]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-security]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-shutdown]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,183][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-sql]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,189][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-stack]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,189][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-text-structure]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,189][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-voting-only-node]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,189][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] loaded module [x-pack-watcher]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,202][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding template [.monitoring-alerts-7] for index patterns [.monitoring-alerts-7]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:32,190][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-1] no plugins loaded
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,294][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding template [.monitoring-es] for index patterns [.monitoring-es-7-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,310][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-7-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,402][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.monitoring-ent-search-mb] for index patterns [.monitoring-ent-search-8-*]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:32.485705283Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.00016922 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,532][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.monitoring-es-mb] for index patterns [.monitoring-es-8-*]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:32.537403732Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: i/o timeout (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:32.681443025Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,831][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [.deprecation-indexing-template] for index patterns [.logs-deprecation.*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,848][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [logs] for index patterns [logs-*-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,904][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [metrics] for index patterns [metrics-*-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:32,935][INFO ][o.e.c.m.MetadataIndexTemplateService] [my-elasticsearch-master-0] adding index template [synthetics] for index patterns [synthetics-*-*]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:33,157][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [watch-history-ilm-policy-16]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:33,368][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [ilm-history-ilm-policy]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:33.477474133Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:33,507][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [slm-history-ilm-policy]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:33,833][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [.deprecation-indexing-ilm-policy]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:34,327][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [logs]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:34,434][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [90-days-default]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:34,541][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [180-days-default]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:34,627][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [365-days-default]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:34,728][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [metrics]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:34,904][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [7-days-default]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:34,987][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [aggs-matrix-stats]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,011][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [analysis-common]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,015][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [constant-keyword]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,020][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [data-streams]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,020][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [frozen-indices]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,020][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-attachment]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-common]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-geoip]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [ingest-user-agent]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,021][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [kibana]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,031][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [lang-expression]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,032][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [lang-mustache]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,032][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [lang-painless]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:35,095][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [synthetics]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,032][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [legacy-geo]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,032][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [mapper-extras]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [mapper-version]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [old-lucene-versions]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [parent-join]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [percolator]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [rank-eval]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [reindex]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repositories-metering-api]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-azure]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,038][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-encrypted]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-gcs]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-s3]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [repository-url]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [runtime-fields-common]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [search-business-rules]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [searchable-snapshots]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [snapshot-based-recoveries]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [snapshot-repo-test-kit]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [spatial]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,039][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [transform]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [transport-netty4]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [unsigned-long]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [vector-tile]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [wildcard]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-aggregate-metric]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-analytics]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-async]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-async-search]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-autoscaling]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ccr]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,069][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-core]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-deprecation]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-enrich]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-eql]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-fleet]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-graph]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-identity-provider]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ilm]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-logstash]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ml]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,070][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-monitoring]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-ql]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-rollup]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-security]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-shutdown]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-sql]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-stack]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-text-structure]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-voting-only-node]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,071][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] loaded module [x-pack-watcher]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:35,072][INFO ][o.e.p.PluginsService ] [my-elasticsearch-ingest-0] no plugins loaded
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:35,302][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [30-days-default]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:35,440][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [.monitoring-8-ilm-policy]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:35,601][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [my-elasticsearch-master-0] adding index lifecycle policy [.fleet-actions-results-ilm-policy]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:38.721572615Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=1.3434230409999999 err="Get \"http://my-elasticsearch:9200\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:39,011][INFO ][o.e.l.LicenseService ] [my-elasticsearch-data-0] license [84c0ee05-70bb-4f77-b169-16f8a54e2d9a] mode [basic] - valid
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:39,030][INFO ][o.e.l.LicenseService ] [my-elasticsearch-coordinating-0] license [84c0ee05-70bb-4f77-b169-16f8a54e2d9a] mode [basic] - valid
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:39,202][INFO ][o.e.l.LicenseService ] [my-elasticsearch-master-0] license [84c0ee05-70bb-4f77-b169-16f8a54e2d9a] mode [basic] - valid
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:39,312][INFO ][o.e.c.m.MetadataCreateIndexService] [my-elasticsearch-master-0] [.geoip_databases] creating index, cause [auto(bulk api)], templates [], shards [1]/[0]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:40,609][INFO ][o.e.c.r.a.AllocationService] [my-elasticsearch-master-0] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.geoip_databases][0]]])." previous.health="YELLOW" reason="shards started [[.geoip_databases][0]]"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:40.745424483Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:40.802081672Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:42,410][INFO ][o.e.i.g.GeoIpDownloader ] [my-elasticsearch-data-0] successfully downloaded geoip database [GeoLite2-ASN.mmdb]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=error ts=2022-10-14T11:12:42.709392554Z caller=collector.go:189 msg="collector failed" name=cluster-info duration_seconds=5.010352974 err="Get \"http://my-elasticsearch:9200\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:42.741410672Z caller=nodes.go:1857 msg="failed to fetch and decode node stats" err="failed to get cluster health from http://my-elasticsearch:9200/_nodes/stats: Get \"http://my-elasticsearch:9200/_nodes/stats\": dial tcp 10.96.171.149:9200: i/o timeout (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:42.934487943Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:44,437][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-ingest-1] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vda2)]], net usable_space [21.3gb], net total_space [31.4gb], types [ext4]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:44,438][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-ingest-1] heap size [128mb], compressed ordinary object pointers [true]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:44,474][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] node name [my-elasticsearch-ingest-1], node ID [qP5166PIQiafL0dRh1AbVQ], cluster name [elastic], roles [ingest]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:45,250][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-ingest-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vda2)]], net usable_space [21.3gb], net total_space [31.4gb], types [ext4]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:45,251][INFO ][o.e.e.NodeEnvironment ] [my-elasticsearch-ingest-0] heap size [128mb], compressed ordinary object pointers [true]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:45,346][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] node name [my-elasticsearch-ingest-0], node ID [BP5kdzy_SM2GDtNLN0859Q], cluster name [elastic], roles [ingest]
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:47,854][INFO ][o.e.i.g.GeoIpDownloader ] [my-elasticsearch-data-0] successfully downloaded geoip database [GeoLite2-City.mmdb]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=warn ts=2022-10-14T11:12:48.641568425Z caller=cluster_health.go:286 msg="failed to fetch and decode cluster health" err="failed to get cluster health from http://my-elasticsearch:9200/_cluster/health: Get \"http://my-elasticsearch:9200/_cluster/health\": dial tcp 10.96.171.149:9200: connect: connection refused"
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:49,412][INFO ][o.e.i.g.GeoIpDownloader ] [my-elasticsearch-data-0] successfully downloaded geoip database [GeoLite2-Country.mmdb]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:54,238][INFO ][o.e.x.s.Security ] [my-elasticsearch-ingest-1] Security is disabled
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:54,945][INFO ][o.e.x.s.Security ] [my-elasticsearch-ingest-0] Security is disabled
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:55,059][INFO ][o.e.t.n.NettyAllocator ] [my-elasticsearch-ingest-1] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=128mb}]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:55,113][INFO ][o.e.i.r.RecoverySettings ] [my-elasticsearch-ingest-1] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:55,207][INFO ][o.e.d.DiscoveryModule ] [my-elasticsearch-ingest-1] using discovery type [multi-node] and seed hosts providers [settings]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:55,684][INFO ][o.e.t.n.NettyAllocator ] [my-elasticsearch-ingest-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=128mb}]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:55,754][INFO ][o.e.i.r.RecoverySettings ] [my-elasticsearch-ingest-0] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:55,813][INFO ][o.e.d.DiscoveryModule ] [my-elasticsearch-ingest-0] using discovery type [multi-node] and seed hosts providers [settings]
- my-elasticsearch-metrics-944c9685b-bpwr5 › metrics
+ my-elasticsearch-metrics-944c9685b-bpwr5 › metrics
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:12:56.53646533Z caller=clusterinfo.go:214 msg="triggering initial cluster info call"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:12:56.53672996Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:12:56.542268639Z caller=main.go:245 msg="started cluster info retriever" interval=5m0s
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:12:56.542502484Z caller=main.go:285 msg="starting elasticsearch_exporter" addr=:9114
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:57,528][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] initialized
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:57,531][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] starting ...
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:57,541][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [my-elasticsearch-ingest-1] deprecation component started
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:57,885][INFO ][o.e.t.TransportService ] [my-elasticsearch-ingest-1] publish_address {my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local/10.112.128.8:9300}, bound_addresses {0.0.0.0:9300}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:58,264][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] initialized
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:58,268][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] starting ...
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:58,276][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [my-elasticsearch-ingest-0] deprecation component started
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:58,474][INFO ][o.e.t.TransportService ] [my-elasticsearch-ingest-0] publish_address {my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local/10.112.128.9:9300}, bound_addresses {0.0.0.0:9300}
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:58,710][INFO ][o.e.b.BootstrapChecks ] [my-elasticsearch-ingest-1] bound or publishing to a non-loopback address, enforcing bootstrap checks
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:58,723][INFO ][o.e.c.c.ClusterBootstrapService] [my-elasticsearch-ingest-1] this node has not joined a bootstrapped cluster yet; [cluster.initial_master_nodes] is set to []
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:58,883][INFO ][o.e.b.BootstrapChecks ] [my-elasticsearch-ingest-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:58,891][INFO ][o.e.c.c.ClusterBootstrapService] [my-elasticsearch-ingest-0] this node has not joined a bootstrapped cluster yet; [cluster.initial_master_nodes] is set to []
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:59,238][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-data-0] added {{my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i}}, term: 1, version: 27, reason: ApplyCommitRequest{term=1, version=27, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:59,234][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-coordinating-0] added {{my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i}}, term: 1, version: 27, reason: ApplyCommitRequest{term=1, version=27, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:59,203][INFO ][o.e.c.s.MasterService ] [my-elasticsearch-master-0] node-join[{my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i} joining], term: 1, version: 27, delta: added {{my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i}}
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:59,356][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-ingest-1] master node changed {previous [], current [{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}]}, added {{my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300}, {my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}, {my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d}}, term: 1, version: 27, reason: ApplyCommitRequest{term=1, version=27, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:59,432][ERROR][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-1] failed to retrieve database [GeoLite2-Country.mmdb] org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:176)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:162)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:935)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeLocalSearch(TransportSearchAction.java:769)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.lambda$executeRequest$6(TransportSearchAction.java:390)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.ActionListener$2.onResponse(ActionListener.java:162)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:112)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:77)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeRequest(TransportSearchAction.java:478)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:277)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:103)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:86)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:61)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.tasks.TaskManager.registerAndExecute(TaskManager.java:186)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.node.NodeClient.executeLocally(NodeClient.java:112)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.node.NodeClient.doExecute(NodeClient.java:90)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:380)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.FilterClient.doExecute(FilterClient.java:57)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.OriginSettingClient.doExecute(OriginSettingClient.java:43)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:380)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:366)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.search(AbstractClient.java:510)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.ingest.geoip@8.4.2/org.elasticsearch.ingest.geoip.DatabaseNodeService.lambda$retrieveDatabase$13(DatabaseNodeService.java:401)
my-elasticsearch-ingest-1 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:710)
my-elasticsearch-ingest-1 elasticsearch at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
my-elasticsearch-ingest-1 elasticsearch at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
my-elasticsearch-ingest-1 elasticsearch at java.base/java.lang.Thread.run(Thread.java:833)
my-elasticsearch-ingest-1 elasticsearch
my-elasticsearch-data-0 elasticsearch [2022-10-14T11:12:59,639][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-data-0] added {{my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i}}, term: 1, version: 28, reason: ApplyCommitRequest{term=1, version=28, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:59,586][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-master-0] added {{my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i}}, term: 1, version: 27, reason: Publication{term=1, version=27}
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:12:59,598][INFO ][o.e.c.s.MasterService ] [my-elasticsearch-master-0] node-join[{my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i} joining], term: 1, version: 28, delta: added {{my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i}}
my-elasticsearch-coordinating-0 elasticsearch [2022-10-14T11:12:59,621][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-coordinating-0] added {{my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i}}, term: 1, version: 28, reason: ApplyCommitRequest{term=1, version=28, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:59,581][INFO ][o.e.l.LicenseService ] [my-elasticsearch-ingest-1] license [84c0ee05-70bb-4f77-b169-16f8a54e2d9a] mode [basic] - valid
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:59,590][INFO ][o.e.h.AbstractHttpServerTransport] [my-elasticsearch-ingest-1] publish_address {my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local/10.112.128.8:9200}, bound_addresses {0.0.0.0:9200}
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:59,597][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-1] started {my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i}{xpack.installed=true}
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:12:59,687][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-ingest-1] added {{my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i}}, term: 1, version: 28, reason: ApplyCommitRequest{term=1, version=28, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:59,814][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-ingest-0] master node changed {previous [], current [{my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}]}, added {{my-elasticsearch-coordinating-0}{C2b61Vl2Q0SU6vpWYHJVVA}{qyGjZ1KORo6J-HX_HJQh3Q}{my-elasticsearch-coordinating-0}{my-elasticsearch-coordinating-0.my-elasticsearch-coordinating-hl.elasticsearch.svc.cluster.local}{10.112.128.10:9300}, {my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}, {my-elasticsearch-ingest-1}{qP5166PIQiafL0dRh1AbVQ}{8iUP_96DReiLYLiwb1P_Gg}{my-elasticsearch-ingest-1}{my-elasticsearch-ingest-1.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.8:9300}{i}, {my-elasticsearch-data-0}{0zAOpHP1RDeQD67yUeq7Pw}{5RuXsLlVTgWpXz2VwRvgXA}{my-elasticsearch-data-0}{my-elasticsearch-data-0.my-elasticsearch-data-hl.elasticsearch.svc.cluster.local}{10.112.128.11:9300}{d}}, term: 1, version: 28, reason: ApplyCommitRequest{term=1, version=28, sourceNode={my-elasticsearch-master-0}{Lbr5LxCsTjqlwg5jsTSruw}{LiKHeue2TjqZUKmJ9HBokw}{my-elasticsearch-master-0}{my-elasticsearch-master-0.my-elasticsearch-master-hl.elasticsearch.svc.cluster.local}{10.112.128.12:9300}{m}{xpack.installed=true}}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:59,975][ERROR][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-0] failed to retrieve database [GeoLite2-Country.mmdb] org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:176)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:162)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:935)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeLocalSearch(TransportSearchAction.java:769)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.lambda$executeRequest$6(TransportSearchAction.java:390)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.ActionListener$2.onResponse(ActionListener.java:162)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:112)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:77)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeRequest(TransportSearchAction.java:478)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:277)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:103)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:86)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:61)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.tasks.TaskManager.registerAndExecute(TaskManager.java:186)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.node.NodeClient.executeLocally(NodeClient.java:112)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.node.NodeClient.doExecute(NodeClient.java:90)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:380)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.FilterClient.doExecute(FilterClient.java:57)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.OriginSettingClient.doExecute(OriginSettingClient.java:43)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:380)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:366)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.search(AbstractClient.java:510)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.ingest.geoip@8.4.2/org.elasticsearch.ingest.geoip.DatabaseNodeService.lambda$retrieveDatabase$13(DatabaseNodeService.java:401)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:710)
my-elasticsearch-ingest-0 elasticsearch at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
my-elasticsearch-ingest-0 elasticsearch at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
my-elasticsearch-ingest-0 elasticsearch at java.base/java.lang.Thread.run(Thread.java:833)
my-elasticsearch-ingest-0 elasticsearch
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:12:59,988][ERROR][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-0] failed to retrieve database [GeoLite2-ASN.mmdb] org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:176)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:162)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:935)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeLocalSearch(TransportSearchAction.java:769)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.lambda$executeRequest$6(TransportSearchAction.java:390)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.ActionListener$2.onResponse(ActionListener.java:162)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:112)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:77)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.executeRequest(TransportSearchAction.java:478)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:277)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:103)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:86)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:61)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.tasks.TaskManager.registerAndExecute(TaskManager.java:186)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.node.NodeClient.executeLocally(NodeClient.java:112)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.node.NodeClient.doExecute(NodeClient.java:90)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:380)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.FilterClient.doExecute(FilterClient.java:57)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.OriginSettingClient.doExecute(OriginSettingClient.java:43)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:380)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:366)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.client.internal.support.AbstractClient.search(AbstractClient.java:510)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.ingest.geoip@8.4.2/org.elasticsearch.ingest.geoip.DatabaseNodeService.lambda$retrieveDatabase$13(DatabaseNodeService.java:401)
my-elasticsearch-ingest-0 elasticsearch at org.elasticsearch.server@8.4.2/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:710)
my-elasticsearch-ingest-0 elasticsearch at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
my-elasticsearch-ingest-0 elasticsearch at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
my-elasticsearch-ingest-0 elasticsearch at java.base/java.lang.Thread.run(Thread.java:833)
my-elasticsearch-ingest-0 elasticsearch
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:13:00,752][INFO ][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-1] successfully loaded geoip database file [GeoLite2-Country.mmdb]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:13:01,106][INFO ][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-1] successfully loaded geoip database file [GeoLite2-ASN.mmdb]
my-elasticsearch-master-0 elasticsearch [2022-10-14T11:13:01,975][INFO ][o.e.c.s.ClusterApplierService] [my-elasticsearch-master-0] added {{my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i}}, term: 1, version: 28, reason: Publication{term=1, version=28}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:13:01,934][INFO ][o.e.l.LicenseService ] [my-elasticsearch-ingest-0] license [84c0ee05-70bb-4f77-b169-16f8a54e2d9a] mode [basic] - valid
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:13:01,966][INFO ][o.e.h.AbstractHttpServerTransport] [my-elasticsearch-ingest-0] publish_address {my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local/10.112.128.9:9200}, bound_addresses {0.0.0.0:9200}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:13:01,966][INFO ][o.e.n.Node ] [my-elasticsearch-ingest-0] started {my-elasticsearch-ingest-0}{BP5kdzy_SM2GDtNLN0859Q}{OuLnhNnmTEqil6OC7baUJw}{my-elasticsearch-ingest-0}{my-elasticsearch-ingest-0.my-elasticsearch-ingest-hl.elasticsearch.svc.cluster.local}{10.112.128.9:9300}{i}{xpack.installed=true}
my-elasticsearch-ingest-0 elasticsearch [2022-10-14T11:13:03,057][INFO ][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-0] successfully loaded geoip database file [GeoLite2-City.mmdb]
my-elasticsearch-ingest-1 elasticsearch [2022-10-14T11:13:02,938][INFO ][o.e.i.g.DatabaseNodeService] [my-elasticsearch-ingest-1] successfully loaded geoip database file [GeoLite2-City.mmdb]
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:17:56.536902195Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:22:56.541381254Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:27:56.537226526Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
my-elasticsearch-metrics-944c9685b-bpwr5 metrics level=info ts=2022-10-14T11:32:56.545398274Z caller=clusterinfo.go:183 msg="providing consumers with updated cluster info label"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment