Skip to content

Instantly share code, notes, and snippets.

@martinjuhasz

martinjuhasz/gist:403b71e947e386c0692578551162876e Secret

Created December 17, 2021 11:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save martinjuhasz/403b71e947e386c0692578551162876e to your computer and use it in GitHub Desktop.
Save martinjuhasz/403b71e947e386c0692578551162876e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
Attaching to opensearch-dashboards, opensearch-node1, opensearch-node2
opensearch-node1 | Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
opensearch-node2 | Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
opensearch-node1 | OpenSearch Security Demo Installer
opensearch-node1 | ** Warning: Do not use on production or public reachable systems **
opensearch-node1 | Basedir: /usr/share/opensearch
opensearch-node2 | OpenSearch Security Demo Installer
opensearch-node2 | ** Warning: Do not use on production or public reachable systems **
opensearch-node2 | Basedir: /usr/share/opensearch
opensearch-node1 | OpenSearch install type: rpm/deb on NAME="Amazon Linux"
opensearch-node1 | OpenSearch config dir: /usr/share/opensearch/config
opensearch-node1 | OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
opensearch-node1 | OpenSearch bin dir: /usr/share/opensearch/bin
opensearch-node1 | OpenSearch plugins dir: /usr/share/opensearch/plugins
opensearch-node1 | OpenSearch lib dir: /usr/share/opensearch/lib
opensearch-node1 | Detected OpenSearch Version: x-content-1.2.2
opensearch-node1 | Detected OpenSearch Security Version: 1.2.2.0
opensearch-node2 | OpenSearch install type: rpm/deb on NAME="Amazon Linux"
opensearch-node2 | OpenSearch config dir: /usr/share/opensearch/config
opensearch-node2 | OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
opensearch-node2 | OpenSearch bin dir: /usr/share/opensearch/bin
opensearch-node2 | OpenSearch plugins dir: /usr/share/opensearch/plugins
opensearch-node2 | OpenSearch lib dir: /usr/share/opensearch/lib
opensearch-node2 | Detected OpenSearch Version: x-content-1.2.2
opensearch-node2 | Detected OpenSearch Security Version: 1.2.2.0
opensearch-node1 |
opensearch-node2 |
opensearch-node1 | ### Success
opensearch-node1 | ### Execute this script now on all your nodes and then start all nodes
opensearch-node1 | ### OpenSearch Security will be automatically initialized.
opensearch-node1 | ### If you like to change the runtime configuration
opensearch-node1 | ### change the files in ../securityconfig and execute:
opensearch-node1 | "/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh" -cd "/usr/share/opensearch/plugins/opensearch-security/securityconfig" -icl -key "/usr/share/opensearch/config/kirk-key.pem" -cert "/usr/share/opensearch/config/kirk.pem" -cacert "/usr/share/opensearch/config/root-ca.pem" -nhnv
opensearch-node1 | ### or run ./securityadmin_demo.sh
opensearch-node1 | ### To use the Security Plugin ConfigurationGUI
opensearch-node1 | ### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
opensearch-node1 | ### (Ignore the SSL certificate warning because we installed self-signed demo certificates)
opensearch-node1 | Enabling OpenSearch Security Plugin
opensearch-node2 | ### Success
opensearch-node2 | ### Execute this script now on all your nodes and then start all nodes
opensearch-node2 | ### OpenSearch Security will be automatically initialized.
opensearch-node2 | ### If you like to change the runtime configuration
opensearch-node2 | ### change the files in ../securityconfig and execute:
opensearch-node2 | "/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh" -cd "/usr/share/opensearch/plugins/opensearch-security/securityconfig" -icl -key "/usr/share/opensearch/config/kirk-key.pem" -cert "/usr/share/opensearch/config/kirk.pem" -cacert "/usr/share/opensearch/config/root-ca.pem" -nhnv
opensearch-node2 | ### or run ./securityadmin_demo.sh
opensearch-node2 | ### To use the Security Plugin ConfigurationGUI
opensearch-node2 | ### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
opensearch-node2 | ### (Ignore the SSL certificate warning because we installed self-signed demo certificates)
opensearch-node2 | Enabling OpenSearch Security Plugin
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:13Z","tags":["info","plugins-service"],"pid":1,"message":"Plugin \"visTypeXy\" is disabled."}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:13Z","tags":["warning","config","deprecation"],"pid":1,"message":"\"cpu.cgroup.path.override\" is deprecated and has been replaced by \"ops.cGroupOverrides.cpuPath\""}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:13Z","tags":["warning","config","deprecation"],"pid":1,"message":"\"cpuacct.cgroup.path.override\" is deprecated and has been replaced by \"ops.cGroupOverrides.cpuAcctPath\""}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:13Z","tags":["info","plugins-system"],"pid":1,"message":"Setting up [44] plugins: [alertingDashboards,usageCollection,opensearchDashboardsUsageCollection,opensearchDashboardsLegacy,mapsLegacy,share,opensearchUiShared,legacyExport,embeddable,expressions,data,home,console,apmOss,management,indexPatternManagement,advancedSettings,savedObjects,securityDashboards,reportsDashboards,indexManagementDashboards,anomalyDetectionDashboards,dashboard,visualizations,visTypeVega,visTypeTimeline,timeline,visTypeTable,visTypeMarkdown,tileMap,regionMap,inputControlVis,ganttChartDashboards,visualize,queryWorkbenchDashboards,charts,visTypeVislib,visTypeTagcloud,visTypeTimeseries,visTypeMetric,observabilityDashboards,discover,savedObjectsManagement,bfetch]"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:15Z","tags":["info","savedobjects-service"],"pid":1,"message":"Waiting until all OpenSearch nodes are compatible with OpenSearch Dashboards before starting saved objects migrations..."}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:15Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:15Z","tags":["error","savedobjects-service"],"pid":1,"message":"Unable to retrieve version information from OpenSearch nodes."}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:18Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:20Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:23Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:25Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node1 | [2021-12-17T09:43:26,359][INFO ][o.o.n.Node ] [opensearch-node1] version[1.2.2], pid[102], build[tar/123d41ce4fad54529acd7a290efed848e707b624/2021-12-15T18:03:07.761961Z], OS[Linux/5.10.76-linuxkit/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
opensearch-node1 | [2021-12-17T09:43:26,364][INFO ][o.o.n.Node ] [opensearch-node1] JVM home [/usr/share/opensearch/jdk], using bundled JDK [true]
opensearch-node2 | [2021-12-17T09:43:26,351][INFO ][o.o.n.Node ] [opensearch-node2] version[1.2.2], pid[103], build[tar/123d41ce4fad54529acd7a290efed848e707b624/2021-12-15T18:03:07.761961Z], OS[Linux/5.10.76-linuxkit/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]
opensearch-node2 | [2021-12-17T09:43:26,367][INFO ][o.o.n.Node ] [opensearch-node2] JVM home [/usr/share/opensearch/jdk], using bundled JDK [true]
opensearch-node2 | [2021-12-17T09:43:26,368][INFO ][o.o.n.Node ] [opensearch-node2] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-2104995908129673578, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=/usr/share/opensearch/plugins/opensearch-performance-analyzer/pa_config/opensearch_security.policy, -Dopensearch.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -XX:MaxDirectMemorySize=268435456, -Dopensearch.path.home=/usr/share/opensearch, -Dopensearch.path.conf=/usr/share/opensearch/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
opensearch-node1 | [2021-12-17T09:43:26,364][INFO ][o.o.n.Node ] [opensearch-node1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-18074478098892252011, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=/usr/share/opensearch/plugins/opensearch-performance-analyzer/pa_config/opensearch_security.policy, -Dopensearch.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -XX:MaxDirectMemorySize=268435456, -Dopensearch.path.home=/usr/share/opensearch, -Dopensearch.path.conf=/usr/share/opensearch/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:28Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:30Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:33Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:43:33,250][INFO ][o.o.s.s.t.SSLConfig ] [opensearch-node2] SSL dual mode is disabled
opensearch-node2 | [2021-12-17T09:43:33,256][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] OpenSearch Config path is /usr/share/opensearch/config
opensearch-node1 | [2021-12-17T09:43:33,728][INFO ][o.o.s.s.t.SSLConfig ] [opensearch-node1] SSL dual mode is disabled
opensearch-node1 | [2021-12-17T09:43:33,729][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] OpenSearch Config path is /usr/share/opensearch/config
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:35Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:43:35,590][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] JVM supports TLSv1.3
opensearch-node2 | [2021-12-17T09:43:35,593][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] Config directory is /usr/share/opensearch/config/, from there the key- and truststore files are resolved relatively
opensearch-node1 | [2021-12-17T09:43:35,593][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] JVM supports TLSv1.3
opensearch-node1 | [2021-12-17T09:43:35,596][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] Config directory is /usr/share/opensearch/config/, from there the key- and truststore files are resolved relatively
opensearch-node1 | [2021-12-17T09:43:37,042][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] TLS Transport Client Provider : JDK
opensearch-node1 | [2021-12-17T09:43:37,043][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] TLS Transport Server Provider : JDK
opensearch-node1 | [2021-12-17T09:43:37,044][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] TLS HTTP Provider : JDK
opensearch-node1 | [2021-12-17T09:43:37,045][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2, TLSv1.1]
opensearch-node1 | [2021-12-17T09:43:37,045][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node1] Enabled TLS protocols for HTTP layer : [TLSv1.3, TLSv1.2, TLSv1.1]
opensearch-node2 | [2021-12-17T09:43:37,082][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] TLS Transport Client Provider : JDK
opensearch-node2 | [2021-12-17T09:43:37,082][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] TLS Transport Server Provider : JDK
opensearch-node2 | [2021-12-17T09:43:37,082][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] TLS HTTP Provider : JDK
opensearch-node2 | [2021-12-17T09:43:37,083][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2, TLSv1.1]
opensearch-node2 | [2021-12-17T09:43:37,083][INFO ][o.o.s.s.DefaultSecurityKeyStore] [opensearch-node2] Enabled TLS protocols for HTTP layer : [TLSv1.3, TLSv1.2, TLSv1.1]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:38Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:43:39,005][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] Clustername: opensearch-cluster
opensearch-node1 | [2021-12-17T09:43:39,009][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] Clustername: opensearch-cluster
opensearch-node2 | [2021-12-17T09:43:39,035][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] Directory /usr/share/opensearch/config has insecure file permissions (should be 0700)
opensearch-node1 | [2021-12-17T09:43:39,036][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] Directory /usr/share/opensearch/config has insecure file permissions (should be 0700)
opensearch-node2 | [2021-12-17T09:43:39,037][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] File /usr/share/opensearch/config/esnode.pem has insecure file permissions (should be 0600)
opensearch-node2 | [2021-12-17T09:43:39,038][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] File /usr/share/opensearch/config/esnode-key.pem has insecure file permissions (should be 0600)
opensearch-node1 | [2021-12-17T09:43:39,037][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] File /usr/share/opensearch/config/esnode.pem has insecure file permissions (should be 0600)
opensearch-node1 | [2021-12-17T09:43:39,039][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] File /usr/share/opensearch/config/esnode-key.pem has insecure file permissions (should be 0600)
opensearch-node1 | [2021-12-17T09:43:39,041][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] File /usr/share/opensearch/config/kirk.pem has insecure file permissions (should be 0600)
opensearch-node1 | [2021-12-17T09:43:39,041][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] File /usr/share/opensearch/config/kirk-key.pem has insecure file permissions (should be 0600)
opensearch-node1 | [2021-12-17T09:43:39,049][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] File /usr/share/opensearch/config/root-ca.pem has insecure file permissions (should be 0600)
opensearch-node2 | [2021-12-17T09:43:39,049][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] File /usr/share/opensearch/config/kirk.pem has insecure file permissions (should be 0600)
opensearch-node2 | [2021-12-17T09:43:39,054][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] File /usr/share/opensearch/config/kirk-key.pem has insecure file permissions (should be 0600)
opensearch-node2 | [2021-12-17T09:43:39,055][WARN ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] File /usr/share/opensearch/config/root-ca.pem has insecure file permissions (should be 0600)
opensearch-node2 | [2021-12-17T09:43:39,669][INFO ][o.o.p.c.PluginSettings ] [opensearch-node2] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true, batch-metrics-retention-period-minutes: 7, rpc-port: 9650, webservice-port 9600
opensearch-node1 | [2021-12-17T09:43:39,684][INFO ][o.o.p.c.PluginSettings ] [opensearch-node1] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true, batch-metrics-retention-period-minutes: 7, rpc-port: 9650, webservice-port 9600
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:40Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:43:42,524][INFO ][o.o.i.r.ReindexPlugin ] [opensearch-node2] ReindexPlugin reloadSPI called
opensearch-node2 | [2021-12-17T09:43:42,529][INFO ][o.o.i.r.ReindexPlugin ] [opensearch-node2] Unable to find any implementation for RemoteReindexExtension
opensearch-node1 | [2021-12-17T09:43:42,536][INFO ][o.o.i.r.ReindexPlugin ] [opensearch-node1] ReindexPlugin reloadSPI called
opensearch-node1 | [2021-12-17T09:43:42,547][INFO ][o.o.i.r.ReindexPlugin ] [opensearch-node1] Unable to find any implementation for RemoteReindexExtension
opensearch-node1 | [2021-12-17T09:43:42,668][INFO ][o.o.j.JobSchedulerPlugin ] [opensearch-node1] Loaded scheduler extension: opendistro-index-management, index: .opendistro-ism-config
opensearch-node2 | [2021-12-17T09:43:42,681][INFO ][o.o.j.JobSchedulerPlugin ] [opensearch-node2] Loaded scheduler extension: opendistro-index-management, index: .opendistro-ism-config
opensearch-node1 | [2021-12-17T09:43:42,891][INFO ][o.o.j.JobSchedulerPlugin ] [opensearch-node1] Loaded scheduler extension: reports-scheduler, index: .opendistro-reports-definitions
opensearch-node1 | [2021-12-17T09:43:42,905][INFO ][o.o.j.JobSchedulerPlugin ] [opensearch-node1] Loaded scheduler extension: opendistro_anomaly_detector, index: .opendistro-anomaly-detector-jobs
opensearch-node1 | [2021-12-17T09:43:42,916][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [aggs-matrix-stats]
opensearch-node1 | [2021-12-17T09:43:42,921][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [analysis-common]
opensearch-node1 | [2021-12-17T09:43:42,921][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [geo]
opensearch-node1 | [2021-12-17T09:43:42,921][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [ingest-common]
opensearch-node1 | [2021-12-17T09:43:42,921][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [ingest-geoip]
opensearch-node1 | [2021-12-17T09:43:42,924][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [ingest-user-agent]
opensearch-node1 | [2021-12-17T09:43:42,924][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [lang-expression]
opensearch-node1 | [2021-12-17T09:43:42,927][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [lang-mustache]
opensearch-node1 | [2021-12-17T09:43:42,932][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [lang-painless]
opensearch-node1 | [2021-12-17T09:43:42,933][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [mapper-extras]
opensearch-node1 | [2021-12-17T09:43:42,933][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [opensearch-dashboards]
opensearch-node1 | [2021-12-17T09:43:42,933][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [parent-join]
opensearch-node1 | [2021-12-17T09:43:42,934][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [percolator]
opensearch-node1 | [2021-12-17T09:43:42,934][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [rank-eval]
opensearch-node1 | [2021-12-17T09:43:42,934][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [reindex]
opensearch-node1 | [2021-12-17T09:43:42,934][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [repository-url]
opensearch-node1 | [2021-12-17T09:43:42,934][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded module [transport-netty4]
opensearch-node1 | [2021-12-17T09:43:42,936][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-alerting]
opensearch-node1 | [2021-12-17T09:43:42,937][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-anomaly-detection]
opensearch-node1 | [2021-12-17T09:43:42,937][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-asynchronous-search]
opensearch-node1 | [2021-12-17T09:43:42,937][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-cross-cluster-replication]
opensearch-node1 | [2021-12-17T09:43:42,937][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-index-management]
opensearch-node1 | [2021-12-17T09:43:42,937][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-job-scheduler]
opensearch-node1 | [2021-12-17T09:43:42,938][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-knn]
opensearch-node1 | [2021-12-17T09:43:42,938][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-observability]
opensearch-node1 | [2021-12-17T09:43:42,938][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-performance-analyzer]
opensearch-node1 | [2021-12-17T09:43:42,939][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-reports-scheduler]
opensearch-node1 | [2021-12-17T09:43:42,940][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-security]
opensearch-node1 | [2021-12-17T09:43:42,942][INFO ][o.o.p.PluginsService ] [opensearch-node1] loaded plugin [opensearch-sql]
opensearch-node2 | [2021-12-17T09:43:43,058][INFO ][o.o.j.JobSchedulerPlugin ] [opensearch-node2] Loaded scheduler extension: reports-scheduler, index: .opendistro-reports-definitions
opensearch-node1 | [2021-12-17T09:43:43,057][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in opensearch.yml
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:43Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:43:43,112][INFO ][o.o.j.JobSchedulerPlugin ] [opensearch-node2] Loaded scheduler extension: opendistro_anomaly_detector, index: .opendistro-anomaly-detector-jobs
opensearch-node2 | [2021-12-17T09:43:43,122][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [aggs-matrix-stats]
opensearch-node2 | [2021-12-17T09:43:43,129][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [analysis-common]
opensearch-node2 | [2021-12-17T09:43:43,131][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [geo]
opensearch-node2 | [2021-12-17T09:43:43,133][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [ingest-common]
opensearch-node2 | [2021-12-17T09:43:43,141][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [ingest-geoip]
opensearch-node2 | [2021-12-17T09:43:43,142][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [ingest-user-agent]
opensearch-node2 | [2021-12-17T09:43:43,144][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [lang-expression]
opensearch-node2 | [2021-12-17T09:43:43,145][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [lang-mustache]
opensearch-node2 | [2021-12-17T09:43:43,146][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [lang-painless]
opensearch-node2 | [2021-12-17T09:43:43,147][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [mapper-extras]
opensearch-node2 | [2021-12-17T09:43:43,149][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [opensearch-dashboards]
opensearch-node2 | [2021-12-17T09:43:43,149][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [parent-join]
opensearch-node2 | [2021-12-17T09:43:43,151][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [percolator]
opensearch-node2 | [2021-12-17T09:43:43,152][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [rank-eval]
opensearch-node2 | [2021-12-17T09:43:43,159][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [reindex]
opensearch-node2 | [2021-12-17T09:43:43,162][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [repository-url]
opensearch-node2 | [2021-12-17T09:43:43,164][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded module [transport-netty4]
opensearch-node2 | [2021-12-17T09:43:43,166][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-alerting]
opensearch-node2 | [2021-12-17T09:43:43,167][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-anomaly-detection]
opensearch-node2 | [2021-12-17T09:43:43,169][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-asynchronous-search]
opensearch-node2 | [2021-12-17T09:43:43,170][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-cross-cluster-replication]
opensearch-node2 | [2021-12-17T09:43:43,177][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-index-management]
opensearch-node2 | [2021-12-17T09:43:43,178][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-job-scheduler]
opensearch-node2 | [2021-12-17T09:43:43,179][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-knn]
opensearch-node2 | [2021-12-17T09:43:43,180][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-observability]
opensearch-node2 | [2021-12-17T09:43:43,181][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-performance-analyzer]
opensearch-node2 | [2021-12-17T09:43:43,182][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-reports-scheduler]
opensearch-node2 | [2021-12-17T09:43:43,188][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-security]
opensearch-node2 | [2021-12-17T09:43:43,191][INFO ][o.o.p.PluginsService ] [opensearch-node2] loaded plugin [opensearch-sql]
opensearch-node1 | [2021-12-17T09:43:43,234][DEPRECATION][o.o.d.c.s.Settings ] [opensearch-node1] [node.max_local_storage_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
opensearch-node2 | [2021-12-17T09:43:43,287][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in opensearch.yml
opensearch-node1 | [2021-12-17T09:43:43,301][INFO ][o.o.e.NodeEnvironment ] [opensearch-node1] using [1] data paths, mounts [[/usr/share/opensearch/data (/dev/vda1)]], net usable_space [49.2gb], net total_space [58.4gb], types [ext4]
opensearch-node1 | [2021-12-17T09:43:43,307][INFO ][o.o.e.NodeEnvironment ] [opensearch-node1] heap size [512mb], compressed ordinary object pointers [true]
opensearch-node2 | [2021-12-17T09:43:43,362][DEPRECATION][o.o.d.c.s.Settings ] [opensearch-node2] [node.max_local_storage_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
opensearch-node2 | [2021-12-17T09:43:43,427][INFO ][o.o.e.NodeEnvironment ] [opensearch-node2] using [1] data paths, mounts [[/usr/share/opensearch/data (/dev/vda1)]], net usable_space [49.2gb], net total_space [58.4gb], types [ext4]
opensearch-node2 | [2021-12-17T09:43:43,432][INFO ][o.o.e.NodeEnvironment ] [opensearch-node2] heap size [512mb], compressed ordinary object pointers [true]
opensearch-node1 | [2021-12-17T09:43:43,712][INFO ][o.o.n.Node ] [opensearch-node1] node name [opensearch-node1], node ID [4D-8LuBkQAqBElf8BvC_Tg], cluster name [opensearch-cluster], roles [master, remote_cluster_client, data, ingest]
opensearch-node2 | [2021-12-17T09:43:43,783][INFO ][o.o.n.Node ] [opensearch-node2] node name [opensearch-node2], node ID [R-sEvVs8RQCCYNfE0tKF5A], cluster name [opensearch-cluster], roles [master, remote_cluster_client, data, ingest]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:45Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:48Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:50Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:53Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:55Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:43:55,936][DEPRECATION][o.o.d.c.s.Settings ] [opensearch-node2] [node.max_local_storage_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
opensearch-node1 | [2021-12-17T09:43:55,969][DEPRECATION][o.o.d.c.s.Settings ] [opensearch-node1] [node.max_local_storage_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:43:58Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:00Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node1 | [2021-12-17T09:44:02,693][WARN ][o.o.s.c.Salt ] [opensearch-node1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
opensearch-node2 | [2021-12-17T09:44:02,841][WARN ][o.o.s.c.Salt ] [opensearch-node2] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
opensearch-node1 | [2021-12-17T09:44:02,872][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Message routing enabled: true
opensearch-node2 | [2021-12-17T09:44:02,946][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Message routing enabled: true
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:03Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node1 | [2021-12-17T09:44:03,144][INFO ][o.o.s.f.SecurityFilter ] [opensearch-node1] <NONE> indices are made immutable.
opensearch-node2 | [2021-12-17T09:44:03,165][INFO ][o.o.s.f.SecurityFilter ] [opensearch-node2] <NONE> indices are made immutable.
opensearch-node2 | [2021-12-17T09:44:04,506][INFO ][o.o.a.b.ADCircuitBreakerService] [opensearch-node2] Registered memory breaker.
opensearch-node1 | [2021-12-17T09:44:04,521][INFO ][o.o.a.b.ADCircuitBreakerService] [opensearch-node1] Registered memory breaker.
opensearch-node1 | WARNING: An illegal reflective access operation has occurred
opensearch-node1 | WARNING: Illegal reflective access by io.protostuff.runtime.PolymorphicThrowableSchema (file:/usr/share/opensearch/plugins/opensearch-anomaly-detection/protostuff-runtime-1.7.4.jar) to field java.lang.Throwable.cause
opensearch-node1 | WARNING: Please consider reporting this to the maintainers of io.protostuff.runtime.PolymorphicThrowableSchema
opensearch-node1 | WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
opensearch-node1 | WARNING: All illegal access operations will be denied in a future release
opensearch-node2 | WARNING: An illegal reflective access operation has occurred
opensearch-node2 | WARNING: Illegal reflective access by io.protostuff.runtime.PolymorphicThrowableSchema (file:/usr/share/opensearch/plugins/opensearch-anomaly-detection/protostuff-runtime-1.7.4.jar) to field java.lang.Throwable.cause
opensearch-node2 | WARNING: Please consider reporting this to the maintainers of io.protostuff.runtime.PolymorphicThrowableSchema
opensearch-node2 | WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
opensearch-node2 | WARNING: All illegal access operations will be denied in a future release
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:05Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:08Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:44:08,277][INFO ][o.o.t.NettyAllocator ] [opensearch-node2] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=512mb}]
opensearch-node1 | [2021-12-17T09:44:08,304][INFO ][o.o.t.NettyAllocator ] [opensearch-node1] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=512mb}]
opensearch-node2 | [2021-12-17T09:44:08,753][INFO ][o.o.d.DiscoveryModule ] [opensearch-node2] using discovery type [zen] and seed hosts providers [settings]
opensearch-node1 | [2021-12-17T09:44:08,779][INFO ][o.o.d.DiscoveryModule ] [opensearch-node1] using discovery type [zen] and seed hosts providers [settings]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:10Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:44:11,065][WARN ][o.o.g.DanglingIndicesState] [opensearch-node2] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
opensearch-node1 | [2021-12-17T09:44:11,909][WARN ][o.o.g.DanglingIndicesState] [opensearch-node1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:13Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:44:14,815][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [opensearch-node2] PerformanceAnalyzer Enabled: false
opensearch-node1 | [2021-12-17T09:44:15,009][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [opensearch-node1] PerformanceAnalyzer Enabled: false
opensearch-node2 | [2021-12-17T09:44:15,260][INFO ][o.o.n.Node ] [opensearch-node2] initialized
opensearch-node2 | [2021-12-17T09:44:15,261][INFO ][o.o.n.Node ] [opensearch-node2] starting ...
opensearch-node1 | [2021-12-17T09:44:15,468][INFO ][o.o.n.Node ] [opensearch-node1] initialized
opensearch-node1 | [2021-12-17T09:44:15,469][INFO ][o.o.n.Node ] [opensearch-node1] starting ...
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:15Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:44:16,459][INFO ][o.o.t.TransportService ] [opensearch-node2] publish_address {172.25.0.2:9300}, bound_addresses {0.0.0.0:9300}
opensearch-node1 | [2021-12-17T09:44:16,596][INFO ][o.o.t.TransportService ] [opensearch-node1] publish_address {172.25.0.3:9300}, bound_addresses {0.0.0.0:9300}
opensearch-node2 | [2021-12-17T09:44:17,143][INFO ][o.o.b.BootstrapChecks ] [opensearch-node2] bound or publishing to a non-loopback address, enforcing bootstrap checks
opensearch-node1 | [2021-12-17T09:44:17,245][INFO ][o.o.b.BootstrapChecks ] [opensearch-node1] bound or publishing to a non-loopback address, enforcing bootstrap checks
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:18Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node2 | [2021-12-17T09:44:20,208][INFO ][o.o.c.c.Coordinator ] [opensearch-node2] setting initial configuration to VotingConfiguration{R-sEvVs8RQCCYNfE0tKF5A,4D-8LuBkQAqBElf8BvC_Tg}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:20Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node1 | [2021-12-17T09:44:21,928][INFO ][o.o.c.c.Coordinator ] [opensearch-node1] setting initial configuration to VotingConfiguration{R-sEvVs8RQCCYNfE0tKF5A,4D-8LuBkQAqBElf8BvC_Tg}
opensearch-node1 | [2021-12-17T09:44:23,406][INFO ][o.o.c.c.JoinHelper ] [opensearch-node1] failed to join {opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} with JoinRequest{sourceNode={opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}, minimumTerm=0, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}, targetNode={opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}}]}
opensearch-node1 | org.opensearch.transport.RemoteTransportException: [opensearch-node2][172.25.0.2:9300][internal:cluster/coordination/join]
opensearch-node1 | Caused by: org.opensearch.cluster.coordination.CoordinationStateRejectedException: incoming term 1 does not match current term 2
opensearch-node1 | at org.opensearch.cluster.coordination.CoordinationState.handleJoin(CoordinationState.java:254) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.cluster.coordination.Coordinator.handleJoin(Coordinator.java:1175) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at java.util.Optional.ifPresent(Optional.java:176) ~[?:?]
opensearch-node1 | at org.opensearch.cluster.coordination.Coordinator.processJoinRequest(Coordinator.java:644) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.cluster.coordination.Coordinator.lambda$handleJoinRequest$7(Coordinator.java:607) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.action.ActionListener$1.onResponse(ActionListener.java:78) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.transport.ClusterConnectionManager.connectToNode(ClusterConnectionManager.java:136) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.transport.TransportService.connectToNode(TransportService.java:430) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.transport.TransportService.connectToNode(TransportService.java:414) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:592) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.cluster.coordination.JoinHelper.lambda$new$1(JoinHelper.java:172) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.indexmanagement.rollup.interceptor.RollupInterceptor$interceptHandler$1.messageReceived(RollupInterceptor.kt:139) ~[?:?]
opensearch-node1 | at org.opensearch.security.ssl.transport.SecuritySSLRequestHandler.messageReceivedDecorate(SecuritySSLRequestHandler.java:193) ~[?:?]
opensearch-node1 | at org.opensearch.security.transport.SecurityRequestHandler.messageReceivedDecorate(SecurityRequestHandler.java:336) ~[?:?]
opensearch-node1 | at org.opensearch.security.ssl.transport.SecuritySSLRequestHandler.messageReceived(SecuritySSLRequestHandler.java:153) ~[?:?]
opensearch-node1 | at org.opensearch.security.OpenSearchSecurityPlugin$7$1.messageReceived(OpenSearchSecurityPlugin.java:647) ~[?:?]
opensearch-node1 | at org.opensearch.performanceanalyzer.transport.PerformanceAnalyzerTransportRequestHandler.messageReceived(PerformanceAnalyzerTransportRequestHandler.java:64) ~[?:?]
opensearch-node1 | at org.opensearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:91) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:373) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) ~[?:?]
opensearch-node1 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) ~[?:?]
opensearch-node1 | at java.lang.Thread.run(Thread.java:832) [?:?]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:23Z","tags":["error","opensearch","data"],"pid":1,"message":"[ConnectionError]: connect ECONNREFUSED 172.25.0.3:9200"}
opensearch-node1 | [2021-12-17T09:44:23,716][INFO ][o.o.c.s.MasterService ] [opensearch-node1] elected-as-master ([2] nodes joined)[{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} elect leader, {opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 2, version: 1, delta: master node changed {previous [], current [{opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}}
opensearch-node2 | [2021-12-17T09:44:23,816][INFO ][o.o.c.c.JoinHelper ] [opensearch-node2] failed to join {opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} with JoinRequest{sourceNode={opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}, minimumTerm=0, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}, targetNode={opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}}]}
opensearch-node2 | org.opensearch.transport.RemoteTransportException: [opensearch-node2][172.25.0.2:9300][internal:cluster/coordination/join]
opensearch-node2 | Caused by: org.opensearch.cluster.coordination.CoordinationStateRejectedException: became follower
opensearch-node2 | at org.opensearch.cluster.coordination.JoinHelper$CandidateJoinAccumulator.lambda$close$3(JoinHelper.java:575) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at java.util.HashMap$Values.forEach(HashMap.java:1067) [?:?]
opensearch-node2 | at org.opensearch.cluster.coordination.JoinHelper$CandidateJoinAccumulator.close(JoinHelper.java:575) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at org.opensearch.cluster.coordination.Coordinator.becomeFollower(Coordinator.java:747) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at org.opensearch.cluster.coordination.Coordinator.onFollowerCheckRequest(Coordinator.java:345) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at org.opensearch.cluster.coordination.FollowersChecker$2.doRun(FollowersChecker.java:238) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) [opensearch-1.2.2.jar:1.2.2]
opensearch-node2 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]
opensearch-node2 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]
opensearch-node2 | at java.lang.Thread.run(Thread.java:832) [?:?]
opensearch-node1 | [2021-12-17T09:44:24,290][INFO ][o.o.c.c.CoordinationState] [opensearch-node1] cluster UUID set to [14bRwwHZRJK9TYe-DlRPwg]
opensearch-node2 | [2021-12-17T09:44:24,304][INFO ][o.o.c.c.CoordinationState] [opensearch-node2] cluster UUID set to [14bRwwHZRJK9TYe-DlRPwg]
opensearch-node2 | [2021-12-17T09:44:24,398][INFO ][o.o.c.s.ClusterApplierService] [opensearch-node2] master node changed {previous [], current [{opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}}, term: 2, version: 1, reason: ApplyCommitRequest{term=2, version=1, sourceNode={opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}}
opensearch-node2 | [2021-12-17T09:44:24,508][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node2] Cluster is not recovered yet.
opensearch-node1 | [2021-12-17T09:44:24,552][INFO ][o.o.c.s.ClusterApplierService] [opensearch-node1] master node changed {previous [], current [{opensearch-node1}{4D-8LuBkQAqBElf8BvC_Tg}{46VQziqpSdudk9q8refHNA}{172.25.0.3}{172.25.0.3:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}}, term: 2, version: 1, reason: Publication{term=2, version=1}
opensearch-node2 | [2021-12-17T09:44:24,588][INFO ][o.o.h.AbstractHttpServerTransport] [opensearch-node2] publish_address {172.25.0.2:9200}, bound_addresses {0.0.0.0:9200}
opensearch-node2 | [2021-12-17T09:44:24,589][INFO ][o.o.n.Node ] [opensearch-node2] started
opensearch-node2 | [2021-12-17T09:44:24,595][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] Node started
opensearch-node2 | [2021-12-17T09:44:24,596][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node2] Will attempt to create index .opendistro_security and default configs if they are absent
opensearch-node2 | [2021-12-17T09:44:24,600][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node2] 0 OpenSearch Security modules loaded so far: []
opensearch-node2 | [2021-12-17T09:44:24,602][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node2] Background init thread started. Install default config?: true
opensearch-node1 | [2021-12-17T09:44:24,734][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [opensearch-node1] Config override setting update called with empty string. Ignoring.
opensearch-node1 | [2021-12-17T09:44:24,764][INFO ][o.o.c.r.a.DiskThresholdMonitor] [opensearch-node1] skipping monitor as a check is already in progress
opensearch-node1 | [2021-12-17T09:44:24,767][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node1] Cluster is not recovered yet.
opensearch-node2 | [2021-12-17T09:44:24,859][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [opensearch-node2] Config override setting update called with empty string. Ignoring.
opensearch-node2 | [2021-12-17T09:44:25,191][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node2] Cluster is not recovered yet.
opensearch-node1 | [2021-12-17T09:44:25,204][INFO ][o.o.h.AbstractHttpServerTransport] [opensearch-node1] publish_address {172.25.0.3:9200}, bound_addresses {0.0.0.0:9200}
opensearch-node1 | [2021-12-17T09:44:25,206][INFO ][o.o.n.Node ] [opensearch-node1] started
opensearch-node1 | [2021-12-17T09:44:25,220][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] Node started
opensearch-node1 | [2021-12-17T09:44:25,222][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node1] Will attempt to create index .opendistro_security and default configs if they are absent
opensearch-node1 | [2021-12-17T09:44:25,229][INFO ][o.o.s.OpenSearchSecurityPlugin] [opensearch-node1] 0 OpenSearch Security modules loaded so far: []
opensearch-node1 | [2021-12-17T09:44:25,231][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node1] Background init thread started. Install default config?: true
opensearch-node1 | [2021-12-17T09:44:25,431][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node1] Cluster is not recovered yet.
opensearch-node2 | [2021-12-17T09:44:25,599][INFO ][o.o.a.c.HashRing ] [opensearch-node2] Node added: [R-sEvVs8RQCCYNfE0tKF5A, 4D-8LuBkQAqBElf8BvC_Tg]
opensearch-node2 | [2021-12-17T09:44:25,667][INFO ][o.o.a.c.HashRing ] [opensearch-node2] Add data node to AD version hash ring: R-sEvVs8RQCCYNfE0tKF5A
opensearch-node2 | [2021-12-17T09:44:25,683][INFO ][o.o.a.c.HashRing ] [opensearch-node2] Add data node to AD version hash ring: 4D-8LuBkQAqBElf8BvC_Tg
opensearch-node2 | [2021-12-17T09:44:25,699][INFO ][o.o.a.c.HashRing ] [opensearch-node2] All nodes with known AD version: {R-sEvVs8RQCCYNfE0tKF5A=ADNodeInfo{version=1.2.2, isEligibleDataNode=true}, 4D-8LuBkQAqBElf8BvC_Tg=ADNodeInfo{version=1.2.2, isEligibleDataNode=true}}
opensearch-node2 | [2021-12-17T09:44:25,700][INFO ][o.o.a.c.HashRing ] [opensearch-node2] Rebuild AD hash ring for realtime AD with cooldown, nodeChangeEvents size 0
opensearch-node2 | [2021-12-17T09:44:25,704][INFO ][o.o.a.c.HashRing ] [opensearch-node2] Build AD version hash ring successfully
opensearch-node2 | [2021-12-17T09:44:25,717][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node2] Init AD version hash ring successfully
opensearch-node1 | [2021-12-17T09:44:25,727][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Node added: [R-sEvVs8RQCCYNfE0tKF5A, 4D-8LuBkQAqBElf8BvC_Tg]
opensearch-node1 | [2021-12-17T09:44:25,879][INFO ][o.o.g.GatewayService ] [opensearch-node1] recovered [0] indices into cluster_state
opensearch-node1 | [2021-12-17T09:44:26,376][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Add data node to AD version hash ring: R-sEvVs8RQCCYNfE0tKF5A
opensearch-node1 | [2021-12-17T09:44:26,409][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Add data node to AD version hash ring: 4D-8LuBkQAqBElf8BvC_Tg
opensearch-node1 | [2021-12-17T09:44:26,428][INFO ][o.o.a.c.HashRing ] [opensearch-node1] All nodes with known AD version: {R-sEvVs8RQCCYNfE0tKF5A=ADNodeInfo{version=1.2.2, isEligibleDataNode=true}, 4D-8LuBkQAqBElf8BvC_Tg=ADNodeInfo{version=1.2.2, isEligibleDataNode=true}}
opensearch-node1 | [2021-12-17T09:44:26,430][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Rebuild AD hash ring for realtime AD with cooldown, nodeChangeEvents size 0
opensearch-node1 | [2021-12-17T09:44:26,441][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Build AD version hash ring successfully
opensearch-node1 | [2021-12-17T09:44:26,474][INFO ][o.o.a.c.ADDataMigrator ] [opensearch-node1] Start migrating AD data
opensearch-node1 | [2021-12-17T09:44:26,477][INFO ][o.o.a.c.ADDataMigrator ] [opensearch-node1] AD job index doesn't exist, no need to migrate
opensearch-node1 | [2021-12-17T09:44:26,489][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node1] Init AD version hash ring successfully
opensearch-node2 | [2021-12-17T09:44:26,883][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:30,133][WARN ][o.o.m.j.JvmGcMonitorService] [opensearch-node1] [gc][young][14][13] duration [1s], collections [1]/[1.2s], total [1s]/[1.9s], memory [266.3mb]->[79.8mb]/[512mb], all_pools {[young] [191mb]->[0b]/[0b]}{[old] [73.8mb]->[73.8mb]/[512mb]}{[survivor] [1.5mb]->[6mb]/[0b]}
opensearch-node1 | [2021-12-17T09:44:30,155][WARN ][o.o.m.j.JvmGcMonitorService] [opensearch-node1] [gc][14] overhead, spent [1s] collecting in the last [1.2s]
opensearch-node1 | [2021-12-17T09:44:32,256][INFO ][o.o.c.m.MetadataCreateIndexService] [opensearch-node1] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1]
opensearch-node1 | [2021-12-17T09:44:34,107][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:34,287][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:34,315][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:34Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:44:35,513][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node2] Index .opendistro_security already exists
opensearch-node2 | [2021-12-17T09:44:35,514][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node2] Node started, try to initialize it. Wait for at least yellow cluster state....
opensearch-node2 | [2021-12-17T09:44:37,179][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:38,642][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:38,908][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:39,677][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:40Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:44:41,848][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node1] Index .opendistro_security created?: true
opensearch-node1 | [2021-12-17T09:44:41,882][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node1] Node started, try to initialize it. Wait for at least yellow cluster state....
opensearch-node1 | [2021-12-17T09:44:41,952][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'config' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/config.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:44:41,950][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'config' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/config.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:44:42,426][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:42,650][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:43,453][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:44,114][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:45Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:44:46,736][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:46,895][INFO ][o.o.m.j.JvmGcMonitorService] [opensearch-node1] [gc][30] overhead, spent [618ms] collecting in the last [1.5s]
opensearch-node1 | [2021-12-17T09:44:47,252][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:50,418][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:50,884][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:51Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:44:52,810][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:52,914][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:52,956][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:52,985][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:53Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:44:54,937][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] create_mapping [_doc]
opensearch-node2 | [2021-12-17T09:44:55,115][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:55,149][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:55,232][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:55,254][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:55Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:44:57,683][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:57,704][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:44:57,715][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:44:57,728][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:44:57Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:45:00,319][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:00,409][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Doc with id 'config' and version 2 is updated in .opendistro_security index.
opensearch-node1 | [2021-12-17T09:45:00,545][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:00,412][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'roles' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/roles.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:45:00,602][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:00,642][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:00Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:45:02,285][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Index .opendistro_security already contains doc with id config, skipping update.
opensearch-node1 | [2021-12-17T09:45:02,297][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'roles' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/roles.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:45:02,636][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:03,097][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:03,255][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:03,231][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node1 | [2021-12-17T09:45:03,449][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:03Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:45:05,114][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:05,164][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:05,192][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:05,242][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:05Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:45:05,593][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Doc with id 'roles' and version 2 is updated in .opendistro_security index.
opensearch-node2 | [2021-12-17T09:45:05,598][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'rolesmapping' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/roles_mapping.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:05,616][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Index .opendistro_security already contains doc with id roles, skipping update.
opensearch-node1 | [2021-12-17T09:45:05,622][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'rolesmapping' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/roles_mapping.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:05,880][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node1 | [2021-12-17T09:45:07,191][INFO ][o.o.c.r.a.AllocationService] [opensearch-node1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]]]).
opensearch-node1 | [2021-12-17T09:45:07,302][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Doc with id 'rolesmapping' and version 2 is updated in .opendistro_security index.
opensearch-node1 | [2021-12-17T09:45:07,303][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'internalusers' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/internal_users.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:07,435][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node2 | [2021-12-17T09:45:07,730][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:07,912][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:07,942][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Index .opendistro_security already contains doc with id rolesmapping, skipping update.
opensearch-node2 | [2021-12-17T09:45:07,955][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'internalusers' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/internal_users.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:45:07,962][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:08,044][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:08Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:45:08,253][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Doc with id 'internalusers' and version 2 is updated in .opendistro_security index.
opensearch-node1 | [2021-12-17T09:45:08,253][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'actiongroups' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/action_groups.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:45:08,294][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Index .opendistro_security already contains doc with id internalusers, skipping update.
opensearch-node2 | [2021-12-17T09:45:08,294][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'actiongroups' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/action_groups.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:08,428][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node1 | [2021-12-17T09:45:08,891][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Doc with id 'actiongroups' and version 2 is updated in .opendistro_security index.
opensearch-node1 | [2021-12-17T09:45:08,891][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'tenants' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/tenants.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node2 | [2021-12-17T09:45:08,951][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Index .opendistro_security already contains doc with id actiongroups, skipping update.
opensearch-node2 | [2021-12-17T09:45:08,954][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'tenants' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/tenants.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:09,161][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node1 | [2021-12-17T09:45:09,723][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Doc with id 'tenants' and version 2 is updated in .opendistro_security index.
opensearch-node1 | [2021-12-17T09:45:09,723][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'nodesdn' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/nodes_dn.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
opensearch-node2 | [2021-12-17T09:45:09,730][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Index .opendistro_security already contains doc with id tenants, skipping update.
opensearch-node2 | [2021-12-17T09:45:09,730][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'nodesdn' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/nodes_dn.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
opensearch-node1 | [2021-12-17T09:45:09,801][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node2 | [2021-12-17T09:45:10,105][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:10,231][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:10,288][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:10,341][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:10,305][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Index .opendistro_security already contains doc with id nodesdn, skipping update.
opensearch-node2 | [2021-12-17T09:45:10,309][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'whitelist' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/whitelist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
opensearch-node1 | [2021-12-17T09:45:10,359][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Doc with id 'nodesdn' and version 2 is updated in .opendistro_security index.
opensearch-node1 | [2021-12-17T09:45:10,361][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'whitelist' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/whitelist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:10Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:45:10,529][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node2 | [2021-12-17T09:45:10,848][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Doc with id 'whitelist' and version 2 is updated in .opendistro_security index.
opensearch-node2 | [2021-12-17T09:45:10,850][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Will update 'audit' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/audit.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:10,874][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Index .opendistro_security already contains doc with id whitelist, skipping update.
opensearch-node1 | [2021-12-17T09:45:10,874][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Will update 'audit' with /usr/share/opensearch/plugins/opensearch-security/securityconfig/audit.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
opensearch-node1 | [2021-12-17T09:45:11,193][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [.opendistro_security/KT0zSHc5QIqa0oxHUMfXkg] update_mapping [_doc]
opensearch-node2 | [2021-12-17T09:45:12,538][INFO ][o.o.m.j.JvmGcMonitorService] [opensearch-node2] [gc][young][52][13] duration [950ms], collections [1]/[1.5s], total [950ms]/[1.8s], memory [196.7mb]->[82.3mb]/[512mb], all_pools {[young] [118mb]->[0b]/[0b]}{[old] [64.3mb]->[77.8mb]/[512mb]}{[survivor] [14.4mb]->[4.5mb]/[0b]}
opensearch-node2 | [2021-12-17T09:45:12,577][WARN ][o.o.m.j.JvmGcMonitorService] [opensearch-node2] [gc][52] overhead, spent [950ms] collecting in the last [1.5s]
opensearch-node2 | [2021-12-17T09:45:12,606][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:12,620][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:12,639][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:12,652][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:12Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:45:16,731][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:16,970][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:16,991][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:16,997][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:17Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node2 | [2021-12-17T09:45:18,249][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:18,265][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:18,276][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:18,312][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:18Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:45:19,517][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node1] Doc with id 'audit' and version 2 is updated in .opendistro_security index.
opensearch-node2 | [2021-12-17T09:45:19,580][INFO ][o.o.s.s.ConfigHelper ] [opensearch-node2] Index .opendistro_security already contains doc with id audit, skipping update.
opensearch-node2 | [2021-12-17T09:45:20,768][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:20,807][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-node2 | [2021-12-17T09:45:20,838][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node2] Not yet initialized (you may need to run securityadmin)
opensearch-node1 | [2021-12-17T09:45:20,942][ERROR][o.o.s.a.BackendRegistry ] [opensearch-node1] Not yet initialized (you may need to run securityadmin)
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:20Z","tags":["error","opensearch","data"],"pid":1,"message":"[ResponseError]: Response Error"}
opensearch-node1 | [2021-12-17T09:45:21,274][INFO ][stdout ] [opensearch-node1] [FINE] No subscribers registered for event class org.opensearch.security.securityconf.DynamicConfigFactory$NodesDnModelImpl
opensearch-node1 | [2021-12-17T09:45:21,275][INFO ][stdout ] [opensearch-node1] [FINE] No subscribers registered for event class org.greenrobot.eventbus.NoSubscriberEvent
opensearch-node1 | [2021-12-17T09:45:21,276][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing on REST API is enabled.
opensearch-node1 | [2021-12-17T09:45:21,277][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from REST API auditing.
opensearch-node1 | [2021-12-17T09:45:21,277][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing on Transport API is enabled.
opensearch-node1 | [2021-12-17T09:45:21,277][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from Transport API auditing.
opensearch-node1 | [2021-12-17T09:45:21,277][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing of request body is enabled.
opensearch-node1 | [2021-12-17T09:45:21,279][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Bulk requests resolution is disabled during request auditing.
opensearch-node1 | [2021-12-17T09:45:21,280][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Index resolution is enabled during request auditing.
opensearch-node1 | [2021-12-17T09:45:21,280][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Sensitive headers auditing is enabled.
opensearch-node1 | [2021-12-17T09:45:21,280][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing requests from kibanaserver users is disabled.
opensearch-node1 | [2021-12-17T09:45:21,292][WARN ][o.o.s.a.r.AuditMessageRouter] [opensearch-node1] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
opensearch-node1 | [2021-12-17T09:45:21,293][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing of external configuration is disabled.
opensearch-node1 | [2021-12-17T09:45:21,293][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing of internal configuration is enabled.
opensearch-node1 | [2021-12-17T09:45:21,293][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing only metadata information for read request is enabled.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing will watch {} for read requests.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing read operation requests from kibanaserver users is disabled.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing only metadata information for write request is enabled.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing diffs for write requests is disabled.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing write operation requests from kibanaserver users is disabled.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Auditing will watch <NONE> for write requests.
opensearch-node1 | [2021-12-17T09:45:21,294][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] .opendistro_security is used as internal security index.
opensearch-node1 | [2021-12-17T09:45:21,295][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node1] Internal index used for posting audit logs is null
opensearch-node1 | [2021-12-17T09:45:21,299][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node1] Hot-reloading of audit configuration is enabled
opensearch-node1 | [2021-12-17T09:45:21,299][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node1] Node 'opensearch-node1' initialized
opensearch-node2 | [2021-12-17T09:45:21,545][INFO ][stdout ] [opensearch-node2] [FINE] No subscribers registered for event class org.opensearch.security.securityconf.DynamicConfigFactory$NodesDnModelImpl
opensearch-node2 | [2021-12-17T09:45:21,547][INFO ][stdout ] [opensearch-node2] [FINE] No subscribers registered for event class org.greenrobot.eventbus.NoSubscriberEvent
opensearch-node2 | [2021-12-17T09:45:21,548][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing on REST API is enabled.
opensearch-node2 | [2021-12-17T09:45:21,549][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from REST API auditing.
opensearch-node2 | [2021-12-17T09:45:21,549][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing on Transport API is enabled.
opensearch-node2 | [2021-12-17T09:45:21,550][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from Transport API auditing.
opensearch-node2 | [2021-12-17T09:45:21,550][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing of request body is enabled.
opensearch-node2 | [2021-12-17T09:45:21,551][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Bulk requests resolution is disabled during request auditing.
opensearch-node2 | [2021-12-17T09:45:21,552][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Index resolution is enabled during request auditing.
opensearch-node2 | [2021-12-17T09:45:21,553][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Sensitive headers auditing is enabled.
opensearch-node2 | [2021-12-17T09:45:21,554][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing requests from kibanaserver users is disabled.
opensearch-node2 | [2021-12-17T09:45:21,570][WARN ][o.o.s.a.r.AuditMessageRouter] [opensearch-node2] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
opensearch-node2 | [2021-12-17T09:45:21,571][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing of external configuration is disabled.
opensearch-node2 | [2021-12-17T09:45:21,572][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing of internal configuration is enabled.
opensearch-node2 | [2021-12-17T09:45:21,573][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing only metadata information for read request is enabled.
opensearch-node2 | [2021-12-17T09:45:21,575][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing will watch {} for read requests.
opensearch-node2 | [2021-12-17T09:45:21,576][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing read operation requests from kibanaserver users is disabled.
opensearch-node2 | [2021-12-17T09:45:21,576][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing only metadata information for write request is enabled.
opensearch-node2 | [2021-12-17T09:45:21,577][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing diffs for write requests is disabled.
opensearch-node2 | [2021-12-17T09:45:21,577][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing write operation requests from kibanaserver users is disabled.
opensearch-node2 | [2021-12-17T09:45:21,578][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Auditing will watch <NONE> for write requests.
opensearch-node2 | [2021-12-17T09:45:21,579][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] .opendistro_security is used as internal security index.
opensearch-node2 | [2021-12-17T09:45:21,580][INFO ][o.o.s.a.i.AuditLogImpl ] [opensearch-node2] Internal index used for posting audit logs is null
opensearch-node2 | [2021-12-17T09:45:21,583][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node2] Hot-reloading of audit configuration is enabled
opensearch-node2 | [2021-12-17T09:45:21,584][INFO ][o.o.s.c.ConfigurationRepository] [opensearch-node2] Node 'opensearch-node2' initialized
opensearch-node1 | [2021-12-17T09:45:24,776][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch-node1] Performing move cluster state metadata.
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:28Z","tags":["info","savedobjects-service"],"pid":1,"message":"Starting saved objects migrations"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:31Z","tags":["info","savedobjects-service"],"pid":1,"message":"Creating index .kibana_1."}
opensearch-node2 | [2021-12-17T09:45:31,200][INFO ][o.o.m.j.JvmGcMonitorService] [opensearch-node2] [gc][68] overhead, spent [341ms] collecting in the last [1s]
opensearch-node1 | [2021-12-17T09:45:33,384][DEPRECATION][o.o.d.c.m.MetadataCreateIndexService] [opensearch-node1] index name [.kibana_1] starts with a dot '.', in the next major version, index names starting with a dot are reserved for hidden indices and system indices
opensearch-node1 | [2021-12-17T09:45:33,994][INFO ][o.o.c.m.MetadataCreateIndexService] [opensearch-node1] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:35Z","tags":["info","savedobjects-service"],"pid":1,"message":"Pointing alias .kibana to .kibana_1."}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:36Z","tags":["info","savedobjects-service"],"pid":1,"message":"Finished in 6118ms."}
opensearch-node1 | [2021-12-17T09:45:37,241][INFO ][o.o.c.r.a.AllocationService] [opensearch-node1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.kibana_1][0]]]).
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:38Z","tags":["info","plugins-system"],"pid":1,"message":"Starting [44] plugins: [alertingDashboards,usageCollection,opensearchDashboardsUsageCollection,opensearchDashboardsLegacy,mapsLegacy,share,opensearchUiShared,legacyExport,embeddable,expressions,data,home,console,apmOss,management,indexPatternManagement,advancedSettings,savedObjects,securityDashboards,reportsDashboards,indexManagementDashboards,anomalyDetectionDashboards,dashboard,visualizations,visTypeVega,visTypeTimeline,timeline,visTypeTable,visTypeMarkdown,tileMap,regionMap,inputControlVis,ganttChartDashboards,visualize,queryWorkbenchDashboards,charts,visTypeVislib,visTypeTagcloud,visTypeTimeseries,visTypeMetric,observabilityDashboards,discover,savedObjectsManagement,bfetch]"}
opensearch-node1 | [2021-12-17T09:45:57,424][INFO ][o.o.c.m.MetadataIndexTemplateService] [opensearch-node1] adding template [tenant_template] for index patterns [.kibana_-*_*, .kibana_0*_*, .kibana_1*_*, .kibana_2*_*, .kibana_3*_*, .kibana_4*_*, .kibana_5*_*, .kibana_6*_*, .kibana_7*_*, .kibana_8*_*, .kibana_9*_*]
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:45:58Z","tags":["listening","info"],"pid":1,"message":"Server running at http://0:5601"}
opensearch-dashboards | {"type":"log","@timestamp":"2021-12-17T09:46:04Z","tags":["info","http","server","OpenSearchDashboards"],"pid":1,"message":"http server running at http://0:5601"}
opensearch-node2 | Killing performance analyzer process 104
opensearch-node2 | OpenSearch exited with code 137
opensearch-node2 | Performance analyzer exited with code 143
opensearch-node2 | ./opensearch-docker-entrypoint.sh: line 108: 103 Killed $OPENSEARCH_HOME/bin/opensearch "${opensearch_opts[@]}"
opensearch-node1 | [2021-12-17T09:46:24,768][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch-node1] Performing move cluster state metadata.
opensearch-node1 | [2021-12-17T09:46:25,053][INFO ][o.o.c.r.a.AllocationService] [opensearch-node1] updating number_of_replicas to [0] for indices [.kibana_1, .opendistro_security]
opensearch-node1 | [2021-12-17T09:46:25,973][INFO ][o.o.c.r.a.AllocationService] [opensearch-node1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} reason: disconnected]).
opensearch-node1 | [2021-12-17T09:46:25,997][INFO ][o.o.c.s.MasterService ] [opensearch-node1] node-left[{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} reason: disconnected], term: 2, version: 23, delta: removed {{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}}
opensearch-node1 | [2021-12-17T09:46:26,001][ERROR][o.o.s.s.t.SecuritySSLNettyTransport] [opensearch-node1] Exception during establishing a SSL connection: java.net.SocketException: Connection reset
opensearch-node1 | java.net.SocketException: Connection reset
opensearch-node1 | at sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:367) ~[?:?]
opensearch-node1 | at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:398) ~[?:?]
opensearch-node1 | at org.opensearch.transport.CopyBytesSocketChannel.readFromSocketChannel(CopyBytesSocketChannel.java:155) ~[transport-netty4-client-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.transport.CopyBytesSocketChannel.doReadBytes(CopyBytesSocketChannel.java:140) ~[transport-netty4-client-1.2.2.jar:1.2.2]
opensearch-node1 | at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:151) [netty-transport-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719) [netty-transport-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:620) [netty-transport-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:583) [netty-transport-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [netty-common-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.69.Final.jar:4.1.69.Final]
opensearch-node1 | at java.lang.Thread.run(Thread.java:832) [?:?]
opensearch-node1 | [2021-12-17T09:46:26,588][WARN ][o.o.c.NodeConnectionsService] [opensearch-node1] failed to connect to {opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} (tried [1] times)
opensearch-node1 | org.opensearch.transport.ConnectTransportException: [opensearch-node2][172.25.0.2:9300] connect_exception
opensearch-node1 | at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1064) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:213) ~[opensearch-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:55) ~[opensearch-core-1.2.2.jar:1.2.2]
opensearch-node1 | at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) ~[?:?]
opensearch-node1 | at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) ~[?:?]
opensearch-node1 | at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) ~[?:?]
opensearch-node1 | at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2152) ~[?:?]
opensearch-node1 | at org.opensearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:70) ~[opensearch-core-1.2.2.jar:1.2.2]
opensearch-node1 | at org.opensearch.transport.netty4.Netty4TcpChannel.lambda$addListener$0(Netty4TcpChannel.java:81) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:707) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:620) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:583) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
opensearch-node1 | at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) ~[?:?]
opensearch-node1 | at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
opensearch-node1 | at java.lang.Thread.run(Thread.java:832) [?:?]
opensearch-node1 | Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: 172.25.0.2/172.25.0.2:9300
opensearch-node1 | Caused by: java.net.ConnectException: Connection refused
opensearch-node1 | at sun.nio.ch.Net.pollConnect(Native Method) ~[?:?]
opensearch-node1 | at sun.nio.ch.Net.pollConnectNow(Net.java:660) ~[?:?]
opensearch-node1 | at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:875) ~[?:?]
opensearch-node1 | at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330) ~[?:?]
opensearch-node1 | at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) ~[?:?]
opensearch-node1 | ... 7 more
opensearch-node1 | [2021-12-17T09:46:26,743][INFO ][o.o.c.s.ClusterApplierService] [opensearch-node1] removed {{opensearch-node2}{R-sEvVs8RQCCYNfE0tKF5A}{9CZnDaTrQW6jdZpkk9hN8Q}{172.25.0.2}{172.25.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}}, term: 2, version: 23, reason: Publication{term=2, version=23}
opensearch-node2 exited with code 0
opensearch-node1 | [2021-12-17T09:46:26,878][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node1] Cluster node changed, node removed: true, node added: false
opensearch-node1 | [2021-12-17T09:46:26,890][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Node removed: [R-sEvVs8RQCCYNfE0tKF5A]
opensearch-node1 | [2021-12-17T09:46:26,896][INFO ][o.o.a.c.HashRing ] [opensearch-node1] Remove data node from AD version hash ring: R-sEvVs8RQCCYNfE0tKF5A
opensearch-node1 | [2021-12-17T09:46:26,897][INFO ][o.o.a.c.ADClusterEventListener] [opensearch-node1] Hash ring build result: true
opensearch-node1 | [2021-12-17T09:46:27,065][INFO ][o.o.i.s.IndexShard ] [opensearch-node1] [.opendistro_security][0] primary-replica resync completed with 0 operations
opensearch-node1 | [2021-12-17T09:46:27,070][INFO ][o.o.i.s.IndexShard ] [opensearch-node1] [.kibana_1][0] primary-replica resync completed with 0 operations
opensearch-node1 | [2021-12-17T09:46:27,106][INFO ][o.o.c.m.MetadataCreateIndexService] [opensearch-node1] [security-auditlog-2021.12.17] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
opensearch-node1 | [2021-12-17T09:46:27,496][INFO ][o.o.c.m.MetadataMappingService] [opensearch-node1] [security-auditlog-2021.12.17/pEYK4gqmT6uwqg9qe8IeMQ] create_mapping [_doc]
opensearch-node1 | [2021-12-17T09:46:35,562][WARN ][o.o.c.r.a.AllocationService] [opensearch-node1] [.kibana_1][0] marking unavailable shards as stale: [oHvIve7bSB-OVxkVmNcUwQ]
opensearch-node1 | [2021-12-17T09:46:44,163][WARN ][o.o.c.r.a.AllocationService] [opensearch-node1] [.opendistro_security][0] marking unavailable shards as stale: [u-b10_slTXCQu44xj6uj7w]
opensearch-node1 | [2021-12-17T09:47:24,692][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch-node1] Performing move cluster state metadata.
opensearch-node1 | [2021-12-17T09:48:24,623][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch-node1] Performing move cluster state metadata.
opensearch-node1 | [2021-12-17T09:48:24,625][INFO ][o.o.i.i.MetadataService ] [opensearch-node1] Move Metadata succeed, set finish flag to true. Indices failed to get indexed: {}
opensearch-node1 | [2021-12-17T09:49:16,918][INFO ][o.o.j.s.JobSweeper ] [opensearch-node1] Running full sweep
opensearch-node1 | [2021-12-17T09:49:24,597][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch-node1] Cancel background move metadata process.
opensearch-node1 | [2021-12-17T09:49:24,597][INFO ][o.o.i.i.ManagedIndexCoordinator] [opensearch-node1] Performing move cluster state metadata.
opensearch-node1 | [2021-12-17T09:49:24,598][INFO ][o.o.i.i.MetadataService ] [opensearch-node1] Move metadata has finished.
Gracefully stopping... (press Ctrl+C again to force)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment