Skip to content

Instantly share code, notes, and snippets.

@theherodied
Created January 11, 2021 18:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save theherodied/f7722b7e8ef1a359b11b2d3ce792e402 to your computer and use it in GitHub Desktop.
Save theherodied/f7722b7e8ef1a359b11b2d3ce792e402 to your computer and use it in GitHub Desktop.
graylog_upgrade_error
################################################################################
2021-01-11T12:27:30.600-05:00 INFO [CmdLineTool] Loaded plugin: Csv function 0.0.4 [com.alexjck.plugins.csv.CsvFunctionPlugin]
2021-01-11T12:27:30.603-05:00 INFO [CmdLineTool] Loaded plugin: MongoDB profiler input 2.0.1 [com.graylog2.inputs.mongoprofiler.plugin.MongoDBProfilerInputPlugin]
2021-01-11T12:27:30.604-05:00 INFO [CmdLineTool] Loaded plugin: AWS plugins 4.0.1 [org.graylog.aws.AWSPlugin]
2021-01-11T12:27:30.605-05:00 INFO [CmdLineTool] Loaded plugin: Enterprise Integrations 4.0.1 [org.graylog.enterprise.integrations.EnterpriseIntegrationsPlugin]
2021-01-11T12:27:30.605-05:00 INFO [CmdLineTool] Loaded plugin: Integrations 4.0.1 [org.graylog.integrations.IntegrationsPlugin]
2021-01-11T12:27:30.606-05:00 INFO [CmdLineTool] Loaded plugin: Collector 4.0.1 [org.graylog.plugins.collector.CollectorPlugin]
2021-01-11T12:27:30.607-05:00 INFO [CmdLineTool] Loaded plugin: Graylog Enterprise 4.0.1 [org.graylog.plugins.enterprise.EnterprisePlugin]
2021-01-11T12:27:30.608-05:00 INFO [CmdLineTool] Loaded plugin: Threat Intelligence Plugin 4.0.1 [org.graylog.plugins.threatintel.ThreatIntelPlugin]
2021-01-11T12:27:30.611-05:00 INFO [CmdLineTool] Loaded plugin: SnmpPlugin 0.3.0 [org.graylog.snmp.SnmpPlugin]
2021-01-11T12:27:30.611-05:00 INFO [CmdLineTool] Loaded plugin: Elasticsearch 6 Support 4.0.1+6a0cc0b [org.graylog.storage.elasticsearch6.Elasticsearch6Plugin]
2021-01-11T12:27:30.612-05:00 INFO [CmdLineTool] Loaded plugin: Elasticsearch 7 Support 4.0.1+6a0cc0b [org.graylog.storage.elasticsearch7.Elasticsearch7Plugin]
2021-01-11T12:27:30.834-05:00 INFO [CmdLineTool] Running with JVM arguments: -Xms2g -Xmx2g -XX:NewRatio=1 -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -XX:+UseParNewGC -Dlog4j.configurationFile=file:///etc/graylog/server/log4j2.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar -Dgraylog2.installation_source=rpm
2021-01-11T12:27:31.047-05:00 INFO [Version] HV000001: Hibernate Validator null
2021-01-11T12:27:33.985-05:00 INFO [InputBufferImpl] Message journal is enabled.
2021-01-11T12:27:34.005-05:00 INFO [NodeId] Node ID: b785a71e-096c-42ae-9a0c-91c6ebe9cbbf
2021-01-11T12:27:34.195-05:00 INFO [LogManager] Loading logs.
2021-01-11T12:27:34.218-05:00 WARN [Log] Found a corrupted index file, /var/lib/graylog-server/journal/messagejournal-0/00000000009318530297.index, deleting and rebuilding index...
2021-01-11T12:27:34.457-05:00 INFO [LogManager] Logs loading complete.
2021-01-11T12:27:34.461-05:00 INFO [KafkaJournal] Initialized Kafka based journal at /var/lib/graylog-server/journal
2021-01-11T12:27:34.484-05:00 INFO [cluster] Cluster created with settings {hosts=[log1.company.com:27017, log2.company.com:27017, log3.company.com:27017], mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=5000}
2021-01-11T12:27:34.484-05:00 INFO [cluster] Adding discovered server log1.company.com:27017 to client view of cluster
2021-01-11T12:27:34.509-05:00 INFO [cluster] Adding discovered server log2.company.com:27017 to client view of cluster
2021-01-11T12:27:34.510-05:00 INFO [cluster] Adding discovered server log3.company.com:27017 to client view of cluster
2021-01-11T12:27:34.530-05:00 INFO [cluster] Cluster description not yet available. Waiting for 30000 ms before timing out
2021-01-11T12:27:34.558-05:00 INFO [connection] Opened connection [connectionId{localValue:1, serverValue:13}] to log3.company.com:27017
2021-01-11T12:27:34.558-05:00 INFO [connection] Opened connection [connectionId{localValue:3, serverValue:13}] to log2.company.com:27017
2021-01-11T12:27:34.558-05:00 INFO [connection] Opened connection [connectionId{localValue:2, serverValue:49}] to log1.company.com:27017
2021-01-11T12:27:34.568-05:00 INFO [cluster] Monitor thread successfully connected to server with description ServerDescription{address=log1.company.com:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 21]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=3415276, setName='rs01', canonicalAddress=log1.company.com:27017, hosts=[log2.company.com:27017, log3.company.com:27017, log1.company.com:27017], passives=[], arbiters=[], primary='log1.company.com:27017', tagSet=TagSet{[]}, electionId=7fffffff00000000000000c7, setVersion=3, lastWriteDate=Mon Jan 11 12:27:28 EST 2021, lastUpdateTimeNanos=543545420198}
2021-01-11T12:27:34.568-05:00 INFO [cluster] Monitor thread successfully connected to server with description ServerDescription{address=log2.company.com:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 21]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=6354794, setName='rs01', canonicalAddress=log2.company.com:27017, hosts=[log2.company.com:27017, log3.company.com:27017, log1.company.com:27017], passives=[], arbiters=[], primary='log1.company.com:27017', tagSet=TagSet{[]}, electionId=null, setVersion=3, lastWriteDate=Mon Jan 11 12:27:28 EST 2021, lastUpdateTimeNanos=543547404903}
2021-01-11T12:27:34.570-05:00 INFO [cluster] Monitor thread successfully connected to server with description ServerDescription{address=log3.company.com:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 21]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=6397299, setName='rs01', canonicalAddress=log3.company.com:27017, hosts=[log2.company.com:27017, log3.company.com:27017, log1.company.com:27017], passives=[], arbiters=[], primary='log1.company.com:27017', tagSet=TagSet{[]}, electionId=null, setVersion=3, lastWriteDate=Mon Jan 11 12:27:28 EST 2021, lastUpdateTimeNanos=543547420375}
2021-01-11T12:27:34.570-05:00 INFO [cluster] Discovered cluster type of REPLICA_SET
2021-01-11T12:27:34.571-05:00 INFO [cluster] Setting max election id to 7fffffff00000000000000c7 from replica set primary log1.company.com:27017
2021-01-11T12:27:34.571-05:00 INFO [cluster] Setting max set version to 3 from replica set primary log1.company.com:27017
2021-01-11T12:27:34.571-05:00 INFO [cluster] Discovered replica set primary log1.company.com:27017
2021-01-11T12:27:34.666-05:00 INFO [connection] Opened connection [connectionId{localValue:4, serverValue:50}] to log1.company.com:27017
2021-01-11T12:27:34.866-05:00 INFO [InputBufferImpl] Initialized InputBufferImpl with ring size <65536> and wait strategy <BlockingWaitStrategy>, running 2 parallel message handlers.
2021-01-11T12:27:35.112-05:00 INFO [ElasticsearchVersionProvider] Elasticsearch cluster is running v6.8.13
2021-01-11T12:27:35.152-05:00 INFO [AbstractJestClient] Setting server pool to a list of 5 servers: [http://elastic1:9200,http://elastic2:9200,http://elastic3:9200,http://elastic4:9200,http://elastic5:9200]
2021-01-11T12:27:35.153-05:00 INFO [JestClientFactory] Using multi thread/connection supporting pooling connection manager
2021-01-11T12:27:35.217-05:00 INFO [JestClientFactory] Using custom ObjectMapper instance
2021-01-11T12:27:35.218-05:00 INFO [JestClientFactory] Node Discovery enabled...
2021-01-11T12:27:35.230-05:00 INFO [JestClientFactory] Idle connection reaping disabled...
2021-01-11T12:27:35.296-05:00 INFO [AbstractJestClient] Setting server pool to a list of 5 servers: [http://10.100.1.154:9200,http://10.100.1.155:9200,http://10.100.1.157:9200,http://10.100.1.163:9200,http://10.100.1.162:9200]
2021-01-11T12:27:35.731-05:00 INFO [ProcessBuffer] Initialized ProcessBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2021-01-11T12:27:36.266-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:36.274-05:00 INFO [connection] Opened connection [connectionId{localValue:5, serverValue:51}] to log1.company.com:27017
2021-01-11T12:27:36.286-05:00 INFO [OutputBuffer] Initialized OutputBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2021-01-11T12:27:36.389-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:36.489-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:36.630-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:36.707-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:36.774-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:36.844-05:00 WARN [GeoIpResolverEngine] GeoIP database file does not exist: /etc/graylog/server/GeoLite2-City.mmdb
2021-01-11T12:27:37.661-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.661-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.661-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.661-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.661-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.662-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.663-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.663-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.663-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.664-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.664-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.664-05:00 ERROR [CmdLineTool] Guice error (more detail on log level debug): Error injecting constructor, com.mongodb.DuplicateKeyException: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
2021-01-11T12:27:37.665-05:00 ERROR [Server]
################################################################################
ERROR: Unable to connect to MongoDB. Is it running and the configuration correct?
Details: Write failed with error code 11000 and error message 'E11000 duplicate key error collection: graylog.teams index: name_1_auth_service_id_1 dup key: { : null, : null }'
Need further help?
* Official documentation: http://docs.graylog.org/
* Community support: https://www.graylog.org/community-support/
* Commercial support: https://www.graylog.com/technical-support/
Terminating. :(
################################################################################
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment