Skip to content

Instantly share code, notes, and snippets.

@mfournier
Created April 22, 2016 14:06
Show Gist options
  • Save mfournier/303c6de4140cc67ab8096ac077b9ca89 to your computer and use it in GitHub Desktop.
Save mfournier/303c6de4140cc67ab8096ac077b9ca89 to your computer and use it in GitHub Desktop.
time="2016-04-22T13:48:08Z" level=info msg="Loading configuration file /etc/prometheus-confd/prometheus.yml" source="main.go:202"
time="2016-04-22T13:48:08Z" level=info msg="Loading series map and head chunks..." source="storage.go:318"
time="2016-04-22T13:48:09Z" level=warning msg="Persistence layer appears dirty." source="persistence.go:702"
time="2016-04-22T13:48:09Z" level=warning msg="Starting crash recovery. Prometheus is inoperational until complete." source="crashrecovery.go:39"
time="2016-04-22T13:48:09Z" level=warning msg="To avoid crash recovery in the future, shut down Prometheus with SIGTERM or a HTTP POST to /-/quit." source="crashrecovery.go:40"
time="2016-04-22T13:48:09Z" level=info msg="Scanning files." source="crashrecovery.go:54"
time="2016-04-22T13:48:09Z" level=info msg="10000 files scanned." source="crashrecovery.go:76"
time="2016-04-22T13:48:10Z" level=info msg="20000 files scanned." source="crashrecovery.go:76"
time="2016-04-22T13:48:10Z" level=info msg="File scan complete. 25756 series found." source="crashrecovery.go:81"
time="2016-04-22T13:48:10Z" level=info msg="Checking for series without series file." source="crashrecovery.go:83"
time="2016-04-22T13:48:10Z" level=info msg="Check for series without series file complete." source="crashrecovery.go:128"
time="2016-04-22T13:48:10Z" level=info msg="Cleaning up archive indexes." source="crashrecovery.go:396"
time="2016-04-22T13:48:10Z" level=info msg="10000 archived metrics checked." source="crashrecovery.go:403"
time="2016-04-22T13:48:11Z" level=info msg="10000 archived time ranges checked." source="crashrecovery.go:463"
time="2016-04-22T13:48:11Z" level=info msg="Clean-up of archive indexes complete." source="crashrecovery.go:487"
time="2016-04-22T13:48:11Z" level=info msg="Rebuilding label indexes." source="crashrecovery.go:495"
time="2016-04-22T13:48:11Z" level=info msg="Indexing metrics in memory." source="crashrecovery.go:496"
time="2016-04-22T13:48:11Z" level=info msg="Indexing archived metrics." source="crashrecovery.go:504"
time="2016-04-22T13:48:11Z" level=info msg="10000 metrics queued for indexing." source="crashrecovery.go:517"
time="2016-04-22T13:48:11Z" level=info msg="20000 metrics queued for indexing." source="crashrecovery.go:517"
time="2016-04-22T13:48:12Z" level=info msg="All requests for rebuilding the label indexes queued. (Actual processing may lag behind.)" source="crashrecovery.go:523"
time="2016-04-22T13:48:12Z" level=warning msg="Crash recovery complete." source="crashrecovery.go:150"
time="2016-04-22T13:48:12Z" level=info msg="9961 series loaded." source="storage.go:323"
time="2016-04-22T13:48:12Z" level=warning msg="No AlertManager configured, not dispatching any alerts" source="notifier.go:165"
time="2016-04-22T13:48:12Z" level=info msg="Starting target manager..." source="targetmanager.go:74"
time="2016-04-22T13:48:12Z" level=error msg="Error creating file watcher: too many open files" source="file.go:96"
time="2016-04-22T13:48:12Z" level=debug msg="Stopping file discovery for [/etc/prometheus-confd/prometheus-targets.yml]..." source="file.go:149"
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x38 pc=0x9e9e18]
goroutine 168 [running]:
github.com/prometheus/prometheus/vendor/gopkg.in/fsnotify%2ev1.(*Watcher).isClosed(0x0, 0xc82ca41ce0)
/gopath/src/github.com/prometheus/prometheus/vendor/gopkg.in/fsnotify.v1/inotify.go:64 +0x18
github.com/prometheus/prometheus/vendor/gopkg.in/fsnotify%2ev1.(*Watcher).Close(0x0, 0x0, 0x0)
/gopath/src/github.com/prometheus/prometheus/vendor/gopkg.in/fsnotify.v1/inotify.go:73 +0x31
github.com/prometheus/prometheus/retrieval/discovery.(*FileDiscovery).stop(0xc82ca3f2c0)
/gopath/src/github.com/prometheus/prometheus/retrieval/discovery/file.go:166 +0x19c
github.com/prometheus/prometheus/retrieval/discovery.(*FileDiscovery).Run(0xc82ca3f2c0, 0x7f7e42dc7cb0, 0xc827f4e9c0, 0xc82d236840)
/gopath/src/github.com/prometheus/prometheus/retrieval/discovery/file.go:97 +0x176
created by github.com/prometheus/prometheus/retrieval.(*targetSet).runProviders
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:325 +0x303
goroutine 1 [select]:
main.Main(0x0)
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:182 +0x1b35
main.main()
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:46 +0x18
goroutine 17 [syscall, locked to thread]:
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1721 +0x1
goroutine 9 [select]:
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).logThrottling(0xc8201f06e0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:665 +0x8e1
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).Start
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:333 +0x502
goroutine 35 [syscall]:
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:22 +0x18
created by os/signal.init.1
/usr/local/go/src/os/signal/signal_unix.go:28 +0x37
goroutine 8 [select]:
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).handleQuarantine(0xc8201f06e0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:1402 +0x522
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).Start
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:332 +0x4dd
goroutine 125 [select, locked to thread]:
runtime.gopark(0xfe7a28, 0xc82001e728, 0xe14870, 0x6, 0x434e18, 0x2)
/usr/local/go/src/runtime/proc.go:185 +0x163
runtime.selectgoImpl(0xc82001e728, 0x0, 0x18)
/usr/local/go/src/runtime/select.go:392 +0xa64
runtime.selectgo(0xc82001e728)
/usr/local/go/src/runtime/select.go:212 +0x12
runtime.ensureSigM.func1()
/usr/local/go/src/runtime/signal1_unix.go:227 +0x353
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1721 +0x1
goroutine 124 [select]:
github.com/prometheus/prometheus/rules.(*Group).run(0xc820702320)
/gopath/src/github.com/prometheus/prometheus/rules/manager.go:140 +0x2c6
github.com/prometheus/prometheus/rules.(*Manager).ApplyConfig.func1.1(0xc8202556e0, 0xc820702320)
/gopath/src/github.com/prometheus/prometheus/rules/manager.go:446 +0x48
created by github.com/prometheus/prometheus/rules.(*Manager).ApplyConfig.func1
/gopath/src/github.com/prometheus/prometheus/rules/manager.go:447 +0xa0
goroutine 126 [runnable]:
main.Main.func2(0xc8207042a0, 0xc820704240, 0xc8201ca900, 0xc8207020a0, 0x5, 0x5)
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:126 +0x45
created by main.Main
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:134 +0xf0c
goroutine 128 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc8201d6000)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x29d
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x26b
goroutine 130 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc8201f0420)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:69 +0x54a
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:139 +0x77f
goroutine 131 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc8201f0420)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:82 +0x14b
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x7a1
goroutine 132 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc8201f0420)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:768 +0x7c8
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:146 +0x9a5
goroutine 133 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc8201f0420)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:715 +0x253
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:147 +0x9c7
goroutine 134 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).jWriter(0xc8201f0420)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_write.go:37 +0x1a2
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:148 +0x9e9
goroutine 135 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc8201d6540)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x29d
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x26b
goroutine 136 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc8201f02c0)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:69 +0x54a
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:139 +0x77f
goroutine 137 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc8201f02c0)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:82 +0x14b
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x7a1
goroutine 138 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc8201f02c0)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:768 +0x7c8
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:146 +0x9a5
goroutine 139 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc8201f02c0)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:715 +0x253
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:147 +0x9c7
goroutine 140 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).jWriter(0xc8201f02c0)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_write.go:37 +0x1a2
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:148 +0x9e9
goroutine 141 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc8201d69a0)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x29d
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x26b
goroutine 142 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc8201f0580)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:69 +0x54a
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:139 +0x77f
goroutine 143 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc8201f0580)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:82 +0x14b
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x7a1
goroutine 144 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc8201f0580)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:768 +0x7c8
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:146 +0x9a5
goroutine 145 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc8201f0580)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:715 +0x253
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:147 +0x9c7
goroutine 146 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).jWriter(0xc8201f0580)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_write.go:37 +0x1a2
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:148 +0x9e9
goroutine 147 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc8201d6b60)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x29d
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x26b
goroutine 148 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc8201f0b00)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:69 +0x54a
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:139 +0x77f
goroutine 149 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc8201f0b00)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:82 +0x14b
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x7a1
goroutine 150 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc8201f0b00)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:768 +0x7c8
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:146 +0x9a5
goroutine 151 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc8201f0b00)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:715 +0x253
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:147 +0x9c7
goroutine 152 [select]:
github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).jWriter(0xc8201f0b00)
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db_write.go:37 +0x1a2
created by github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/gopath/src/github.com/prometheus/prometheus/vendor/github.com/syndtr/goleveldb/leveldb/db.go:148 +0x9e9
goroutine 153 [runnable]:
github.com/prometheus/prometheus/storage/local.(*persistence).processIndexingQueue(0xc8203d4a00)
/gopath/src/github.com/prometheus/prometheus/storage/local/persistence.go:1310 +0xb39
github.com/prometheus/prometheus/storage/local.(*persistence).run(0xc8203d4a00)
/gopath/src/github.com/prometheus/prometheus/storage/local/persistence.go:283 +0x21
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).Start
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:308 +0x14c
goroutine 7 [select]:
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).handleEvictList(0xc8201f06e0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:792 +0x539
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).Start
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:331 +0x4b8
goroutine 10 [select]:
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).loop(0xc8201f06e0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:1009 +0x5e4
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).Start
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:334 +0x527
goroutine 15 [select]:
github.com/prometheus/prometheus/notifier.(*Notifier).Run(0xc8201ea180)
/gopath/src/github.com/prometheus/prometheus/notifier/notifier.go:169 +0x5a8
created by main.Main
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:162 +0x12ed
goroutine 166 [runnable]:
github.com/prometheus/prometheus/retrieval.(*TargetManager).reload.func1(0xc8202531f0, 0xc82ccfd8b0)
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:117
created by github.com/prometheus/prometheus/retrieval.(*TargetManager).reload
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:120 +0x20f
goroutine 162 [semacquire]:
sync.runtime_Semacquire(0xc828ca92cc)
/usr/local/go/src/runtime/sema.go:43 +0x26
sync.(*WaitGroup).Wait(0xc828ca92c0)
/usr/local/go/src/sync/waitgroup.go:126 +0xb4
github.com/prometheus/prometheus/retrieval.(*targetSet).runProviders(0xc82ccfd8b0, 0x7f7e42dc7cb0, 0xc827f4e980, 0xc82ca3f290)
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:330 +0x335
github.com/prometheus/prometheus/retrieval.(*TargetManager).reload(0xc8202531f0)
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:124 +0x25e
github.com/prometheus/prometheus/retrieval.(*TargetManager).Run(0xc8202531f0)
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:79 +0x1cf
created by main.Main
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:168 +0x138a
goroutine 163 [runnable]:
github.com/prometheus/prometheus/web.(*Handler).Run(0xc8201ca900)
/gopath/src/github.com/prometheus/prometheus/web/web.go:238
created by main.Main
/gopath/src/github.com/prometheus/prometheus/cmd/prometheus/main.go:175 +0x1405
goroutine 164 [runnable]:
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).cycleThroughMemoryFingerprints.func1(0xc82d236420, 0xc8201f06e0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:909
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).cycleThroughMemoryFingerprints
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:946 +0x5d
goroutine 165 [select]:
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).waitForNextFP(0xc8201f06e0, 0x0, 0x3ff0000000000000, 0x0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:896 +0x19a
github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).cycleThroughArchivedFingerprints.func1(0xc82d236480, 0xc8201f06e0)
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:969 +0x2bf
created by github.com/prometheus/prometheus/storage/local.(*memorySeriesStorage).cycleThroughArchivedFingerprints
/gopath/src/github.com/prometheus/prometheus/storage/local/storage.go:989 +0x5d
goroutine 167 [runnable]:
github.com/prometheus/prometheus/retrieval.(*targetSet).runProviders.func1(0xc828ca92b0, 0xc82d236840, 0xc82ccfd8b0, 0xc828ca92c0, 0xc828ca92a0, 0x6, 0x7f7e41a71660, 0xc82ca3f2c0)
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:280
created by github.com/prometheus/prometheus/retrieval.(*targetSet).runProviders
/gopath/src/github.com/prometheus/prometheus/retrieval/targetmanager.go:323 +0x2b7
goroutine 169 [runnable]:
github.com/prometheus/prometheus/retrieval/discovery.(*FileDiscovery).stop.func1(0xc82ca3f2c0, 0xc82d2368a0)
/gopath/src/github.com/prometheus/prometheus/retrieval/discovery/file.go:155
created by github.com/prometheus/prometheus/retrieval/discovery.(*FileDiscovery).stop
/gopath/src/github.com/prometheus/prometheus/retrieval/discovery/file.go:165 +0x187
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment