Skip to content

Instantly share code, notes, and snippets.

@jstangroome
Last active March 30, 2016 03:22
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jstangroome/a1a70306cbd7a9420be15ec2bbe109a0 to your computer and use it in GitHub Desktop.
Save jstangroome/a1a70306cbd7a9420be15ec2bbe109a0 to your computer and use it in GitHub Desktop.
Filebeat 1.1.2 does not persist correct inode for rotated logs on exit
+ trap 'echo Exited with $?' EXIT
+ filebeat --version
+ grep --fixed-strings 1.1.2
filebeat version 1.1.2 (amd64)
+ sleep_duration_seconds=10
++ dirname /vagrant/filebeat-issue-repro.sh
+ conf_file=/vagrant/filebeat-issue-repro.yml
+ mkdir --parents /tmp/filebeat-issue-repro/
+ cd /tmp/filebeat-issue-repro/
+ rm --force ./input ./input.1 ./registry ./shipped
+ echo entry1
+ test -a ./shipped
+ filebeat_pid=3550084
+ sleep 10
+ filebeat -e -c /vagrant/filebeat-issue-repro.yml
2016/03/30 03:20:07.399391 beat.go:135: DBG Initializing output plugins
2016/03/30 03:20:07.399877 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths
2016/03/30 03:20:07.400125 file.go:39: INFO File output base filename set to: shipped
2016/03/30 03:20:07.400336 file.go:50: INFO Rotate every bytes set to: 10485760
2016/03/30 03:20:07.400579 file.go:57: INFO Number of files set to: 7
2016/03/30 03:20:07.400828 outputs.go:119: INFO Activated file as output plugin.
2016/03/30 03:20:07.401099 publish.go:232: DBG Create output worker
2016/03/30 03:20:07.401375 publish.go:274: DBG No output is defined to store the topology. The server fields might not be filled.
2016/03/30 03:20:07.401701 publish.go:288: INFO Publisher name: section-delivery
2016/03/30 03:20:07.402408 async.go:78: INFO Flush Interval set to: -1ms
2016/03/30 03:20:07.402647 async.go:84: INFO Max Bulk Size set to: -1
2016/03/30 03:20:07.402893 beat.go:147: INFO Init Beat: filebeat; Version: 1.1.2
2016/03/30 03:20:07.404053 beat.go:173: INFO filebeat sucessfully setup. Start running.
2016/03/30 03:20:07.404079 registrar.go:66: INFO Registry file set to: /tmp/filebeat-issue-repro/registry
2016/03/30 03:20:07.404100 spooler.go:44: DBG Set idleTimeoutDuration to 5s
2016/03/30 03:20:07.404102 crawler.go:38: DBG File Configs: [/tmp/filebeat-issue-repro/input*]
2016/03/30 03:20:07.404147 prospector.go:127: INFO Set ignore_older duration to 24h0m0s
2016/03/30 03:20:07.404156 prospector.go:127: INFO Set scan_frequency duration to 1s
2016/03/30 03:20:07.404164 prospector.go:84: INFO Invalid input type set:
2016/03/30 03:20:07.404170 prospector.go:87: INFO Input type set to: log
2016/03/30 03:20:07.404176 prospector.go:127: INFO Set backoff duration to 1s
2016/03/30 03:20:07.404183 prospector.go:127: INFO Set max_backoff duration to 1s
2016/03/30 03:20:07.404190 prospector.go:107: INFO force_close_file is disabled
2016/03/30 03:20:07.404201 crawler.go:58: DBG Waiting for 1 prospectors to initialise
2016/03/30 03:20:07.404233 prospector.go:137: INFO Starting prospector of type: log
2016/03/30 03:20:07.404258 prospector.go:155: DBG exclude_files: []
2016/03/30 03:20:07.404265 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:07.404310 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.404324 prospector.go:315: DBG Start harvesting unknown file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.404341 prospector.go:362: DBG Launching harvester on new file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.404360 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:07.404392 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.404402 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.404409 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.405082 spooler.go:77: INFO Starting spooler: spool_size: 2048; idle_timeout: 5s
2016/03/30 03:20:07.405586 log.go:282: DBG harvest: "/tmp/filebeat-issue-repro/input" (offset snapshot:0)
2016/03/30 03:20:07.406002 log.go:113: INFO Harvester started for file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:07.406388 util.go:20: DBG full line read
2016/03/30 03:20:07.406788 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:07.405617 crawler.go:65: DBG No pending prospectors. Finishing setup
2016/03/30 03:20:07.407434 crawler.go:78: INFO All prospectors initialised with 0 states to persist
2016/03/30 03:20:07.407697 registrar.go:83: INFO Starting Registrar
2016/03/30 03:20:07.407970 publish.go:88: INFO Start sending events to output
2016/03/30 03:20:08.404737 prospector.go:179: DBG Start next scan
2016/03/30 03:20:08.404957 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:08.405197 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:08.407125 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:08.407999 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:08.407798 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:09.409027 prospector.go:179: DBG Start next scan
2016/03/30 03:20:09.411421 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:09.412660 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:09.413273 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:09.414399 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:09.411293 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:09.905334 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 1
2016/03/30 03:20:09.905840 publish.go:109: DBG Publish: {
"@timestamp": "2016-03-30T03:20:07.406Z",
"beat": {
"hostname": "section-delivery",
"name": "section-delivery"
},
"count": 1,
"fields": null,
"input_type": "log",
"message": "entry1",
"offset": 0,
"source": "/tmp/filebeat-issue-repro/input",
"type": "log"
}
2016/03/30 03:20:09.906368 output.go:87: DBG output worker: publish 1 events
2016/03/30 03:20:09.915025 publish.go:104: INFO Events sent: 1
2016/03/30 03:20:09.917155 registrar.go:111: DBG Processing 1 events
2016/03/30 03:20:09.918147 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry
2016/03/30 03:20:09.919301 registrar.go:157: INFO Registry file updated. 1 states written.
2016/03/30 03:20:10.415052 prospector.go:179: DBG Start next scan
2016/03/30 03:20:10.415373 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:10.417721 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:10.415658 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:10.417809 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:10.417836 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:11.417999 prospector.go:179: DBG Start next scan
2016/03/30 03:20:11.418036 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:11.418160 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:11.418174 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:11.418184 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:11.418244 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:12.418322 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:12.418349 prospector.go:179: DBG Start next scan
2016/03/30 03:20:12.418389 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:12.418444 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:12.418456 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:12.418465 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:13.418596 prospector.go:179: DBG Start next scan
2016/03/30 03:20:13.418699 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:13.418863 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:13.418987 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:13.419007 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:13.419075 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:14.419244 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:14.419293 prospector.go:179: DBG Start next scan
2016/03/30 03:20:14.419308 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:14.419369 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:14.419382 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:14.419391 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:15.419528 prospector.go:179: DBG Start next scan
2016/03/30 03:20:15.419568 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:15.419576 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:15.419618 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:15.419629 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:15.419657 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:16.420098 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:16.420153 prospector.go:179: DBG Start next scan
2016/03/30 03:20:16.420207 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:16.420356 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:16.420388 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:16.420406 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
+ ls -il ./input
2016/03/30 03:20:17.408486 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0
136135 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input
+ mv ./input ./input.1
2016/03/30 03:20:17.420440 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:17.421231 prospector.go:179: DBG Start next scan
2016/03/30 03:20:17.421335 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:17.421557 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:17.421594 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:17.421659 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
+ touch ./input
+ ls -il ./input ./input.1
136151 -rw-r--r-- 1 root root 0 Mar 30 03:20 ./input
136135 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input.1
+ sleep 10
2016/03/30 03:20:18.420985 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:18.423289 prospector.go:179: DBG Start next scan
2016/03/30 03:20:18.423427 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:18.424321 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:18.424326 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:18.424438 prospector.go:401: DBG Launching harvester on rotated file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:18.424471 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:18.424508 prospector.go:315: DBG Start harvesting unknown file: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:18.424533 registrar.go:210: INFO Old file with new name found: /tmp/filebeat-issue-repro/input is no /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:18.424553 registrar.go:179: INFO Detected rename of a previously harvested file: /tmp/filebeat-issue-repro/input -> /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:18.424593 prospector.go:353: DBG File rename was detected: /tmp/filebeat-issue-repro/input -> /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:18.424840 registrar.go:98: DBG Registrar will re-save state for /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:18.424862 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry
2016/03/30 03:20:18.425140 registrar.go:157: INFO Registry file updated. 2 states written.
2016/03/30 03:20:18.425714 log.go:282: DBG harvest: "/tmp/filebeat-issue-repro/input" (offset snapshot:0)
2016/03/30 03:20:18.425750 log.go:113: INFO Harvester started for file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:18.425843 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:19.422141 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:19.425030 prospector.go:179: DBG Start next scan
2016/03/30 03:20:19.425195 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:19.425740 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:19.426354 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:19.426786 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:19.427309 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:19.427887 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:19.428708 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:19.426271 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:20.422785 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:20.429455 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:20.429726 prospector.go:179: DBG Start next scan
2016/03/30 03:20:20.429992 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:20.431112 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:20.431689 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:20.432209 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:20.433168 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:20.433541 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:20.433793 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:21.423741 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:21.429941 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:21.434331 prospector.go:179: DBG Start next scan
2016/03/30 03:20:21.434592 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:21.434802 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:21.435908 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:21.436772 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:21.436932 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:21.437174 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:21.437371 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:22.425408 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:22.430440 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:22.438923 prospector.go:179: DBG Start next scan
2016/03/30 03:20:22.439276 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:22.439659 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:22.439877 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:22.440516 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:22.440618 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:22.440790 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:22.441582 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:23.426634 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:23.431202 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:23.442968 prospector.go:179: DBG Start next scan
2016/03/30 03:20:23.443039 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:23.443753 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:23.443785 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:23.443802 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:23.443816 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:23.443832 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:23.443843 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:24.426995 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:24.432782 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:24.444178 prospector.go:179: DBG Start next scan
2016/03/30 03:20:24.444250 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:24.444427 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:24.444460 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:24.444481 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:24.444499 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:24.444520 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:24.444535 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:24.905528 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0
2016/03/30 03:20:25.427377 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:25.433083 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:25.445867 prospector.go:179: DBG Start next scan
2016/03/30 03:20:25.445967 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:25.446472 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:25.446747 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:25.447038 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:25.447326 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:25.447555 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:25.447769 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:26.427698 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:26.433315 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:26.448030 prospector.go:179: DBG Start next scan
2016/03/30 03:20:26.448069 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:26.448079 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:26.448122 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:26.448132 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:26.448140 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:26.448148 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:26.448155 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:27.427982 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:27.434085 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
+ echo entry2
+ sleep 10
2016/03/30 03:20:27.448441 prospector.go:179: DBG Start next scan
2016/03/30 03:20:27.448482 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:27.448591 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:27.448597 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:27.448634 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:27.448642 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:27.448653 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:27.448659 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:28.428384 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:28.434465 util.go:20: DBG full line read
2016/03/30 03:20:28.434524 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:28.448846 prospector.go:179: DBG Start next scan
2016/03/30 03:20:28.448895 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:28.449008 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:28.449023 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:28.449051 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:28.449060 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:28.449070 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:28.449076 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:29.429442 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:29.434707 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:29.449343 prospector.go:179: DBG Start next scan
2016/03/30 03:20:29.449383 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:29.449391 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:29.449433 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:29.449443 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:29.449451 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:29.449460 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:29.449467 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:30.429756 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:30.435748 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:30.449737 prospector.go:179: DBG Start next scan
2016/03/30 03:20:30.449778 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:30.449786 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:30.449843 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:30.449853 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:30.449862 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:30.449872 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:30.449879 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:31.430333 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:31.436002 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:31.450149 prospector.go:179: DBG Start next scan
2016/03/30 03:20:31.450263 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:31.450663 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:31.450756 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:31.450773 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:31.450787 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:31.450802 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:31.450813 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:32.405322 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 1
2016/03/30 03:20:32.405598 publish.go:109: DBG Publish: {
"@timestamp": "2016-03-30T03:20:28.434Z",
"beat": {
"hostname": "section-delivery",
"name": "section-delivery"
},
"count": 1,
"fields": null,
"input_type": "log",
"message": "entry2",
"offset": 0,
"source": "/tmp/filebeat-issue-repro/input",
"type": "log"
}
2016/03/30 03:20:32.405639 output.go:87: DBG output worker: publish 1 events
2016/03/30 03:20:32.405736 publish.go:104: INFO Events sent: 1
2016/03/30 03:20:32.405762 registrar.go:111: DBG Processing 1 events
2016/03/30 03:20:32.405783 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry
2016/03/30 03:20:32.405985 registrar.go:157: INFO Registry file updated. 2 states written.
2016/03/30 03:20:32.430680 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:32.436336 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:32.451113 prospector.go:179: DBG Start next scan
2016/03/30 03:20:32.451477 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:32.452440 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:32.452589 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:32.452612 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:32.452663 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:32.452689 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:32.452704 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:33.431095 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:33.436692 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:33.453815 prospector.go:179: DBG Start next scan
2016/03/30 03:20:33.453921 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:33.455498 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:33.455512 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:33.455660 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:33.455684 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:33.455713 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:33.455736 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:34.432222 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:34.436865 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:34.455956 prospector.go:179: DBG Start next scan
2016/03/30 03:20:34.455993 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:34.456006 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:34.456113 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:34.456242 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:34.456431 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:34.456443 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:34.456450 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:35.432551 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:35.437122 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:35.456679 prospector.go:179: DBG Start next scan
2016/03/30 03:20:35.456715 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:35.456729 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:35.456970 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:35.457174 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:35.457223 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:35.457326 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:35.458406 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:36.432986 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:36.438061 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:36.458868 prospector.go:179: DBG Start next scan
2016/03/30 03:20:36.459023 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:36.459125 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:36.459245 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:36.459253 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:36.459472 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:36.459482 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:36.459593 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:37.433339 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
+ ls -il ./input ./input.1
2016/03/30 03:20:37.438579 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
136151 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input
136135 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input.1
+ mv ./input.1 ./input.2
+ mv ./input ./input.1
+ touch ./input
+ rm ./input.2
+ ls -il ./input ./input.1
136156 -rw-r--r-- 1 root root 0 Mar 30 03:20 ./input
136151 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input.1
+ sleep 10
2016/03/30 03:20:37.461027 prospector.go:179: DBG Start next scan
2016/03/30 03:20:37.461096 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:37.461912 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:37.462043 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:37.462058 prospector.go:401: DBG Launching harvester on rotated file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:37.462071 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:37.462081 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:37.462088 prospector.go:394: DBG File rename was detected: /tmp/filebeat-issue-repro/input -> /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:37.462094 prospector.go:395: DBG Launching harvester on renamed file: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:37.462173 log.go:282: DBG harvest: "/tmp/filebeat-issue-repro/input" (offset snapshot:0)
2016/03/30 03:20:37.462183 log.go:113: INFO Harvester started for file: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:37.462659 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:38.434689 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:38.439667 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:38.463158 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:38.463207 prospector.go:179: DBG Start next scan
2016/03/30 03:20:38.463220 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:38.463428 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:38.463443 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:38.463488 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:38.463498 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:38.463508 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:38.463514 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:39.435058 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:39.439982 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:39.464199 prospector.go:179: DBG Start next scan
2016/03/30 03:20:39.464295 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:39.464436 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:39.464458 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:39.464471 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:39.464483 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:39.464496 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:39.464525 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:39.464589 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:39.906271 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0
2016/03/30 03:20:40.436380 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:40.440228 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:40.464845 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:40.464876 prospector.go:179: DBG Start next scan
2016/03/30 03:20:40.464891 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:40.465094 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:40.465160 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:40.465169 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:40.465178 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:40.465187 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:40.465194 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:41.436712 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:41.441813 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:41.465076 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:41.465325 prospector.go:179: DBG Start next scan
2016/03/30 03:20:41.465355 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:41.465449 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:41.465465 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:41.465474 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:41.465498 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:41.465509 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:41.465515 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:42.437377 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:42.445273 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:42.466475 prospector.go:179: DBG Start next scan
2016/03/30 03:20:42.466620 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:42.466824 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:42.466863 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:42.466888 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:42.466911 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:42.466935 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:42.467001 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:42.467059 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:43.438861 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:43.445734 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:43.467514 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:43.467583 prospector.go:179: DBG Start next scan
2016/03/30 03:20:43.467617 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:43.469492 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:43.469751 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:43.469778 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:43.469801 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:43.469855 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:43.469878 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:44.440228 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:44.446202 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:44.468086 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:44.470372 prospector.go:179: DBG Start next scan
2016/03/30 03:20:44.470520 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:44.471054 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:44.471475 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:44.471872 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:44.472548 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:44.473113 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:44.474035 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:45.440655 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:45.446525 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:45.468981 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:45.475774 prospector.go:179: DBG Start next scan
2016/03/30 03:20:45.475983 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:45.476325 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:45.476531 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:45.476702 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:45.476867 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:45.477077 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:45.477234 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:46.442186 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:46.446852 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:46.470126 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:46.477557 prospector.go:179: DBG Start next scan
2016/03/30 03:20:46.477587 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:46.477821 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:46.477965 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:46.477978 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:46.477987 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:46.477996 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:46.478002 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:47.405345 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0
2016/03/30 03:20:47.442756 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:47.447342 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
+ echo entry3
+ sleep 10
2016/03/30 03:20:47.470630 util.go:20: DBG full line read
2016/03/30 03:20:47.470781 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:47.478341 prospector.go:179: DBG Start next scan
2016/03/30 03:20:47.478450 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:47.479109 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:47.479119 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:47.479217 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:47.479239 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:47.479266 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:47.479285 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:48.443427 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:48.448457 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:48.471139 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:48.479520 prospector.go:179: DBG Start next scan
2016/03/30 03:20:48.479549 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:48.479699 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:48.479719 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:48.479769 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:48.479782 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:48.479794 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:48.479803 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:49.444013 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:49.449033 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:49.471791 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:49.481144 prospector.go:179: DBG Start next scan
2016/03/30 03:20:49.481236 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:49.481586 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:49.481662 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:49.481679 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:49.481693 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:49.481708 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:49.481720 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:50.444653 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:50.449444 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:50.473782 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:50.482180 prospector.go:179: DBG Start next scan
2016/03/30 03:20:50.482335 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:50.482898 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:50.483018 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:50.483046 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:50.483069 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:50.483095 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:50.483115 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:51.445402 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:51.450785 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:51.474325 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:51.483427 prospector.go:179: DBG Start next scan
2016/03/30 03:20:51.483569 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:51.484331 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:51.484337 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:51.484443 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:51.484467 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:51.484497 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:51.484516 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:52.405815 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 1
2016/03/30 03:20:52.406153 publish.go:109: DBG Publish: {
"@timestamp": "2016-03-30T03:20:47.470Z",
"beat": {
"hostname": "section-delivery",
"name": "section-delivery"
},
"count": 1,
"fields": null,
"input_type": "log",
"message": "entry3",
"offset": 0,
"source": "/tmp/filebeat-issue-repro/input",
"type": "log"
}
2016/03/30 03:20:52.406197 output.go:87: DBG output worker: publish 1 events
2016/03/30 03:20:52.406323 publish.go:104: INFO Events sent: 1
2016/03/30 03:20:52.406373 registrar.go:111: DBG Processing 1 events
2016/03/30 03:20:52.406399 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry
2016/03/30 03:20:52.407203 registrar.go:157: INFO Registry file updated. 2 states written.
2016/03/30 03:20:52.446693 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:52.451561 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:52.474877 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:52.484906 prospector.go:179: DBG Start next scan
2016/03/30 03:20:52.485014 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:52.486755 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:52.486781 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:52.486906 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:52.486950 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:52.487038 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:52.487074 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:53.448018 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:53.451967 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:53.475198 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:53.487744 prospector.go:179: DBG Start next scan
2016/03/30 03:20:53.487826 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:53.488333 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:53.488353 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:53.488422 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:53.488436 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:53.488453 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:53.488478 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:54.449522 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:54.452449 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:54.475734 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:54.488911 prospector.go:179: DBG Start next scan
2016/03/30 03:20:54.489012 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:54.489658 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:54.489794 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:54.489823 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:54.489844 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:54.490120 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:54.490145 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:55.450174 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:55.452917 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:55.477536 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:55.491328 prospector.go:179: DBG Start next scan
2016/03/30 03:20:55.491574 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:55.491951 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:55.492129 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:55.492282 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:55.492419 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:55.492467 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:55.492696 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:56.450916 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:56.453514 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:56.478686 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:56.493037 prospector.go:179: DBG Start next scan
2016/03/30 03:20:56.493971 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input*
2016/03/30 03:20:56.494130 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:56.494379 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:56.494437 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input
2016/03/30 03:20:56.494547 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:56.494665 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:56.494778 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1
2016/03/30 03:20:57.451253 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
2016/03/30 03:20:57.454914 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now.
+ kill 3550084
+ wait
2016/03/30 03:20:57.456725 service.go:30: DBG Received sigterm/sigint, stopping
2016/03/30 03:20:57.456848 registrar.go:129: INFO Stopping Registrar
2016/03/30 03:20:57.456853 registrar.go:93: INFO Ending Registrar
2016/03/30 03:20:57.456965 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry
2016/03/30 03:20:57.457336 registrar.go:157: INFO Registry file updated. 2 states written.
2016/03/30 03:20:57.457482 beat.go:183: INFO Cleaning up filebeat before shutting down.
+ sed 's/\([{},]\)/\1\n/g' ./registry
{
"/tmp/filebeat-issue-repro/input":{
"source":"/tmp/filebeat-issue-repro/input",
"offset":7,
"FileStateOS":{
"inode":136156,
"device":2049}
}
,
"/tmp/filebeat-issue-repro/input.1":{
"source":"/tmp/filebeat-issue-repro/input.1",
"offset":7,
"FileStateOS":{
"inode":136135,
"device":2049}
}
}
+ ls -il ./input ./input.1
136156 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input
136151 -rw-r--r-- 1 root root 7 Mar 30 03:20 ./input.1
++ stat --printf=%i ./input
+ grep --fixed-strings '"inode":136156,' ./registry
{"/tmp/filebeat-issue-repro/input":{"source":"/tmp/filebeat-issue-repro/input","offset":7,"FileStateOS":{"inode":136156,"device":2049}},"/tmp/filebeat-issue-repro/input.1":{"source":"/tmp/filebeat-issue-repro/input.1","offset":7,"FileStateOS":{"inode":136135,"device":2049}}}
++ stat --printf=%i ./input.1
+ grep --fixed-strings '"inode":136151,' ./registry
+ echo Exited with 1
Exited with 1
#!/usr/bin/env bash
set -o errexit -o xtrace
trap "echo Exited with \$?" EXIT
filebeat --version | grep --fixed-strings 1.1.2
sleep_duration_seconds=10
conf_file="$(dirname "${0}")/filebeat-issue-repro.yml"
#init
mkdir --parents /tmp/filebeat-issue-repro/
cd /tmp/filebeat-issue-repro/
rm --force ./*
echo entry1 >>./input
! test -a ./shipped
filebeat -e -c "${conf_file}" &
filebeat_pid=$!
sleep "${sleep_duration_seconds}"
ls -il ./input*
mv ./input ./input.1
touch ./input
ls -il ./input*
sleep "${sleep_duration_seconds}"
echo entry2 >>./input
sleep "${sleep_duration_seconds}"
ls -il ./input*
mv ./input.1 ./input.2
mv ./input ./input.1
touch ./input
rm ./input.2
ls -il ./input*
sleep "${sleep_duration_seconds}"
echo entry3 >>./input
sleep "${sleep_duration_seconds}"
kill "${filebeat_pid}"
wait
sed 's/\([{},]\)/\1\n/g' ./registry
ls -il ./input*
grep --fixed-strings "\"inode\":$(stat --printf=%i ./input)," ./registry
grep --fixed-strings "\"inode\":$(stat --printf=%i ./input.1)," ./registry
filebeat:
prospectors:
-
paths:
- /tmp/filebeat-issue-repro/input*
ignore_older: 24h
max_backoff: 1s
scan_frequency: 1s
registry_file: /tmp/filebeat-issue-repro/registry
output:
file:
path: /tmp/filebeat-issue-repro/
filename: shipped
logging:
level: debug
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment