Last active
March 24, 2016 06:39
-
-
Save jstangroome/b3459eaf1d96e7fac00b to your computer and use it in GitHub Desktop.
filebeat-issue-repro for https://discuss.elastic.co/t/old-file-with-new-name-found/41766
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| + trap 'echo Exited with $?' EXIT | |
| + filebeat --version | |
| s 1.1.2 | |
| filebeat version 1.1.2 (amd64) | |
| ++ dirname /vagrant/filebeat-issue-repro.sh | |
| + conf_file=/vagrant/filebeat-issue-repro.yml | |
| + mkdir --parents /tmp/filebeat-issue-repro/ | |
| + cd /tmp/filebeat-issue-repro/ | |
| + rm --force ./input ./input.1 ./registry ./shipped | |
| + echo entry1 | |
| + echo entry0 | |
| + touch --date=yesterday ./input.1 | |
| + test -a ./shipped | |
| + filebeat_pid=2378720 | |
| + sleep 5 | |
| + filebeat -e -c /vagrant/filebeat-issue-repro.yml | |
| 2016/03/23 10:22:40.715827 beat.go:135: DBG Initializing output plugins | |
| 2016/03/23 10:22:40.716049 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths | |
| 2016/03/23 10:22:40.716157 file.go:39: INFO File output base filename set to: shipped | |
| 2016/03/23 10:22:40.716259 file.go:50: INFO Rotate every bytes set to: 10485760 | |
| 2016/03/23 10:22:40.716308 file.go:57: INFO Number of files set to: 7 | |
| 2016/03/23 10:22:40.716433 outputs.go:119: INFO Activated file as output plugin. | |
| 2016/03/23 10:22:40.716543 publish.go:232: DBG Create output worker | |
| 2016/03/23 10:22:40.716594 publish.go:274: DBG No output is defined to store the topology. The server fields might not be filled. | |
| 2016/03/23 10:22:40.716719 publish.go:288: INFO Publisher name: section-delivery | |
| 2016/03/23 10:22:40.716864 async.go:78: INFO Flush Interval set to: -1ms | |
| 2016/03/23 10:22:40.716983 async.go:84: INFO Max Bulk Size set to: -1 | |
| 2016/03/23 10:22:40.717116 beat.go:147: INFO Init Beat: filebeat; Version: 1.1.2 | |
| 2016/03/23 10:22:40.717847 beat.go:173: INFO filebeat sucessfully setup. Start running. | |
| 2016/03/23 10:22:40.718780 registrar.go:66: INFO Registry file set to: /tmp/filebeat-issue-repro/registry | |
| 2016/03/23 10:22:40.718905 spooler.go:44: DBG Set idleTimeoutDuration to 5s | |
| 2016/03/23 10:22:40.719001 crawler.go:38: DBG File Configs: [/tmp/filebeat-issue-repro/input*] | |
| 2016/03/23 10:22:40.719047 prospector.go:127: INFO Set ignore_older duration to 1h0m0s | |
| 2016/03/23 10:22:40.719151 prospector.go:127: INFO Set scan_frequency duration to 1s | |
| 2016/03/23 10:22:40.719286 prospector.go:84: INFO Invalid input type set: | |
| 2016/03/23 10:22:40.719398 prospector.go:87: INFO Input type set to: log | |
| 2016/03/23 10:22:40.719500 prospector.go:127: INFO Set backoff duration to 1s | |
| 2016/03/23 10:22:40.719602 prospector.go:127: INFO Set max_backoff duration to 1s | |
| 2016/03/23 10:22:40.719706 prospector.go:107: INFO force_close_file is disabled | |
| 2016/03/23 10:22:40.719807 crawler.go:58: DBG Waiting for 1 prospectors to initialise | |
| 2016/03/23 10:22:40.719911 prospector.go:137: INFO Starting prospector of type: log | |
| 2016/03/23 10:22:40.720071 prospector.go:155: DBG exclude_files: [] | |
| 2016/03/23 10:22:40.720169 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:40.720221 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.720327 prospector.go:315: DBG Start harvesting unknown file: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.720480 prospector.go:362: DBG Launching harvester on new file: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.720536 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.720640 prospector.go:315: DBG Start harvesting unknown file: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.720789 prospector.go:333: DBG Fetching old state of file to resume: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.720898 prospector.go:348: DBG Skipping file (older than ignore older of 1h0m0s, 24h0m0.010602347s): /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.720997 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:40.721055 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.721234 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.721329 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.721379 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.721568 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.721619 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:40.721815 spooler.go:77: INFO Starting spooler: spool_size: 2048; idle_timeout: 5s | |
| 2016/03/23 10:22:40.721939 log.go:282: DBG harvest: "/tmp/filebeat-issue-repro/input" (offset snapshot:0) | |
| 2016/03/23 10:22:40.722036 log.go:113: INFO Harvester started for file: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:40.722195 util.go:20: DBG full line read | |
| 2016/03/23 10:22:40.722300 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:40.722381 crawler.go:65: DBG No pending prospectors. Finishing setup | |
| 2016/03/23 10:22:40.722464 crawler.go:78: INFO All prospectors initialised with 0 states to persist | |
| 2016/03/23 10:22:40.722516 registrar.go:83: INFO Starting Registrar | |
| 2016/03/23 10:22:40.722630 publish.go:88: INFO Start sending events to output | |
| 2016/03/23 10:22:41.722275 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:41.722421 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:41.722548 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:41.722658 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:41.722768 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:41.722882 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:41.723002 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:41.723123 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:41.723296 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:42.724727 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:42.725412 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:42.725744 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:42.726166 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:42.726586 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:42.727058 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:42.727358 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:42.727761 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:42.728010 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:43.222126 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 1 | |
| 2016/03/23 10:22:43.222506 publish.go:109: DBG Publish: { | |
| "@timestamp": "2016-03-23T10:22:40.722Z", | |
| "beat": { | |
| "hostname": "section-delivery", | |
| "name": "section-delivery" | |
| }, | |
| "count": 1, | |
| "fields": null, | |
| "input_type": "log", | |
| "message": "entry1", | |
| "offset": 0, | |
| "source": "/tmp/filebeat-issue-repro/input", | |
| "type": "log" | |
| } | |
| 2016/03/23 10:22:43.222873 output.go:87: DBG output worker: publish 1 events | |
| 2016/03/23 10:22:43.227359 publish.go:104: INFO Events sent: 1 | |
| 2016/03/23 10:22:43.227810 registrar.go:111: DBG Processing 1 events | |
| 2016/03/23 10:22:43.227999 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry | |
| 2016/03/23 10:22:43.228221 registrar.go:157: INFO Registry file updated. 1 states written. | |
| 2016/03/23 10:22:43.726398 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:43.729315 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:43.729529 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:43.729710 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:43.729896 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:43.734199 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:43.734303 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:43.734383 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:43.734460 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:44.726929 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:44.735900 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:44.736215 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:44.736582 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:44.736790 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:44.736930 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:44.737107 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:44.737283 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:44.737461 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| + ls -il ./input ./input.1 | |
| 136135 -rw-r--r-- 1 root root 7 Mar 23 10:22 ./input | |
| 136142 -rw-r--r-- 1 root root 7 Mar 22 10:22 ./input.1 | |
| 2016/03/23 10:22:45.727796 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| + rm ./input.1 | |
| + mv ./input ./input.1 | |
| + echo entry2 | |
| + ls -il ./input ./input.1 | |
| 2016/03/23 10:22:45.738930 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:45.739312 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:45.739751 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:45.740008 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:45.740340 prospector.go:394: DBG File rename was detected: /tmp/filebeat-issue-repro/input.1 -> /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:45.740519 prospector.go:395: DBG Launching harvester on renamed file: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:45.740909 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:45.741095 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:45.741354 prospector.go:394: DBG File rename was detected: /tmp/filebeat-issue-repro/input -> /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:45.741591 prospector.go:395: DBG Launching harvester on renamed file: /tmp/filebeat-issue-repro/input.1 | |
| 136142 -rw-r--r-- 1 root root 7 Mar 23 10:22 ./input | |
| 136135 -rw-r--r-- 1 root root 7 Mar 23 10:22 ./input.1 | |
| + sleep 15 | |
| 2016/03/23 10:22:46.728738 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:46.742292 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:46.742775 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:46.743093 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:46.743508 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:46.743810 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:46.743981 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:46.744226 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:46.744925 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:47.730057 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:47.745857 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:47.746155 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:47.746486 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:47.747558 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:47.747798 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:47.748072 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:47.748273 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:47.748506 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:48.731031 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:48.748988 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:48.749218 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:48.749915 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:48.750179 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:48.750942 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:48.751241 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:48.751531 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:48.751772 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:49.733014 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:49.752514 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:49.752871 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:49.753194 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:49.753604 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:49.753856 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:49.754029 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:49.754231 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:49.754599 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:50.723517 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0 | |
| 2016/03/23 10:22:50.733998 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:50.755994 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:50.756279 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:50.757060 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:50.757342 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:50.757744 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:50.757995 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:50.758274 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:50.758677 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:51.735675 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:51.759409 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:51.759766 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:51.760123 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:51.761580 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:51.761785 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:51.762156 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:51.762389 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:51.762538 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:52.736524 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:52.763117 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:52.763462 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:52.763883 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:52.764803 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:52.765217 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:52.765457 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:52.765716 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:52.766198 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:53.738111 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:53.766761 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:53.767035 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:53.767282 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:53.767701 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:53.767893 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:53.768074 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:53.768283 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:53.768443 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:54.739435 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:54.769044 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:54.769281 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:54.769763 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:54.770180 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:54.770434 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:54.770675 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:54.770931 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:54.771167 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:55.740205 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:55.772544 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:55.773122 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:55.773421 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:55.773750 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:55.774312 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:55.774638 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:55.774894 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:55.775194 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:56.740982 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:56.775871 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:56.776025 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:56.776154 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:56.776270 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:56.776391 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:56.776515 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:56.776652 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:56.776698 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:57.742139 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:57.777333 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:57.777647 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:57.777941 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:57.778193 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:57.778543 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:57.778851 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:57.779036 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:57.779257 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:58.222231 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0 | |
| 2016/03/23 10:22:58.743015 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:58.780571 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:58.781195 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:58.781625 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:58.782089 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:58.782618 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:58.782892 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:58.783152 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:58.783517 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:59.745412 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| 2016/03/23 10:22:59.784997 prospector.go:179: DBG Start next scan | |
| 2016/03/23 10:22:59.785586 prospector.go:246: DBG scan path /tmp/filebeat-issue-repro/input* | |
| 2016/03/23 10:22:59.785849 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:59.786185 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:59.786522 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input | |
| 2016/03/23 10:22:59.786700 prospector.go:259: DBG Check file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:59.786943 prospector.go:380: DBG Update existing file for harvesting: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:22:59.787185 prospector.go:423: DBG Not harvesting, file didn't change: /tmp/filebeat-issue-repro/input.1 | |
| 2016/03/23 10:23:00.746378 reader.go:138: DBG End of file reached: /tmp/filebeat-issue-repro/input; Backoff now. | |
| + kill 2378720 | |
| + wait | |
| 2016/03/23 10:23:00.757658 service.go:30: DBG Received sigterm/sigint, stopping | |
| 2016/03/23 10:23:00.757845 registrar.go:129: INFO Stopping Registrar | |
| 2016/03/23 10:23:00.758021 registrar.go:93: INFO Ending Registrar | |
| 2016/03/23 10:23:00.758258 registrar.go:142: DBG Write registry file: /tmp/filebeat-issue-repro/registry | |
| 2016/03/23 10:23:00.758754 registrar.go:157: INFO Registry file updated. 1 states written. | |
| 2016/03/23 10:23:00.758940 beat.go:183: INFO Cleaning up filebeat before shutting down. | |
| + sed 's/\([{},]\)/\1\n/g' ./registry | |
| { | |
| "/tmp/filebeat-issue-repro/input":{ | |
| "source":"/tmp/filebeat-issue-repro/input", | |
| "offset":7, | |
| "FileStateOS":{ | |
| "inode":136135, | |
| "device":2049} | |
| } | |
| } | |
| + grep entry1 ./shipped | |
| {"@timestamp":"2016-03-23T10:22:40.722Z","beat":{"hostname":"section-delivery","name":"section-delivery"},"count":1,"fields":null,"input_type":"log","message":"entry1","offset":0,"source":"/tmp/filebeat-issue-repro/input","type":"log"} | |
| + grep entry2 ./shipped | |
| + echo Exited with 1 | |
| Exited with 1 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env bash | |
| set -o errexit -o xtrace | |
| trap "echo Exited with \$?" EXIT | |
| filebeat --version | grep --fixed-strings 1.1.2 | |
| conf_file="$(dirname "${0}")/filebeat-issue-repro.yml" | |
| #init | |
| mkdir --parents /tmp/filebeat-issue-repro/ | |
| cd /tmp/filebeat-issue-repro/ | |
| rm --force ./* | |
| echo entry1 >>./input | |
| echo entry0 >>./input.1 | |
| touch --date=yesterday ./input.1 | |
| ! test -a ./shipped | |
| filebeat -e -c "${conf_file}" & | |
| filebeat_pid=$! | |
| sleep 5 | |
| ls -il ./input* | |
| rm ./input.1 | |
| mv ./input ./input.1 | |
| echo entry2 >>./input | |
| ls -il ./input* | |
| sleep 15 | |
| kill "${filebeat_pid}" | |
| wait | |
| sed 's/\([{},]\)/\1\n/g' ./registry | |
| grep entry1 ./shipped | |
| grep entry2 ./shipped | |
| test 2 == "$(cat ./shipped | wc --lines)" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| filebeat: | |
| prospectors: | |
| - | |
| paths: | |
| - /tmp/filebeat-issue-repro/input* | |
| ignore_older: 1h | |
| max_backoff: 1s | |
| scan_frequency: 1s | |
| registry_file: /tmp/filebeat-issue-repro/registry | |
| output: | |
| file: | |
| path: /tmp/filebeat-issue-repro/ | |
| filename: shipped | |
| logging: | |
| level: debug |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment