Skip to content

Instantly share code, notes, and snippets.

@Nereuxofficial

Nereuxofficial/gist:2aef73e8403a6445cca91e6c34d3b296

Created August 7, 2023 13:28
Show Gist options
  • Save Nereuxofficial/2aef73e8403a6445cca91e6c34d3b296 to your computer and use it in GitHub Desktop.
Save Nereuxofficial/2aef73e8403a6445cca91e6c34d3b296 to your computer and use it in GitHub Desktop.
Download ZIP
Nanomq_crash.log
Raw
gistfile1.txt
Running `target/release/rusty-fume --broker-command 'nanomq start' replay`
2023-08-07T13:02:36.894341Z INFO rusty_fume: Replaying thread number 0
2023-08-07T13:02:37.696280Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:38.397854Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:38.398627Z INFO rusty_fume::runtime: Thread 878195166773143652 finished!
2023-08-07T13:02:38.398730Z INFO rusty_fume: Replaying thread number 1
2023-08-07T13:02:39.200658Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:39.903288Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:40.605286Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:40.605379Z INFO rusty_fume::runtime: Thread 2528892852593983727 finished!
2023-08-07T13:02:40.605475Z INFO rusty_fume: Replaying thread number 2
2023-08-07T13:02:41.408759Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:42.110675Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:42.813217Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:42.813764Z INFO rusty_fume::runtime: Thread 7886694614931340180 finished!
2023-08-07T13:02:42.813835Z INFO rusty_fume: Replaying thread number 3
2023-08-07T13:02:43.615898Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:43.617101Z INFO rusty_fume::runtime: Thread 15245780291753644407 finished!
2023-08-07T13:02:43.617207Z INFO rusty_fume: Replaying thread number 4
2023-08-07T13:02:44.418675Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:45.120795Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:45.823226Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:45.823345Z INFO rusty_fume::runtime: Thread 1317314279345140597 finished!
2023-08-07T13:02:45.823412Z INFO rusty_fume: Replaying thread number 5
2023-08-07T13:02:46.525718Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:46.525892Z INFO rusty_fume::runtime: Thread 9728887913209801721 finished!
2023-08-07T13:02:46.525972Z INFO rusty_fume: Replaying thread number 6
2023-08-07T13:02:47.329180Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:47.330580Z INFO rusty_fume::runtime: Thread 8155100120893457851 finished!
2023-08-07T13:02:47.330661Z INFO rusty_fume: Replaying thread number 7
2023-08-07T13:02:47.331777Z INFO rusty_fume::runtime: Thread 16674571040340824909 finished!
2023-08-07T13:02:47.331817Z INFO rusty_fume: Replaying thread number 8
2023-08-07T13:02:48.131631Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:48.832698Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:48.832805Z INFO rusty_fume::runtime: Thread 977686414785570598 finished!
2023-08-07T13:02:48.832904Z INFO rusty_fume: Replaying thread number 9
2023-08-07T13:02:49.534899Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:50.237576Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:50.237685Z INFO rusty_fume::runtime: Thread 6714291571235683323 finished!
2023-08-07T13:02:50.237834Z INFO rusty_fume: Replaying thread number 10
2023-08-07T13:02:50.940924Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:51.642754Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:52.344682Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:52.344797Z INFO rusty_fume::runtime: Thread 9984828311587828599 finished!
2023-08-07T13:02:52.344859Z INFO rusty_fume: Replaying thread number 11
2023-08-07T13:02:53.046661Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:53.749241Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:54.451232Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:54.451383Z INFO rusty_fume::runtime: Thread 16386035705871608128 finished!
2023-08-07T13:02:54.451484Z INFO rusty_fume: Replaying thread number 12
2023-08-07T13:02:55.153491Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:55.154467Z INFO rusty_fume::runtime: Thread 10103959975678120347 finished!
2023-08-07T13:02:55.154518Z INFO rusty_fume: Replaying thread number 13
2023-08-07T13:02:55.955833Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:55.956680Z INFO rusty_fume::runtime: Thread 6800611925412557537 finished!
2023-08-07T13:02:55.956730Z INFO rusty_fume: Replaying thread number 14
2023-08-07T13:02:56.758018Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:56.758781Z INFO rusty_fume::runtime: Thread 6045801211541415348 finished!
2023-08-07T13:02:56.758840Z INFO rusty_fume: Replaying thread number 15
2023-08-07T13:02:57.561226Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:58.262275Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:58.262902Z INFO rusty_fume::runtime: Thread 5541959333092658992 finished!
2023-08-07T13:02:58.263076Z INFO rusty_fume: Replaying thread number 16
2023-08-07T13:02:58.264345Z INFO rusty_fume::runtime: Thread 5976007889327647988 finished!
2023-08-07T13:02:58.264411Z INFO rusty_fume: Replaying thread number 17
2023-08-07T13:02:59.064756Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:59.866433Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:02:59.866519Z INFO rusty_fume::runtime: Thread 15653553972073346676 finished!
2023-08-07T13:02:59.866583Z INFO rusty_fume: Replaying thread number 18
2023-08-07T13:03:00.668399Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:01.370019Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:02.172718Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:02.172842Z INFO rusty_fume::runtime: Thread 4721092113589092935 finished!
2023-08-07T13:03:02.172949Z INFO rusty_fume: Replaying thread number 19
2023-08-07T13:03:02.874257Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:03.676749Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:03.677905Z INFO rusty_fume::runtime: Thread 10522492759785971706 finished!
2023-08-07T13:03:03.678024Z INFO rusty_fume: Replaying thread number 20
2023-08-07T13:03:04.379740Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:05.080481Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:05.882970Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:05.883924Z INFO rusty_fume::runtime: Thread 14993459358441164715 finished!
2023-08-07T13:03:05.883980Z INFO rusty_fume: Replaying thread number 21
2023-08-07T13:03:06.686349Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:07.388274Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:07.388950Z INFO rusty_fume::runtime: Thread 17405081814273227293 finished!
2023-08-07T13:03:07.389079Z INFO rusty_fume: Replaying thread number 22
2023-08-07T13:03:08.090317Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:08.091888Z INFO rusty_fume::runtime: Thread 16769786203160452232 finished!
2023-08-07T13:03:08.092003Z INFO rusty_fume: Replaying thread number 23
2023-08-07T13:03:08.892702Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:09.695586Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:10.397590Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:11.100371Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:11.801262Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:11.802064Z INFO rusty_fume::runtime: Thread 1519316551754114504 finished!
2023-08-07T13:03:11.802129Z INFO rusty_fume: Replaying thread number 24
2023-08-07T13:03:12.603623Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:13.407211Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:13.407318Z INFO rusty_fume::runtime: Thread 3382437486985591535 finished!
2023-08-07T13:03:13.407420Z INFO rusty_fume: Replaying thread number 25
2023-08-07T13:03:14.109458Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:14.110740Z INFO rusty_fume::runtime: Thread 2873440350205830811 finished!
2023-08-07T13:03:14.110849Z INFO rusty_fume: Replaying thread number 26
2023-08-07T13:03:14.913006Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:14.914203Z INFO rusty_fume::runtime: Thread 7844899624993723981 finished!
2023-08-07T13:03:14.914286Z INFO rusty_fume: Replaying thread number 27
2023-08-07T13:03:15.715649Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:16.416485Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:16.417253Z INFO rusty_fume::runtime: Thread 4709395785541881355 finished!
2023-08-07T13:03:16.417395Z INFO rusty_fume: Replaying thread number 28
2023-08-07T13:03:17.219431Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:18.021972Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:18.724326Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:18.724904Z INFO rusty_fume::runtime: Thread 1547415939807221546 finished!
2023-08-07T13:03:18.724963Z INFO rusty_fume: Replaying thread number 29
2023-08-07T13:03:19.526911Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:20.229102Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:20.229656Z INFO rusty_fume::runtime: Thread 9411937598474493351 finished!
2023-08-07T13:03:20.229705Z INFO rusty_fume: Replaying thread number 30
2023-08-07T13:03:21.032074Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:21.735342Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:22.437469Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:23.239987Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:23.941452Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:24.643943Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:25.344533Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:03:25.344620Z INFO rusty_fume::runtime: Thread 1586218270863528083 finished!
2023-08-07T13:03:25.344677Z INFO rusty_fume: Replaying thread number 31
2023-08-07T13:03:25.652524Z ERROR rusty_fume::mqtt: Receive error: Os { code: 104, kind: ConnectionReset, message: "Connection reset by peer" }
2023-08-07T13:03:25.652602Z ERROR rusty_fume::markov: Receive error, probably disconnected by the broker...
2023-08-07T13:03:25.652683Z INFO rusty_fume::process_monitor: Broker process exited with status: signal: 6 (SIGABRT) (core dumped)
2023-08-07T13:03:25.652722Z INFO rusty_fume::process_monitor: Last stdout: ""
2023-08-07T13:03:25.652729Z INFO rusty_fume::process_monitor: Last stderr: "Warning: close pipe & kick client due to KeepAlive timeout!panic: pthread_mutex_lock: Invalid argumentThis message is indicative of a BUG.Report this at https://github.com/emqx/nanomqnanomq(nni_panic+0x117) [0x559ef6e85757]nanomq(nni_task_wait+0x21) [0x559ef6e8ac01]nanomq(+0x59ef5) [0x559ef6e99ef5]nanomq(+0x4583b) [0x559ef6e8583b]nanomq(+0x4639a) [0x559ef6e8639a]nanomq(+0x4afeb) [0x559ef6e8afeb]nanomq(+0x4d8a6) [0x559ef6e8d8a6]/usr/lib/libc.so.6(+0x8c9eb) [0x7f0db3e8c9eb]/usr/lib/libc.so.6(+0x11123c) [0x7f0db3f1123c]"
2023-08-07T13:03:25.652768Z INFO rusty_fume::runtime: Thread 13503647226495983558 finished!
2023-08-07T13:03:25.652809Z INFO rusty_fume: Crashing seed found!
Number 2(this time with --log_level debug):
Running `target/release/rusty-fume --timeout 100 --broker-command 'nanomq start --log_level debug' replay`
2023-08-07T13:26:40.554374Z INFO rusty_fume: Replaying thread number 0
2023-08-07T13:26:40.757333Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:40.859304Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:40.860237Z INFO rusty_fume::runtime: Thread 878195166773143652 finished!
2023-08-07T13:26:40.860353Z INFO rusty_fume: Replaying thread number 1
2023-08-07T13:26:41.061446Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.163860Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.265975Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.266157Z INFO rusty_fume::runtime: Thread 2528892852593983727 finished!
2023-08-07T13:26:41.266262Z INFO rusty_fume: Replaying thread number 2
2023-08-07T13:26:41.469114Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.571454Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.673860Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.674550Z INFO rusty_fume::runtime: Thread 7886694614931340180 finished!
2023-08-07T13:26:41.674722Z INFO rusty_fume: Replaying thread number 3
2023-08-07T13:26:41.877165Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:41.878200Z INFO rusty_fume::runtime: Thread 15245780291753644407 finished!
2023-08-07T13:26:41.878281Z INFO rusty_fume: Replaying thread number 4
2023-08-07T13:26:42.080141Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.182097Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.283711Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.283805Z INFO rusty_fume::runtime: Thread 1317314279345140597 finished!
2023-08-07T13:26:42.284034Z INFO rusty_fume: Replaying thread number 5
2023-08-07T13:26:42.386340Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.386505Z INFO rusty_fume::runtime: Thread 9728887913209801721 finished!
2023-08-07T13:26:42.386623Z INFO rusty_fume: Replaying thread number 6
2023-08-07T13:26:42.487323Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.488569Z INFO rusty_fume::runtime: Thread 8155100120893457851 finished!
2023-08-07T13:26:42.488654Z INFO rusty_fume: Replaying thread number 7
2023-08-07T13:26:42.689890Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.689989Z INFO rusty_fume::runtime: Thread 16674571040340824909 finished!
2023-08-07T13:26:42.690135Z INFO rusty_fume: Replaying thread number 8
2023-08-07T13:26:42.791709Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.893396Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.994633Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:42.994725Z INFO rusty_fume::runtime: Thread 977686414785570598 finished!
2023-08-07T13:26:42.994801Z INFO rusty_fume: Replaying thread number 9
2023-08-07T13:26:43.097005Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.198624Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.199423Z INFO rusty_fume::runtime: Thread 6714291571235683323 finished!
2023-08-07T13:26:43.199521Z INFO rusty_fume: Replaying thread number 10
2023-08-07T13:26:43.401946Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.504059Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.605426Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.605557Z INFO rusty_fume::runtime: Thread 9984828311587828599 finished!
2023-08-07T13:26:43.605702Z INFO rusty_fume: Replaying thread number 11
2023-08-07T13:26:43.707338Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.808725Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.909870Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:43.909959Z INFO rusty_fume::runtime: Thread 16386035705871608128 finished!
2023-08-07T13:26:43.910200Z INFO rusty_fume: Replaying thread number 12
2023-08-07T13:26:44.113397Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:44.315862Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:44.315998Z INFO rusty_fume::runtime: Thread 10103959975678120347 finished!
2023-08-07T13:26:44.316086Z INFO rusty_fume: Replaying thread number 13
2023-08-07T13:26:44.518770Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:44.519792Z INFO rusty_fume::runtime: Thread 6800611925412557537 finished!
2023-08-07T13:26:44.519948Z INFO rusty_fume: Replaying thread number 14
2023-08-07T13:26:44.721926Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:44.723465Z INFO rusty_fume::runtime: Thread 6045801211541415348 finished!
2023-08-07T13:26:44.723563Z INFO rusty_fume: Replaying thread number 15
2023-08-07T13:26:44.925066Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.026669Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.027332Z INFO rusty_fume::runtime: Thread 5541959333092658992 finished!
2023-08-07T13:26:45.027379Z INFO rusty_fume: Replaying thread number 16
2023-08-07T13:26:45.128316Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.129036Z INFO rusty_fume::runtime: Thread 5976007889327647988 finished!
2023-08-07T13:26:45.129142Z INFO rusty_fume: Replaying thread number 17
2023-08-07T13:26:45.330320Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.432373Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.432538Z INFO rusty_fume::runtime: Thread 15653553972073346676 finished!
2023-08-07T13:26:45.432634Z INFO rusty_fume: Replaying thread number 18
2023-08-07T13:26:45.534311Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.635932Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.736650Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:45.736716Z INFO rusty_fume::runtime: Thread 4721092113589092935 finished!
2023-08-07T13:26:45.737366Z INFO rusty_fume: Replaying thread number 19
2023-08-07T13:26:45.840374Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:46.043032Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:46.044477Z INFO rusty_fume::runtime: Thread 10522492759785971706 finished!
2023-08-07T13:26:46.044577Z INFO rusty_fume: Replaying thread number 20
2023-08-07T13:26:46.246377Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:46.449813Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:46.451282Z INFO rusty_fume::runtime: Thread 14993459358441164715 finished!
2023-08-07T13:26:46.451382Z INFO rusty_fume: Replaying thread number 21
2023-08-07T13:26:46.652687Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:46.754533Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:46.755145Z INFO rusty_fume::runtime: Thread 17405081814273227293 finished!
2023-08-07T13:26:46.755199Z INFO rusty_fume: Replaying thread number 22
2023-08-07T13:26:46.756887Z INFO rusty_fume::runtime: Thread 16769786203160452232 finished!
2023-08-07T13:26:46.756931Z INFO rusty_fume: Replaying thread number 23
2023-08-07T13:26:46.958151Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.060973Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.161777Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.162615Z INFO rusty_fume::runtime: Thread 1519316551754114504 finished!
2023-08-07T13:26:47.162758Z INFO rusty_fume: Replaying thread number 24
2023-08-07T13:26:47.263374Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.264713Z INFO rusty_fume::runtime: Thread 3382437486985591535 finished!
2023-08-07T13:26:47.264836Z INFO rusty_fume: Replaying thread number 25
2023-08-07T13:26:47.466315Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.468233Z INFO rusty_fume::runtime: Thread 2873440350205830811 finished!
2023-08-07T13:26:47.468308Z INFO rusty_fume: Replaying thread number 26
2023-08-07T13:26:47.469967Z INFO rusty_fume::runtime: Thread 7844899624993723981 finished!
2023-08-07T13:26:47.470008Z INFO rusty_fume: Replaying thread number 27
2023-08-07T13:26:47.671942Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.774301Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:47.775255Z INFO rusty_fume::runtime: Thread 4709395785541881355 finished!
2023-08-07T13:26:47.775309Z INFO rusty_fume: Replaying thread number 28
2023-08-07T13:26:47.979165Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.081329Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.081974Z INFO rusty_fume::runtime: Thread 1547415939807221546 finished!
2023-08-07T13:26:48.082076Z INFO rusty_fume: Replaying thread number 29
2023-08-07T13:26:48.284155Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.387359Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.388110Z INFO rusty_fume::runtime: Thread 9411937598474493351 finished!
2023-08-07T13:26:48.388278Z INFO rusty_fume: Replaying thread number 30
2023-08-07T13:26:48.590126Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.692337Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.794879Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:48.998221Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.099894Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.201674Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.303508Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.303601Z INFO rusty_fume::runtime: Thread 1586218270863528083 finished!
2023-08-07T13:26:49.303644Z INFO rusty_fume: Replaying thread number 31
2023-08-07T13:26:49.405789Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.507883Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.509348Z INFO rusty_fume::runtime: Thread 13503647226495983558 finished!
2023-08-07T13:26:49.509466Z INFO rusty_fume: Replaying thread number 32
2023-08-07T13:26:49.611435Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.612821Z INFO rusty_fume::runtime: Thread 4671183077235863619 finished!
2023-08-07T13:26:49.612961Z INFO rusty_fume: Replaying thread number 33
2023-08-07T13:26:49.815871Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.817183Z INFO rusty_fume::runtime: Thread 1371620847326427601 finished!
2023-08-07T13:26:49.817231Z INFO rusty_fume: Replaying thread number 34
2023-08-07T13:26:49.918371Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:49.919661Z INFO rusty_fume::runtime: Thread 4517707841361167117 finished!
2023-08-07T13:26:49.919776Z INFO rusty_fume: Replaying thread number 35
2023-08-07T13:26:50.120444Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.221579Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.322307Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.322416Z INFO rusty_fume::runtime: Thread 8605515186933043765 finished!
2023-08-07T13:26:50.322466Z INFO rusty_fume: Replaying thread number 36
2023-08-07T13:26:50.424850Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.526351Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.526539Z INFO rusty_fume::runtime: Thread 17637110671089812952 finished!
2023-08-07T13:26:50.526591Z INFO rusty_fume: Replaying thread number 37
2023-08-07T13:26:50.729523Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.832098Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:50.833545Z INFO rusty_fume::runtime: Thread 7195028168409579882 finished!
2023-08-07T13:26:50.833632Z INFO rusty_fume: Replaying thread number 38
2023-08-07T13:26:50.935448Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.038345Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.140037Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.142066Z INFO rusty_fume::runtime: Thread 7518139998283903192 finished!
2023-08-07T13:26:51.142137Z INFO rusty_fume: Replaying thread number 39
2023-08-07T13:26:51.345490Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.447476Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.548439Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.549864Z INFO rusty_fume::runtime: Thread 7757994157210059796 finished!
2023-08-07T13:26:51.549941Z INFO rusty_fume: Replaying thread number 40
2023-08-07T13:26:51.552112Z INFO rusty_fume::runtime: Thread 17236464683879564318 finished!
2023-08-07T13:26:51.552155Z INFO rusty_fume: Replaying thread number 41
2023-08-07T13:26:51.754358Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.856852Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.958444Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:51.958602Z INFO rusty_fume::runtime: Thread 4579410187419480937 finished!
2023-08-07T13:26:51.958748Z INFO rusty_fume: Replaying thread number 42
2023-08-07T13:26:52.061839Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.164200Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.165105Z INFO rusty_fume::runtime: Thread 12084536263372381569 finished!
2023-08-07T13:26:52.165288Z INFO rusty_fume: Replaying thread number 43
2023-08-07T13:26:52.366560Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.468855Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.468961Z INFO rusty_fume::runtime: Thread 13267845135503875326 finished!
2023-08-07T13:26:52.469105Z INFO rusty_fume: Replaying thread number 44
2023-08-07T13:26:52.672079Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.674283Z INFO rusty_fume::runtime: Thread 14095236268208147648 finished!
2023-08-07T13:26:52.674361Z INFO rusty_fume: Replaying thread number 45
2023-08-07T13:26:52.776616Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.878747Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:52.878890Z INFO rusty_fume::runtime: Thread 2265902001278717117 finished!
2023-08-07T13:26:52.879001Z INFO rusty_fume: Replaying thread number 46
2023-08-07T13:26:52.980326Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.084120Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.185468Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.286348Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.286550Z INFO rusty_fume::runtime: Thread 8351848389776516736 finished!
2023-08-07T13:26:53.286680Z INFO rusty_fume: Replaying thread number 47
2023-08-07T13:26:53.387921Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.490206Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.591359Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.591477Z INFO rusty_fume::runtime: Thread 11055133408766461001 finished!
2023-08-07T13:26:53.591577Z INFO rusty_fume: Replaying thread number 48
2023-08-07T13:26:53.693409Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.794865Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.795739Z INFO rusty_fume::runtime: Thread 12328833133050384193 finished!
2023-08-07T13:26:53.795864Z INFO rusty_fume: Replaying thread number 49
2023-08-07T13:26:53.998400Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:53.999653Z INFO rusty_fume::runtime: Thread 12257839354779943738 finished!
2023-08-07T13:26:53.999750Z INFO rusty_fume: Replaying thread number 50
2023-08-07T13:26:54.203123Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:54.304952Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:54.305092Z INFO rusty_fume::runtime: Thread 14811588821500915201 finished!
2023-08-07T13:26:54.305139Z INFO rusty_fume: Replaying thread number 51
2023-08-07T13:26:54.507807Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:54.509185Z INFO rusty_fume::runtime: Thread 15800296833646195744 finished!
2023-08-07T13:26:54.509267Z INFO rusty_fume: Replaying thread number 52
2023-08-07T13:26:54.711212Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:54.812718Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:54.812810Z INFO rusty_fume::runtime: Thread 2071995578023942911 finished!
2023-08-07T13:26:54.812854Z INFO rusty_fume: Replaying thread number 53
2023-08-07T13:26:55.014927Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.116990Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.219013Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.219143Z INFO rusty_fume::runtime: Thread 4132786662978632799 finished!
2023-08-07T13:26:55.219276Z INFO rusty_fume: Replaying thread number 54
2023-08-07T13:26:55.320397Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.421830Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.522451Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.522560Z INFO rusty_fume::runtime: Thread 15495802875491095503 finished!
2023-08-07T13:26:55.522662Z INFO rusty_fume: Replaying thread number 55
2023-08-07T13:26:55.623347Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.725885Z INFO rusty_fume::runtime: Thread 220879235323835173 finished!
2023-08-07T13:26:55.726027Z INFO rusty_fume: Replaying thread number 56
2023-08-07T13:26:55.728793Z INFO rusty_fume::runtime: Thread 3538234330904966877 finished!
2023-08-07T13:26:55.728833Z INFO rusty_fume: Replaying thread number 57
2023-08-07T13:26:55.830919Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:55.832273Z INFO rusty_fume::runtime: Thread 13956054399699277110 finished!
2023-08-07T13:26:55.832323Z INFO rusty_fume: Replaying thread number 58
2023-08-07T13:26:56.033311Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.035246Z INFO rusty_fume::runtime: Thread 1712557576970823718 finished!
2023-08-07T13:26:56.035294Z INFO rusty_fume: Replaying thread number 59
2023-08-07T13:26:56.136482Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.339434Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.441035Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.442132Z INFO rusty_fume::runtime: Thread 9937024710725923817 finished!
2023-08-07T13:26:56.442200Z INFO rusty_fume: Replaying thread number 60
2023-08-07T13:26:56.545196Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.646346Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.646482Z INFO rusty_fume::runtime: Thread 15095098896995369373 finished!
2023-08-07T13:26:56.646538Z INFO rusty_fume: Replaying thread number 61
2023-08-07T13:26:56.747691Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.848372Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:56.849421Z INFO rusty_fume::runtime: Thread 11480774923924531102 finished!
2023-08-07T13:26:56.849471Z INFO rusty_fume: Replaying thread number 62
2023-08-07T13:26:56.950562Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.052369Z INFO rusty_fume::runtime: Thread 5938456629384362708 finished!
2023-08-07T13:26:57.052423Z INFO rusty_fume: Replaying thread number 63
2023-08-07T13:26:57.153492Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.355983Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.457468Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.457574Z INFO rusty_fume::runtime: Thread 14811215522874725701 finished!
2023-08-07T13:26:57.457629Z INFO rusty_fume: Replaying thread number 64
2023-08-07T13:26:57.559301Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.660340Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.762609Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.863772Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:57.863864Z INFO rusty_fume::runtime: Thread 2992438552237847936 finished!
2023-08-07T13:26:57.863919Z INFO rusty_fume: Replaying thread number 65
2023-08-07T13:26:57.964500Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.065308Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.168027Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.169341Z INFO rusty_fume::runtime: Thread 12444898062389217717 finished!
2023-08-07T13:26:58.169404Z INFO rusty_fume: Replaying thread number 66
2023-08-07T13:26:58.270771Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.371774Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.374226Z INFO rusty_fume::runtime: Thread 17432717442253089337 finished!
2023-08-07T13:26:58.374327Z INFO rusty_fume: Replaying thread number 67
2023-08-07T13:26:58.476392Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.578623Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.679316Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.679510Z INFO rusty_fume::runtime: Thread 4364113054349241259 finished!
2023-08-07T13:26:58.679575Z INFO rusty_fume: Replaying thread number 68
2023-08-07T13:26:58.781025Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.882181Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.984650Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:58.985524Z INFO rusty_fume::runtime: Thread 12220914761411493594 finished!
2023-08-07T13:26:58.985576Z INFO rusty_fume: Replaying thread number 69
2023-08-07T13:26:59.086370Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.288828Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.288933Z INFO rusty_fume::runtime: Thread 9363714573170156895 finished!
2023-08-07T13:26:59.289022Z INFO rusty_fume: Replaying thread number 70
2023-08-07T13:26:59.391067Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.492342Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.595230Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.596386Z INFO rusty_fume::runtime: Thread 476821997332550629 finished!
2023-08-07T13:26:59.596442Z INFO rusty_fume: Replaying thread number 71
2023-08-07T13:26:59.698764Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.801226Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:26:59.801810Z INFO rusty_fume::runtime: Thread 5338808762035985575 finished!
2023-08-07T13:26:59.801898Z INFO rusty_fume: Replaying thread number 72
2023-08-07T13:27:00.005119Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.005852Z INFO rusty_fume::runtime: Thread 4414984146604121719 finished!
2023-08-07T13:27:00.005905Z INFO rusty_fume: Replaying thread number 73
2023-08-07T13:27:00.107368Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.309433Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.309962Z INFO rusty_fume::runtime: Thread 16110718262384301974 finished!
2023-08-07T13:27:00.310008Z INFO rusty_fume: Replaying thread number 74
2023-08-07T13:27:00.410512Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.511339Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.513027Z INFO rusty_fume::runtime: Thread 9728474200800410624 finished!
2023-08-07T13:27:00.513092Z INFO rusty_fume: Replaying thread number 75
2023-08-07T13:27:00.615384Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.716328Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.818594Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:00.818714Z INFO rusty_fume::runtime: Thread 17656124617726201131 finished!
2023-08-07T13:27:00.818758Z INFO rusty_fume: Replaying thread number 76
2023-08-07T13:27:00.919999Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.123064Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.123158Z INFO rusty_fume::runtime: Thread 12970962113136038458 finished!
2023-08-07T13:27:01.123238Z INFO rusty_fume: Replaying thread number 77
2023-08-07T13:27:01.225440Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.327876Z INFO rusty_fume::runtime: Thread 13471896623984375401 finished!
2023-08-07T13:27:01.327962Z INFO rusty_fume: Replaying thread number 78
2023-08-07T13:27:01.428484Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.430508Z INFO rusty_fume::runtime: Thread 8746204660917471019 finished!
2023-08-07T13:27:01.430650Z INFO rusty_fume: Replaying thread number 79
2023-08-07T13:27:01.531652Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.633366Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.633499Z INFO rusty_fume::runtime: Thread 12297321725168079615 finished!
2023-08-07T13:27:01.633649Z INFO rusty_fume: Replaying thread number 80
2023-08-07T13:27:01.734547Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.936755Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:01.937535Z INFO rusty_fume::runtime: Thread 17136610836649429781 finished!
2023-08-07T13:27:01.937651Z INFO rusty_fume: Replaying thread number 81
2023-08-07T13:27:02.038319Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.141080Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.141188Z INFO rusty_fume::runtime: Thread 4338127282943302118 finished!
2023-08-07T13:27:02.141308Z INFO rusty_fume: Replaying thread number 82
2023-08-07T13:27:02.244258Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.345502Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.346251Z INFO rusty_fume::runtime: Thread 14164248274719047313 finished!
2023-08-07T13:27:02.346408Z INFO rusty_fume: Replaying thread number 83
2023-08-07T13:27:02.447391Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.449649Z INFO rusty_fume::runtime: Thread 4701798198575260760 finished!
2023-08-07T13:27:02.449697Z INFO rusty_fume: Replaying thread number 84
2023-08-07T13:27:02.550672Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.651901Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.752548Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.753205Z INFO rusty_fume::runtime: Thread 11144812233845153240 finished!
2023-08-07T13:27:02.753286Z INFO rusty_fume: Replaying thread number 85
2023-08-07T13:27:02.854908Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:02.956624Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.057441Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.057568Z INFO rusty_fume::runtime: Thread 10281690011659925808 finished!
2023-08-07T13:27:03.057729Z INFO rusty_fume: Replaying thread number 86
2023-08-07T13:27:03.160178Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.261503Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.363556Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.466105Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.466238Z INFO rusty_fume::runtime: Thread 6051361463926102834 finished!
2023-08-07T13:27:03.466368Z INFO rusty_fume: Replaying thread number 87
2023-08-07T13:27:03.568274Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.670071Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.771850Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.873064Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.975030Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:03.975143Z INFO rusty_fume::runtime: Thread 9813139711505774687 finished!
2023-08-07T13:27:03.975194Z INFO rusty_fume: Replaying thread number 88
2023-08-07T13:27:04.076643Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.177348Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.278909Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.380118Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.481650Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.583029Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.683438Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.784604Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.784707Z INFO rusty_fume::runtime: Thread 689813010201241724 finished!
2023-08-07T13:27:04.784763Z INFO rusty_fume: Replaying thread number 89
2023-08-07T13:27:04.886262Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:04.988020Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:05.090022Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:05.192116Z ERROR rusty_fume::mqtt: Timeout: Elapsed(())
2023-08-07T13:27:05.228797Z ERROR rusty_fume::mqtt: Receive error: Os { code: 104, kind: ConnectionReset, message: "Connection reset by peer" }
2023-08-07T13:27:05.228835Z ERROR rusty_fume::markov: Receive error, probably disconnected by the broker...
2023-08-07T13:27:05.229016Z INFO rusty_fume::runtime: Thread 15563177320211576171 finished!
2023-08-07T13:27:05.229092Z INFO rusty_fume: Replaying thread number 90
2023-08-07T13:27:05.229169Z INFO rusty_fume::process_monitor: Broker process exited with status: signal: 6 (SIGABRT) (core dumped)
2023-08-07T13:27:05.229192Z INFO rusty_fume::process_monitor: Last stdout: "2023-08-07 15:27:03 [105651] DEBUG /home/benedikt/.cache/paru/clone/nanomq-git/src/nanomq/nanomq/pub_handler.c:86 init_pipe_content: pub_handler: init pipe_info"
2023-08-07T13:27:05.229211Z INFO rusty_fume::process_monitor: Last stderr: "panic: pthread_mutex_lock: Invalid argumentThis message is indicative of a BUG.Report this at https://github.com/emqx/nanomqnanomq(nni_panic+0x117) [0x555cdb377757]nanomq(nni_task_wait+0x21) [0x555cdb37cc01]nanomq(+0x59ef5) [0x555cdb38bef5]nanomq(+0x4583b) [0x555cdb37783b]nanomq(+0x4639a) [0x555cdb37839a]nanomq(+0x4afeb) [0x555cdb37cfeb]nanomq(+0x4d8a6) [0x555cdb37f8a6]/usr/lib/libc.so.6(+0x8c9eb) [0x7f1ecfc8c9eb]/usr/lib/libc.so.6(+0x11123c) [0x7f1ecfd1123c]"
2023-08-07T13:27:05.229335Z INFO rusty_fume::runtime: Thread 161917673895891573 finished!
2023-08-07T13:27:05.229394Z INFO rusty_fume: Crashing seed found!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment