Skip to content

Instantly share code, notes, and snippets.

@antonyc
Created May 14, 2022 09:56
Show Gist options
  • Save antonyc/8438eeaea4318183a26acd698aec2f55 to your computer and use it in GitHub Desktop.
Save antonyc/8438eeaea4318183a26acd698aec2f55 to your computer and use it in GitHub Desktop.
chapson quick paste
admin@zenith-us-stage-ps-2:~$ journalctl -u pageserver.service --since "2022-05-13 19:53:29" | grep -m1 "f36b7783b92cc5b06e9f76963526cea7" -A 40
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2022-05-13T19:53:29.714258Z INFO load tenantconf from /storage/pageserver/data/tenants/f36b7783b92cc5b06e9f76963526cea7/config
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2022-05-13T19:53:29.714354Z INFO saving tenantconf: save tenantconf to /storage/pageserver/data/tenants/f36b7783b92cc5b06e9f76963526cea7/config
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2022-05-13T19:53:29.715372Z WARN loading local timeline: unrecognized filename in timeline dir: 000000067F000040020000800A00000089EF-XXX__000000008007E8C1-00000000B4940549.temp
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2022-05-13T19:53:29.715530Z WARN loading local timeline: unrecognized filename in timeline dir: 000000067F000032AC000040040000000000-XXX__000000008007E8C1-00000000B4940549.temp
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2022-05-13T19:53:29.715551Z INFO loading local timeline: loaded layer map with 18 layers at 0/B4940548
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: Error: Failed to start pageserver
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: Caused by:
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 0: Failed to bootstrap timelines for tenant f36b7783b92cc5b06e9f76963526cea7
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 1: Failed to register new local timeline for tenant f36b7783b92cc5b06e9f76963526cea7
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2: Failed to load image layer /storage/pageserver/data/tenants/f36b7783b92cc5b06e9f76963526cea7/timelines/107e88c7131ca43fe32cd2da7f28363e/000000067F000040020000800A0000008000-000000067F000040020000801C0100000000__00000000B4940548
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 3: in-file summary does not match expected summary. actual = Summary { magic: 0, format_version: 0, tenantid: 00000000000000000000000000000000, timelineid: 00000000000000000000000000000000, key_range: Key { field1: 0, field2: 0, field3: 0, field4: 0, field5: 0, field6: 0 }..Key { field1: 0, field2: 0, field3: 0, field4: 0, field5: 0, field6: 0 }, lsn: 0/0, index_start_blk: 0, index_root_blk: 0 } expected = Summary { magic: 23136, format_version: 3, tenantid: f36b7783b92cc5b06e9f76963526cea7, timelineid: 107e88c7131ca43fe32cd2da7f28363e, key_range: Key { field1: 0, field2: 1663, field3: 16386, field4: 32778, field5: 0, field6: 32768 }..Key { field1: 0, field2: 1663, field3: 16386, field4: 32796, field5: 1, field6: 0 }, lsn: 0/B4940548, index_start_blk: 0, index_root_blk: 0 }
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: Stack backtrace:
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 0: pageserver::layered_repository::image_layer::ImageLayer::load_inner
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/layered_repository/image_layer.rs:298:21
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: pageserver::layered_repository::image_layer::ImageLayer::load
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/layered_repository/image_layer.rs:261:17
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 1: <pageserver::layered_repository::image_layer::ImageLayer as pageserver::layered_repository::storage_layer::Layer>::get_value_reconstruct_data
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/layered_repository/image_layer.rs:160:21
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 2: pageserver::layered_repository::LayeredTimeline::get_reconstruct_data
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/layered_repository.rs:1474:26
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: <pageserver::layered_repository::LayeredTimeline as pageserver::repository::Timeline>::get
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/layered_repository.rs:1076:9
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 3: pageserver::pgdatadir_mapping::DatadirTimeline<R>::get_current_logical_size_non_incremental
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/pgdatadir_mapping.rs:412:31
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 4: pageserver::pgdatadir_mapping::DatadirTimeline<R>::init_logical_size
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/pgdatadir_mapping.rs:72:13
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: pageserver::tenant_mgr::new_local_timeline
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/tenant_mgr.rs:351:5
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 5: pageserver::tenant_mgr::apply_timeline_remote_sync_status_updates
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/tenant_mgr.rs:433:30
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 6: pageserver::tenant_mgr::init_local_repositories
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/tenant_mgr.rs:402:9
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: pageserver::tenant_mgr::init_tenant_mgr
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/tenant_mgr.rs:102:5
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 7: pageserver::start_pageserver
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/bin/pageserver.rs:281:24
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: pageserver::main
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /home/circleci/project/pageserver/src/bin/pageserver.rs:210:9
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: 8: core::ops::function::FnOnce::call_once
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: at /rustc/db9d1b20bba1968c1ec1fc49616d4742c1725b4b/library/core/src/ops/function.rs:227:5
May 13 19:53:29 zenith-us-stage-ps-2.local pageserver[12668]: std::sys_common::backtrace::__rust_begin_short_backtrace
admin@zenith-us-stage-ps-2:~$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment