Skip to content

Instantly share code, notes, and snippets.

View aclamk's full-sized avatar

Adam Kupczyk aclamk

16 followers · 0 following
View GitHub Profile
@aclamk
aclamk / 16-reuse.txt
Last active September 14, 2022 12:18
16 AU per blob, reuse blobs
ITERATION 0
writing (to head) ...
H: [ ~ ]
H: [ ~ ~ ]
H: [ ~ ~ ~ ]
H: [ ~ ~ ~ ~ ]
snap...
objects:
H:[ A A A A ]
1:[ A A A A ]
@aclamk
aclamk / Onode dump
Created September 8, 2022 14:57
Dump of metadata from object named jedenmegabajt.
oid #3:defa039c:::jedenmegabajt:head#
spann 0 sb(153602)[!~1000,0xf5b000~1000,!~1000,0xf5d000~1000,!~1000,0xf5f000~1000,!~1000,0xf61000~1000,!~1000,0xf63000~1000,!~1000,0xf65000~1000,!~1000,0xf67000~1000,!~1000,0xf69000~1000]csum(64bytes)
spann 1 sb(153605)[!~1000,0xf8b000~1000,!~1000,0xf8d000~1000,!~1000,0xf8f000~1000,!~1000,0xf91000~1000,!~1000,0xf93000~1000,!~1000,0xf95000~1000,!~1000,0xf97000~1000,!~1000,0xf99000~1000]csum(64bytes)
spann 2 sb(153608)[!~1000,0xfbb000~1000,!~1000,0xfbd000~1000,!~1000,0xfbf000~1000,!~1000,0xfc1000~1000,!~1000,0xfc3000~1000,!~1000,0xfc5000~1000,!~1000,0xfc7000~1000,!~1000,0xfc9000~1000]csum(64bytes)
spann 3 sb(153611)[!~1000,0xfeb000~1000,!~1000,0xfed000~1000,!~1000,0xfef000~1000,!~1000,0xff1000~1000,!~1000,0xff3000~1000,!~1000,0xff5000~1000,!~1000,0xff7000~1000,!~1000,0xff9000~1000]csum(64bytes)
spann 4 sb(153614)[!~1000,0x101b000~1000,!~1000,0x101d000~1000,!~1000,0x101f000~1000,!~1000,0x1021000~1000,!~1000,0x1023000~1000,!~1000,0x1025000~1000,!~1000,0x1027000~1000,!~1000,0x
@aclamk
aclamk / Quincy.txt
Last active December 20, 2021 18:26
Quincy Bluestore PRs
must:
Fix ceph-bluestore-tool bluefs-import command
https://github.com/ceph/ceph/pull/44317
os/bluestore: BlueFS fine grain locking
https://github.com/ceph/ceph/pull/43794
os/bluestore: make shared blob fsck much less RAM-greedy.
https://github.com/ceph/ceph/pull/43667
@aclamk
aclamk / many-shared-blobs.sh
Created December 17, 2021 16:11
script to create many shared blobs
#!/bin/bash
MON=1 OSD=1 MDS=0 MGR=1 RGW=0 NFS=0 ../src/vstart.sh -l -n --without-dashboard
./bin/ceph osd pool create test_pool 64 --pg_num_min 64
export FIO=${FIO:-$(which fio)}
export TEST_SPACE="--size=60000M --nrfiles=15000"
export DISTR=pareto:0.30:0 #this gives 30% objects handle 70% requests
export TOTAL_TRANSFER=15000M
export IOSIZE="--bssplit=4k/16:8k/10:12k/9:16k/8:20k/7:24k/7:28k/6:32k/6:36k/5:40k/5:44k/4:48k/4:52k/4:56k/3:60k/3:64k/3"
@aclamk
aclamk / Store Alloc + compaction
Last active October 25, 2021 13:12
Scenario that makes it possible for Hybrid Allocator to fail, as in https://tracker.ceph.com/issues/52399
Scenario:
Compaction running during storing allocation.
Actual failure scenario is in case X).
S/W facts:
1) BlueFS frees allocations before syncing log
2) BlueFS umount syncs log
3) In store allocations procedure, we capture shared alloc first,
then we retrieve extents from BlueFS,
@aclamk
aclamk / unwindpmp
Created October 19, 2021 14:09
tracing tracer
Thread 3799051 (unwindpmp) - 1000 samples
+ 100.00% _start
+ 100.00% __libc_start_main
+ 100.00% main
+ 100.00% UwpmpTracer::trace_all()
+ 98.90% UwpmpTracer::trace(std::shared_ptr<UwpmpThread>)
|+ 72.70% _Ux86_64_get_proc_name
||+ 72.70% _Uelf64_get_proc_name
|| + 71.60% _Ux86_64_get_elf_image
|| |+ 48.30% __read
@aclamk
aclamk / bluefs_ buffered_io=false
Created August 20, 2021 15:12
Perf with bluefs lock refactor
iops-report:
iter write-iops write-ios write-cpu-used rw-iops rw-ios rw-cpu-used read-iops read-ios read-cpu-used
0 65810.659719 2425057 471906 37554.073730000004 2424491 449035 61628.481479 2427361 233153
1 65563.945946 2425866 500064 38438.498858 2424393 440985 69625.308465 2426442 218582
2 68203.65785 2423958 485993 40225.177423 2425900 440269 67247.154833 2422646 222419
3 68487.188904 2424378 490422 40693.268714 2426621 420636 56173.520631 2427314 232644
4 67532.522813 2427389 488866 40601.881298 2425800 436664 68882.252753 2426584 227644
5 65320.136721 2427035 511854 39465.402874 2427438 434344 65281.700753 2425868 228554
6 66416.349654 2426787 514238 39761.593312 2425656 435195 52724.07794 2424464 264621
7 64044.739482 2426399 519224 39960.187045 2426942 446666 63109.428661 2425674 231928
@aclamk
aclamk / 1osd-slow
Created April 15, 2021 17:50
wallclock snapshot when running 5k ops
This file has been truncated, but you can view the full file.
Thread: 389082 (ceph-osd) - 451 samples, time suspended=64ms
+ 100.00% _start
+ 100.00% __libc_start_main
+ 100.00% main
+ 100.00% AsyncMessenger::wait()
+ 100.00% std::condition_variable::wait(std::unique_lock<std::mutex>&)
+ 100.00% pthread_cond_wait
Thread: 389084 (log) - 451 samples, time suspended=49ms
@aclamk
aclamk / 1osd-fast
Created April 15, 2021 17:45
wallclock snapshot when running 20k ops
This file has been truncated, but you can view the full file.
Thread: 389082 (ceph-osd) - 498 samples, time suspended=54ms
+ 100.00% _start
+ 100.00% __libc_start_main
+ 100.00% main
+ 100.00% AsyncMessenger::wait()
+ 100.00% std::condition_variable::wait(std::unique_lock<std::mutex>&)
+ 100.00% pthread_cond_wait
Thread: 389084 (log) - 498 samples, time suspended=34ms
@aclamk
aclamk / ino16301.txt
Created March 3, 2021 18:43
ino 16301
2021-02-25 17:37:38.739 read 0x25b0c3a~1687
2021-02-25 17:37:40.367 prefetch 0x3d1a0af~2000
2021-02-25 17:37:40.374 prefetch 0x3d1b388~4000
2021-02-25 17:37:40.376 prefetch 0x3d1f0e0~8000
2021-02-25 17:37:40.378 prefetch 0x3d26cc7~10000
2021-02-25 17:37:40.378 prefetch 0x3d362f7~20000
2021-02-25 17:37:40.379 prefetch 0x3d55e23~40000
2021-02-25 17:37:40.383 prefetch 0x3d94d11~40000
2021-02-25 17:37:40.386 prefetch 0x3dd4453~40000
2021-02-25 17:37:40.387 prefetch 0x3e140ca~40000