Skip to content

Instantly share code, notes, and snippets.

@liu-chunmei

liu-chunmei/metrics.md

Last active August 28, 2021 08:39
Show Gist options
  • Save liu-chunmei/f2a1960ed096a6fbba4826fb56953f43 to your computer and use it in GitHub Desktop.
Save liu-chunmei/f2a1960ed096a6fbba4826fb56953f43 to your computer and use it in GitHub Desktop.
Download ZIP
crimson-osd rados bench metrics
Raw
metrics.md

crimson profiling by rados bench metrics

Scenario

  • 4 KB rados bench test, total 10 round, each round 600s.
  • single OSD instance
  • deployed by vstart.sh
  • crimson-seastore

version

master (commit ID bd94f885ab22c9974301f1caca91aea37ecc8edc )+ #42957

crimson Build configuration

./do_cmake.sh -DWITH_SEASTAR=ON -DWITH_MGR_DASHBOARD_FRONTEND=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo

crimson Deployment

 [build]$ MGR=0 MON=1 OSD=1 MDS=0 RGW=0 ../src/vstart.sh -n -x --without-dashboard --seastore --crimson --nodaemon --redirect-output
 
 [build]$ bin/ceph osd pool create rbd 128 128 && bin/ceph osd pool set --yes-i-really-mean-it rbd size 1 && bin/ceph osd pool --yes-i-really-mean-it set rbd min_size 1 
 
 [build]$ ../../cbt/tools/crimson/seastore_radosbench_run.sh ( set TOTAL_ROUND=10 and BENCH_SECONDS=600)
 [build]$ ../../cbt/tools/crimson/seastore_radosbench_analyze.py
...

Cache basics

cache_usage

cache_hit_access_ratio_by_src

Tree basics

tree_depth

tree_operations

Transaction invalidate/commit ratio by src

trans_invalidate_committed_ratio_by_src---inaccurate

Transaction invalidate/commit ratio for each src, elaborated by the extent-type that caused the conflicts

trans_invalidate_committed_ratio_by_extent---MUTATE

trans_invalidate_committed_ratio_by_extent---READ

trans_invalidate_committed_ratio_by_extent---CLEANER

Transaction invalidated/committed effort ratio for each src

trans_invalidate_committed_ratio_by_effort---accurate---CLEANER

trans_invalidate_committed_ratio_by_effort---accurate---MUTATE

trans_invalidate_committed_ratio_by_effort---accurate---READ

Write amplification at different layers

write_amplification_overall

Write amplification at FRESH_EXTENTS+DELTA layer, elaborated by src, and elaborated by the extent-type that was committed

write_amplification_by_extent---MUTATE

write_amplification_by_extent---CLEANER

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment