Skip to content

Instantly share code, notes, and snippets.

@likid0

likid0/Ceph Bluestore Compression Perf Stats

Created August 27, 2019 10:58
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save likid0/9a0e6c7ff74f5ba59a86c369d6e7c14b to your computer and use it in GitHub Desktop.
Save likid0/9a0e6c7ff74f5ba59a86c369d6e7c14b to your computer and use it in GitHub Desktop.
Download ZIP
Ceph Bluestore Compression Perf Stats for the tests run with: 84 rbd volumes, 32 IO-Depth, 100% Random Write.
Raw
Ceph Bluestore Compression Perf Stats
These are the compression perf stats for the tests run with: 84 rbd volumes, 32 IO-Depth, 100% Random Write.
FIO config:
- LibRBD engine
- refill_buffers
- buffer_compress_percentage=80
- buffer_pattern=0xdeadfac
Ceph config:
- bluestore_compression_algorithm: snappy
- bluestore_compression_mode: aggressive
- bluestore_compression_required_ratio: .875
- bluestore min alloc size = 4096 (to achieve compression with 8kb blocks)
During the tests we reset the compress_success/rejected_count for each block size, so before we begin the tests with a new block size we set the counter to 0.
compress blocksize 4k stats start test:
####################################################
compress_success_count: 0,
compress_rejected_count: 0,
bluestore_compressed_allocated: 0,
bluestore_compressed_original: 0,
####################################################
compress blocksize 4k stats end of test
compress_success_count: 0,
compress_rejected_count: 0,
bluestore_compressed_allocated: 0,
bluestore_compressed_original: 0,
####################################################
compress blocksize 8k stats start test:
####################################################
compress_success_count: 0,
compress_rejected_count: 0,
bluestore_compressed_allocated: 0,
bluestore_compressed_original: 0,
####################################################
compress blocksize 8k stats end of test
compress_success_count: 19323325,
compress_rejected_count: 0,
bluestore_compressed_allocated: 157603119104,
bluestore_compressed_original: 315206238208,
####################################################
compress blocksize 16k stats start test:
####################################################
compress_success_count: 19323325,
compress_rejected_count: 0,
bluestore_compressed_allocated: 157603119104,
bluestore_compressed_original: 315206238208,
####################################################
compress blocksize 16k stats end of test
compress_success_count: 30726540,
bluestore_compressed: 110591860382,
bluestore_compressed_allocated: 217387950080,
bluestore_compressed_original: 434775900160,
####################################################
compress blocksize 32k stats start test:
####################################################
compress_success_count: 30726540,
compress_rejected_count: 0,
bluestore_compressed_allocated: 217387950080,
bluestore_compressed_original: 434775900160,
####################################################
compress blocksize 32k stats end of test
compress_success_count: 43841972,
compress_rejected_count: 0,
bluestore_compressed_allocated: 273106227200,
bluestore_compressed_original: 546212454400,
####################################################
compress blocksize 1024k stats start test:
####################################################
compress_success_count: 43841972,
compress_rejected_count: 0,
bluestore_compressed_allocated: 273106227200,
bluestore_compressed_original: 546212454400,
####################################################
compress blocksize 1024k stats end of test:
compress_success_count: 71176320,
compress_rejected_count: 0,
bluestore_compressed_allocated: 309979492352,
bluestore_compressed_original: 619958984704,
####################################################
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment