Created
October 9, 2017 14:34
-
-
Save rzarzynski/d92fc4626f9713a4e4276751bf80554e to your computer and use it in GitHub Desktop.
Ceph BlueStore KV infra: stalled cycles analysis
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Samples: 57K of event 'cycle_activity.stalls_l1d_miss', Event count (approx.): 114520171780, Thread | |
| Children Self Command Shared Object Symbol ▒ | |
| - 14,41% 0,30% bstore_kv_sync libfio_ceph_objectstore.so [.] BlueStore::_kv_sync_thread ◆ | |
| - 14,11% BlueStore::_kv_sync_thread ▒ | |
| - 12,32% RocksDBStore::submit_transaction ▒ | |
| - 12,14% RocksDBStore::submit_common ▒ | |
| - 12,07% rocksdb::DBImpl::Write ▒ | |
| - rocksdb::DBImpl::WriteImpl ▒ | |
| - 10,72% rocksdb::WriteBatchInternal::InsertInto ▒ | |
| - 10,68% rocksdb::WriteBatch::Iterate ▒ | |
| - 10,21% rocksdb::MemTableInserter::PutCF ▒ | |
| - 10,13% rocksdb::MemTable::Add ▒ | |
| - 9,97% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparator ▒ | |
| - 9,91% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparat▒ | |
| - rocksdb::MemTable::KeyComparator::operator() ▒ | |
| - rocksdb::InternalKeyComparator::Compare ▒ | |
| 1,61% __memcmp_sse4_1 ▒ | |
| - 0,80% rocksdb::DBImpl::WriteToWAL ▒ | |
| - 0,78% rocksdb::log::Writer::AddRecord ▒ | |
| rocksdb::log::Writer::EmitPhysicalRecord ▒ | |
| - 0,81% RocksDBStore::submit_transaction_sync ▒ | |
| - 0,81% RocksDBStore::submit_common ▒ | |
| - 0,80% rocksdb::DBImpl::Write ▒ | |
| - rocksdb::DBImpl::WriteImpl ▒ | |
| - 0,74% rocksdb::DBImpl::WriteToWAL ▒ | |
| - 0,71% rocksdb::WritableFileWriter::Sync ▒ | |
| - rocksdb::WritableFileWriter::SyncInternal ▒ | |
| - BlueRocksWritableFile::Sync ▒ | |
| BlueFS::_fsync ▒ | |
| 0,57% BlueStore::_txc_applied_kv |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Samples: 100K of event 'cycle_activity.stalls_mem_any', Event count (approx.): 200218300327, Thread | |
| Children Self Command Shared Object Symbol ▒ | |
| - 10,94% 0,31% bstore_kv_sync libfio_ceph_objectstore.so [.] BlueStore::_kv_sync_thread ◆ | |
| - 10,63% BlueStore::_kv_sync_thread ▒ | |
| - 8,75% RocksDBStore::submit_transaction ▒ | |
| - 8,53% RocksDBStore::submit_common ▒ | |
| - 8,46% rocksdb::DBImpl::Write ▒ | |
| - 8,43% rocksdb::DBImpl::WriteImpl ▒ | |
| - 7,18% rocksdb::WriteBatchInternal::InsertInto ▒ | |
| - 7,14% rocksdb::WriteBatch::Iterate ▒ | |
| - 5,91% rocksdb::MemTableInserter::PutCF ▒ | |
| - 5,81% rocksdb::MemTable::Add ▒ | |
| - 5,59% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparator ▒ | |
| - 5,52% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparat▒ | |
| - rocksdb::MemTable::KeyComparator::operator() ▒ | |
| - rocksdb::InternalKeyComparator::Compare ▒ | |
| 1,09% __memcmp_sse4_1 ▒ | |
| - 1,11% rocksdb::MemTableInserter::MergeCF ▒ | |
| - 1,06% rocksdb::MemTable::Add ▒ | |
| - 0,91% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparator ▒ | |
| - 0,81% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparat▒ | |
| rocksdb::MemTable::KeyComparator::operator() ▒ | |
| + 0,75% rocksdb::DBImpl::WriteToWAL ▒ | |
| - 0,86% RocksDBStore::submit_transaction_sync ▒ | |
| - 0,85% RocksDBStore::submit_common ▒ | |
| - rocksdb::DBImpl::Write ▒ | |
| - rocksdb::DBImpl::WriteImpl ▒ | |
| - 0,79% rocksdb::DBImpl::WriteToWAL ▒ | |
| - 0,76% rocksdb::WritableFileWriter::Sync ▒ | |
| - 0,75% rocksdb::WritableFileWriter::SyncInternal ▒ | |
| - BlueRocksWritableFile::Sync ▒ | |
| 0,75% BlueFS::_fsync ▒ | |
| 0,56% BlueStore::_txc_applied_kv |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Samples: 915K of event 'cycles:p', Event count (approx.): 481010917757, Thread: bstore_kv_sync | |
| Children Self Command Shared Object Symbol ◆ | |
| - 12,67% 0,18% bstore_kv_sync libfio_ceph_objectstore.so [.] BlueStore::_kv_sync_thread ▒ | |
| - 12,49% BlueStore::_kv_sync_thread ▒ | |
| - 10,76% RocksDBStore::submit_transaction ▒ | |
| - 10,50% RocksDBStore::submit_common ▒ | |
| - 10,44% rocksdb::DBImpl::Write ▒ | |
| - 10,42% rocksdb::DBImpl::WriteImpl ▒ | |
| - 8,87% rocksdb::WriteBatchInternal::InsertInto ▒ | |
| - 8,82% rocksdb::WriteBatch::Iterate ▒ | |
| - 5,13% rocksdb::MemTableInserter::PutCF ▒ | |
| - 5,03% rocksdb::MemTable::Add ▒ | |
| - 4,75% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparator ▒ | |
| - 4,61% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparat▒ | |
| - rocksdb::MemTable::KeyComparator::operator() ▒ | |
| - rocksdb::InternalKeyComparator::Compare ▒ | |
| 0,92% __memcmp_sse4_1 ▒ | |
| - 3,44% rocksdb::MemTableInserter::MergeCF ▒ | |
| - 3,32% rocksdb::MemTable::Add ▒ | |
| - 3,00% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparator ▒ | |
| - 2,79% rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparat▒ | |
| - rocksdb::MemTable::KeyComparator::operator() ▒ | |
| 1,28% rocksdb::InternalKeyComparator::Compare ▒ | |
| + 0,95% rocksdb::DBImpl::WriteToWAL ▒ | |
| - 1,02% RocksDBStore::submit_transaction_sync ▒ | |
| - 1,00% RocksDBStore::submit_common ▒ | |
| - 1,00% rocksdb::DBImpl::Write ▒ | |
| - rocksdb::DBImpl::WriteImpl ▒ | |
| - 0,93% rocksdb::DBImpl::WriteToWAL ▒ | |
| - 0,90% rocksdb::WritableFileWriter::Sync ▒ | |
| - 0,89% rocksdb::WritableFileWriter::SyncInternal ▒ | |
| - 0,89% BlueRocksWritableFile::Sync ▒ | |
| 0,88% BlueFS::_fsync |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment