Skip to content

Instantly share code, notes, and snippets.

View jdurgin's full-sized avatar

Josh Durgin jdurgin

55 followers · 0 following
  • Red Hat
View GitHub Profile
@jdurgin
jdurgin / check_flushes.py
Created August 16, 2013 18:49
scripts to examine aio_flush and low-level request completion times for librbd
#!/usr/bin/python
from datetime import datetime
import re
import sys
class Transaction(object):
def __init__(self, addr, start):
self.comp_addr = addr
self.start = start
@jdurgin
jdurgin / gist:0d5af043875a346b153b
Created May 21, 2014 23:55
2014-05-21 15:23:44.072032 7f19b9294780 1 -- 10.214.135.104:0/1006508 --> 10.214.135.104:6805/6168 -- osd_op(client.4104.0:434 rbd_header.100824ffbd10 [notify 30~37] 3.1716c372 ondisk+read e8) v4 -- ?+0 0x1fe0980 con 0x1fda750
2014-05-21 15:23:44.072842 7f19b432d700 1 -- 10.214.135.104:0/1006508 <== osd.1 10.214.135.104:6805/6168 318 ==== watch-notify(c=12 v=37 i=34359738384 opcode=1) v1 ==== 30+0+0 (643206029 0 0) 0x7f198c000ac0 con 0x1fda750
2014-05-21 15:23:44.072868 7f19b432d700 1 -- 10.214.135.104:0/1006508 <== osd.1 10.214.135.104:6805/6168 319 ==== osd_op_reply(434 rbd_header.100824ffbd10 [notify 30~37] v0'0 uv37 ondisk = 0) v6 ==== 190+0+0 (299293982 0 0) 0x7f198c001040 con 0x1fda750
2014-05-21 15:23:44.072891 7f19b1a27700 1 -- 10.214.135.104:0/1006508 --> 10.214.135.104:6805/6168 -- osd_op(client.4104.0:435 rbd_header.100824ffbd10 [notify-ack 34359738384~37] 3.1716c372 read e8) v4 -- ?+0 0x7f19800067c0 con 0x1fda750
2014-05-21 15:23:44.073396 7f19b432d700 1 -- 10.214.135.104:0/1006508 <== osd.1
@jdurgin
jdurgin / gist:bf1dabc447c5d1ac8fd6
Created December 17, 2014 19:23
2014-12-17 09:10:12,453.453 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stderr:ERROR:radosgw_agent.sync:findi
2014-12-17 09:10:12,454.454 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stderr:ERROR:radosgw_agent.cli:error
2014-12-17 09:10:12,454.454 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stderr:Traceback (most recent call la
2014-12-17 09:10:12,454.454 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stderr: File "/home/ubuntu/cephtest/
POST
2014-12-17 09:10:12,454.454 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stderr: syncer.prepare()
2014-12-17 09:10:12,454.454 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stderr: File "/home/ubuntu/cephtest/
epare
2014-12-17 09:10:12,455.455 INFO:tasks.radosgw_agent.ubuntu@mira032.front.sepia.ceph.com.8000.syncdaemon.mira032.stder
@jdurgin
jdurgin / gist:d0603add73d6e692b7b4
Created December 18, 2014 19:36
2014-12-18T11:05:32.135 16105:DEBUG:boto:url = 'http://mira032.front.sepia.ceph.com:7280/admin/metadata/bucket.instance'
params={'key': u'mybar:r0z0.4140.1'}
headers={'Date': 'Thu, 18 Dec 2014 19:05:32 GMT', 'Content-Length': 0, 'Authorization': u'AWS 0te6NH5mcdcq0Tc5i8i2:c+4xrRMI0WabOjLGsS6N2VQ91Bw=', 'Use
r-Agent': 'Boto/2.34.0 Python/2.7.3 Linux/3.13.0-rc3-ceph-00048-gf48db1e'}
data=None
2014-12-18T11:05:32.135 16105:DEBUG:boto:Method: GET
2014-12-18T11:05:32.135 16105:DEBUG:boto:Path: /admin/metadata/bucket.instance?key=mybar%253Ar0z0.4140.1
2014-12-18T11:05:32.136 16105:DEBUG:boto:Data:
2014-12-18T11:05:32.136 16105:DEBUG:boto:Headers: {}
2014-12-18T11:05:32.136 16105:DEBUG:boto:Host: mira032.front.sepia.ceph.com:7280
@jdurgin
jdurgin / gist:ca28cb1805ded88c8835
Created February 12, 2015 19:02
2015-02-11T21:34:42.373 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
for result in self:
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
resurrect_traceback(result)
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
return func(*args, **kwargs)
File "/var/lib/teuthworker/src/ceph-qa-suite_giant/tasks/workunit.py", line 317, in _run_tests
'{tdir}/workunits.list'.format(tdir=testdir)).split('\0'))
@jdurgin
jdurgin / gist:8380f42d6846ebed7304
Last active December 3, 2015 03:23
teuthology-describe-suite
$ teuthology-describe-tests ~/ceph-qa-suite/suites/rbd/basic
+----------------------------------------------+---------------+-------------------------------------------------+
| path | facet | desc |
+----------------------------------------------+---------------+-------------------------------------------------+
| ├── % | | |
| ├── base | | |
| │ └── install.yaml | base | install ceph |
| ├── cachepool | | |
| │ ├── none.yaml | cachepool | default replicated pool |
| │ └── small.yaml
@jdurgin
jdurgin / gist:09711d5923b583f60afc
Created December 3, 2015 03:18
teuthology-describe-tests --combinations
$ teuthology-describe-tests -c --subset 3/10 ~/ceph-qa-suite/suites/rbd/basic
+------------------+---------+-----------+----------+-------+---------------+---------------+---------------------------------------------+
| subsuite depth 0 | base | cachepool | clusters | fs | msgr-failures | tasks | desc |
+------------------+---------+-----------+----------+-------+---------------+---------------+---------------------------------------------+
| basic | install | none | fixed-1 | btrfs | few | rbd_cli_tests | install ceph |
| | | | | | | | default replicated pool |
| | | | | | | | infrequent network fault injection |
| | | | | | | | basic rbd c
@jdurgin
jdurgin / gist:a546383b3f93354f4355
Created December 4, 2015 22:45
rbd suite combinations
+------------------+---------------------------+---------+--------------+-----------+----------+--------------+------------+-------+---------------+---------------------------------+-----------+----------------------------------+-------------------------------------------------+
| subsuite depth 0 | all | base | cache | cachepool | clusters | copy-on-read | features | fs | msgr-failures | tasks | thrashers | workloads | desc |
+------------------+---------------------------+---------+--------------+-----------+----------+--------------+------------+-------+---------------+---------------------------------+-----------+----------------------------------+-------------------------------------------------+
| basic | | install | | none | fixed-1 | | | btrfs | few | rbd_api_tests_old_format |
@jdurgin
jdurgin / slow_ops.py
Created December 9, 2016 21:29
osd slow ops
#!/usr/bin/python
from datetime import datetime
import re
import sys
class Transaction(object):
def __init__(self, tid, start):
self.tid = tid
self.start = start
@jdurgin
jdurgin / add_omap.py
Created May 17, 2018 17:34
#!/usr/bin/env python
from __future__ import print_function
from rados import Rados, WriteOpCtx
import os
import sys
def main(args):
if len(args) < 4:
print('usage: add_omap.py <pool> <start number> <end number> [keys_per_object]')
sys.exit(1)