Skip to content

Instantly share code, notes, and snippets.

@CyrilPeponnet

CyrilPeponnet/Htop mvdcgluster02 Secret

Last active October 7, 2015 15:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save CyrilPeponnet/ec1bcc743ac5a84debe8 to your computer and use it in GitHub Desktop.
Save CyrilPeponnet/ec1bcc743ac5a84debe8 to your computer and use it in GitHub Desktop.
Download ZIP
gluster fs setup
Raw
details.
[root@mvdcgluster03 ~]# gluster vol list
ansos
archive
beds_status
cloud_images
homedirs
usr_global
videos
virt_beds_mvdcgluster01
virt_beds_mvdcgluster02
virtbeds_storage_mvdcgluster01
virtbeds_storage_mvdcgluster02
[root@mvdcgluster03 ~]# gluster vol info
Volume Name: ansos
Type: Replicate
Volume ID: a0e41341-6765-435d-bfa9-6d4d65a11ad0
Status: Started
Number of Bricks: 1 x 3 = 3
Transport-type: tcp
Bricks:
Brick1: mvdcgluster01.us.alcatel-lucent.com:/export/raid/ansos
Brick2: mvdcgluster02.us.alcatel-lucent.com:/export/raid/ansos
Brick3: mvdcgluster03.us.alcatel-lucent.com:/export/raid/ansos
Options Reconfigured:
server.allow-insecure: on
diagnostics.client-log-level: CRITICAL
nfs.acl: off
server.outstanding-rpc-limit: 128
Volume Name: archive
Type: Distribute
Volume ID: d7020552-60f5-4b06-b546-dea27815c63c
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster03.us.alcatel-lucent.com:/export/raid/archive
Options Reconfigured:
nfs.acl: off
server.outstanding-rpc-limit: 128
Volume Name: beds_status
Type: Replicate
Volume ID: 1759aa03-9531-4b29-b671-cc798e2a5b47
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: mvdcgluster02.us.alcatel-lucent.com:/export/raid/beds_status
Brick2: mvdcgluster01.us.alcatel-lucent.com:/export/raid/beds_status
Options Reconfigured:
diagnostics.client-log-level: CRITICAL
nfs.addr-namelookup: off
nfs.acl: off
nfs.mount-rmtab: /-
server.outstanding-rpc-limit: 128
Volume Name: cloud_images
Type: Distribute
Volume ID: 3f8e1be6-2f40-45bf-93c9-f53d2a5d8b44
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster02.us.alcatel-lucent.com:/export/raid/cloud_images
Options Reconfigured:
nfs.acl: off
server.outstanding-rpc-limit: 128
Volume Name: homedirs
Type: Distribute
Volume ID: 15a4424b-d615-4f07-9b1f-983ef9023ac1
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster03.us.alcatel-lucent.com:/export/raid/homedirs
Options Reconfigured:
server.root-squash: on
nfs.mount-rmtab: /-
nfs.acl: off
nfs.addr-namelookup: off
diagnostics.client-log-level: CRITICAL
server.outstanding-rpc-limit: 128
Volume Name: usr_global
Type: Replicate
Volume ID: f8f5ef65-4678-47be-bcb1-6c3cdaef545e
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: mvdcgluster02.us.alcatel-lucent.com:/export/raid/usr_global
Brick2: mvdcgluster01.us.alcatel-lucent.com:/export/raid/usr_global
Options Reconfigured:
performance.cache-size: 4GB
performance.cache-refresh-timeout: 60
performance.cache-max-file-size: 50MB
nfs.volume-access: read-write
nfs.addr-namelookup: off
nfs.mount-rmtab: /-
nfs.enable-ino32: on
nfs.acl: off
server.root-squash: on
diagnostics.client-log-level: CRITICAL
performance.io-thread-count: 24
Volume Name: videos
Type: Distribute
Volume ID: 8731ff68-474a-4076-bb2c-d93608463057
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster03.us.alcatel-lucent.com:/export/raid/videos
Options Reconfigured:
nfs.acl: off
performance.quick-read: off
performance.stat-prefetch: off
server.outstanding-rpc-limit: 128
Volume Name: virt_beds_mvdcgluster01
Type: Distribute
Volume ID: 192f8e88-9901-4b66-9fd7-6c636a5cbe8a
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster01.us.alcatel-lucent.com:/export/raid/virt_beds_mvdcgluster01
Options Reconfigured:
nfs.acl: off
network.remote-dio: enable
cluster.eager-lock: on
performance.stat-prefetch: off
performance.io-cache: off
performance.read-ahead: off
performance.quick-read: off
diagnostics.client-log-level: CRITICAL
server.outstanding-rpc-limit: 128
Volume Name: virt_beds_mvdcgluster02
Type: Distribute
Volume ID: d390e761-27d1-4ab9-a0eb-11dbae05e81d
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster02.us.alcatel-lucent.com:/export/raid/virt_beds_mvdcgluster02
Options Reconfigured:
cluster.eager-lock: on
performance.stat-prefetch: off
performance.quick-read: off
performance.io-cache: off
performance.read-ahead: off
network.remote-dio: enable
nfs.acl: off
diagnostics.client-log-level: CRITICAL
server.outstanding-rpc-limit: 128
Volume Name: virtbeds_storage_mvdcgluster01
Type: Distribute
Volume ID: 1b9f00ae-822e-4d69-aed9-86a4cd60a25c
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster01.us.alcatel-lucent.com:/export/raid/virtbeds_storage_mvdcgluster01
Options Reconfigured:
nfs.acl: off
diagnostics.client-log-level: CRITICAL
cluster.eager-lock: on
cluster.readdir-optimize: on
performance.readdir-ahead: on
server.outstanding-rpc-limit: 128
Volume Name: virtbeds_storage_mvdcgluster02
Type: Distribute
Volume ID: 47f9b674-6807-4f76-b90a-d9e356b6d74f
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: mvdcgluster02.us.alcatel-lucent.com:/export/raid/virtbeds_storage_mvdcgluster02
Options Reconfigured:
diagnostics.count-fop-hits: on
diagnostics.latency-measurement: on
diagnostics.client-log-level: CRITICAL
nfs.acl: off
server.root-squash: off
cluster.eager-lock: on
cluster.readdir-optimize: on
performance.readdir-ahead: on
server.outstanding-rpc-limit: 128
performance.io-thread-count: 24
Most used vol are usr_global and virtbeds_storage_mvdcgluster01/02, here are some profiling info.
Raw
Htop mvdcgluster02
htop on mvdcgluster02
1 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 84.3%] 7 [||||||||||||||||||||||||||||||||||||||||||||||||| 68.8%] 13 [||||||||||||||||||||||||||||||||||||||||||||||||||||||| 78.1%] 19 [||||||||||||||||||||||||||||||||||||||||||||| 63.0%]
2 [|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 85.2%] 8 [|||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 81.7%] 14 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 84.3%] 20 [||||||||||||||||||||||||||||||||||||||||||||||||| 68.8%]
3 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 84.7%] 9 [|||||||||||||||||||||||||||||||||||||| 52.4%] 15 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 85.6%] 21 [||||||||||||||||||||||||||||||||||||||||||||||||||| 72.0%]
4 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 83.7%] 10 [|||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 81.8%] 16 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 82.5%] 22 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 79.8%]
5 [|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 83.8%] 11 [||||||||||||||||||||||||||||||||||||||||||||||||||| 71.4%] 17 [|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 84.2%] 23 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 81.8%]
6 [||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 85.4%] 12 [|||||||||||||||||||||||||||||||||||||||||| 58.5%] 18 [|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 84.8%] 24 [|||||||||||||||||||||||||||||||||||||||||||||||||||||| 75.5%]
Mem[|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||5252/64231MB] Tasks: 57, 179 thr; 26 running
Swp[||| 57/4095MB] Load average: 15.44 12.94 15.05
Uptime: 45 days, 20:28:19
PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command
11841 root 20 0 2358M 95328 2640 S 46.6 0.1 22h54:04 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11834 root 20 0 2358M 95328 2640 S 46.1 0.1 22h51:06 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11876 root 20 0 2358M 95328 2640 S 45.1 0.1 23h03:33 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11864 root 20 0 2358M 95328 2640 S 44.7 0.1 22h58:16 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11865 root 20 0 2358M 95328 2640 S 43.7 0.1 22h55:53 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11858 root 20 0 2358M 95328 2640 S 43.7 0.1 23h01:15 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11839 root 20 0 2358M 95328 2640 S 43.7 0.1 22h56:34 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11859 root 20 0 2358M 95328 2640 S 43.2 0.1 22h53:13 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11874 root 20 0 2358M 95328 2640 S 33.7 0.1 22h58:31 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11869 root 20 0 2358M 95328 2640 S 8.6 0.1 23h02:08 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11878 root 20 0 2358M 95328 2640 S 8.1 0.1 23h01:14 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11873 root 20 0 2358M 95328 2640 S 7.6 0.1 23h05:40 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11870 root 20 0 2358M 95328 2640 S 6.7 0.1 22h56:31 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11868 root 20 0 2358M 95328 2640 S 6.2 0.1 23h03:16 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11854 root 20 0 2358M 95328 2640 S 5.7 0.1 23h01:30 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
21861 root 20 0 1072M 433M 3096 S 5.2 0.7 3h45:51 /usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/09992295c98357e6e3f38df783793ca5.socket
11838 root 20 0 2358M 95328 2640 S 4.8 0.1 22h50:11 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11872 root 20 0 2358M 95328 2640 S 3.8 0.1 23h00:22 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11866 root 20 0 2358M 95328 2640 S 3.8 0.1 22h58:46 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11853 root 20 0 2358M 95328 2640 D 3.3 0.1 22h52:57 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11877 root 20 0 2358M 95328 2640 R 3.3 0.1 22h52:42 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
19426 root 20 0 1837M 42232 2196 S 2.4 0.1 88h27:15 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id ansos.mvdcgluster02.us.alcatel-lucent.com.export-raid-ansos -p /var/lib/glusterd/vols/ansos/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-ansos.pid -S /var/run/dff5096e4bce8ef4
11867 root 20 0 2358M 95328 2640 S 1.9 0.1 22h59:37 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
17681 root 20 0 121M 4256 1440 R 1.0 0.0 0:00.13 htop
21891 root 20 0 2296M 68568 2808 S 1.0 0.1 1h26:32 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21884 root 20 0 2296M 68568 2808 S 1.0 0.1 1h26:55 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21889 root 20 0 2296M 68568 2808 S 0.5 0.1 1h26:27 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21890 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:31 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21886 root 20 0 2296M 68568 2808 S 0.5 0.1 1h27:17 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21893 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:54 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21885 root 20 0 2296M 68568 2808 S 0.5 0.1 1h27:14 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21880 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:20 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21881 root 20 0 2296M 68568 2808 S 0.5 0.1 1h25:27 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21894 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:22 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21887 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:22 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21876 root 20 0 2296M 68568 2808 S 0.5 0.1 7:51.93 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21914 root 20 0 2296M 68568 2808 S 0.5 0.1 1h26:00 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21909 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:52 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21992 root 20 0 2296M 68568 2808 S 0.5 0.1 1h28:11 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
19868 root 20 0 744M 42420 2264 S 0.5 0.1 6:10.94 /usr/sbin/glusterfs -s localhost --volfile-id gluster/glustershd -p /var/lib/glusterd/glustershd/run/glustershd.pid -l /var/log/glusterfs/glustershd.log -S /var/run/cec345e62b871266f449db7300a6467f.socket --xlator-option *replicate*.node-uuid=c12353b5-f41
21879 root 20 0 2296M 68568 2808 S 0.5 0.1 1h27:27 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
31610 root 20 0 1837M 42232 2196 S 0.5 0.1 2h32:42 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id ansos.mvdcgluster02.us.alcatel-lucent.com.export-raid-ansos -p /var/lib/glusterd/vols/ansos/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-ansos.pid -S /var/run/dff5096e4bce8ef4
19507 root 20 0 1837M 42232 2196 S 0.5 0.1 3h13:09 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id ansos.mvdcgluster02.us.alcatel-lucent.com.export-raid-ansos -p /var/lib/glusterd/vols/ansos/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-ansos.pid -S /var/run/dff5096e4bce8ef4
19477 root 20 0 1837M 42232 2196 S 0.5 0.1 3h12:07 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id ansos.mvdcgluster02.us.alcatel-lucent.com.export-raid-ansos -p /var/lib/glusterd/vols/ansos/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-ansos.pid -S /var/run/dff5096e4bce8ef4
11806 root 20 0 2358M 95328 2640 S 0.0 0.1 561h /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11875 root 20 0 2358M 95328 2640 S 0.0 0.1 22h58:35 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11840 root 20 0 1358M 95328 2640 R 0.0 0.1 22h54:55 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
11871 root 20 0 2358M 95328 2640 S 0.0 0.1 22h56:25 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id usr_global.mvdcgluster02.us.alcatel-lucent.com.export-raid-usr_global -p /var/lib/glusterd/vols/usr_global/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-usr_global.pid -S /var/
21854 root 20 0 2296M 68568 2808 S 0.0 0.1 37h02:22 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21910 root 20 0 2296M 68568 2808 S 0.0 0.1 1h28:23 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21912 root 20 0 2296M 68568 2808 S 0.0 0.1 1h26:34 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21911 root 20 0 2296M 68568 2808 S 0.0 0.1 1h27:38 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21874 root 20 0 2296M 68568 2808 S 0.0 0.1 1h29:11 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21882 root 20 0 2296M 68568 2808 S 0.0 0.1 1h27:48 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21888 root 20 0 2296M 68568 2808 S 0.0 0.1 1h27:10 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21913 root 20 0 2296M 68568 2808 S 0.0 0.1 1h27:32 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21883 root 20 0 2296M 68568 2808 S 0.0 0.1 1h28:41 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
21895 root 20 0 2296M 68568 2808 S 0.0 0.1 1h26:26 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id virtbeds_storage_mvdcgluster02.mvdcgluster02.us.alcatel-lucent.com.export-raid-virtbeds_storage_mvdcgluster02 -p /var/lib/glusterd/vols/virtbeds_storage_mvdcgluster02/run/mvdcgluster
19614 root 20 0 1837M 42232 2196 S 0.0 0.1 3h12:15 /usr/sbin/glusterfsd -s mvdcgluster02.us.alcatel-lucent.com --volfile-id ansos.mvdcgluster02.us.alcatel-lucent.com.export-raid-ansos -p /var/lib/glusterd/vols/ansos/run/mvdcgluster02.us.alcatel-lucent.com-export-raid-ansos.pid -S /var/run/dff5096e4bce8ef4
Raw
IO profile
usr_global contains lot of small files and some qcow2 as backing files for vm (snapshots)
virtbeds_storage_mvdcgluster0X contains mostly snapshot qcow2.
As you can see on profile usr_global is READ a lot, virtbeds_storage_mvdcgluster0X WRITEN a lot.
Raw
usr_global profile
Brick: mvdcgluster03.us.alcatel-lucent.com:/export/raid/usr_global
------------------------------------------------------------------
Cumulative Stats:
Block Size: 1b+ 4b+ 8b+
No. of Reads: 13 17 171
No. of Writes: 13 222 432
Block Size: 16b+ 32b+ 64b+
No. of Reads: 30 100 8910
No. of Writes: 100 1608 16338
Block Size: 128b+ 256b+ 512b+
No. of Reads: 7319 2961 2317
No. of Writes: 12713 7277 7563
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 1665 1894 11790
No. of Writes: 5581 4563 3597
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 6939 11054 15477
No. of Writes: 3441 3661 4392
Block Size: 65536b+ 131072b+ 262144b+
No. of Reads: 35367 2346615 1210
No. of Writes: 5340 11514765 216
Block Size: 524288b+ 1048576b+
No. of Reads: 1368 162301
No. of Writes: 217 108983
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 161065 FORGET
0.00 0.00 us 0.00 us 0.00 us 2074434 RELEASE
0.00 0.00 us 0.00 us 0.00 us 810784 RELEASEDIR
0.00 11.00 us 11.00 us 11.00 us 2 SETATTR
0.00 18.42 us 10.00 us 28.00 us 12 READDIR
0.00 25.39 us 10.00 us 122.00 us 56 MKNOD
0.00 10.75 us 5.00 us 165.00 us 189 ACCESS
0.01 23.83 us 9.00 us 114.00 us 406 GETXATTR
0.03 44.61 us 8.00 us 2233.00 us 871 STATFS
0.04 8.35 us 4.00 us 273.00 us 4722 FLUSH
0.04 45.88 us 8.00 us 3058.00 us 1087 STAT
0.08 23.08 us 16.00 us 167.00 us 4091 READLINK
0.21 49.59 us 17.00 us 26400.00 us 4786 OPEN
0.36 746.33 us 7.00 us 169975.00 us 534 FSTAT
0.45 224.49 us 1.00 us 191301.00 us 2213 OPENDIR
2.22 486.16 us 6.00 us 271265.00 us 5062 MKDIR
2.97 1486.27 us 8.00 us 271284.00 us 2217 READ
5.67 401.69 us 5.00 us 500058.00 us 15682 ENTRYLK
7.68 2093.25 us 12.00 us 316058.00 us 4077 READDIRP
8.03 100.02 us 7.00 us 271279.00 us 89146 INODELK
10.54 676.18 us 57.00 us 190004.00 us 17306 WRITE
61.67 47.62 us 10.00 us 449645.00 us 1438297 LOOKUP
Duration: 170028 seconds
Data Read: 483328473529 bytes
Data Written: 1624686051206 bytes
Interval 18 Stats:
Block Size: 8192b+ 32768b+ 65536b+
No. of Reads: 2 1 7
No. of Writes: 0 0 0
Block Size: 131072b+
No. of Reads: 516
No. of Writes: 3381
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 48 FORGET
0.00 0.00 us 0.00 us 0.00 us 343 RELEASE
0.00 0.00 us 0.00 us 0.00 us 350 RELEASEDIR
0.00 15.00 us 11.00 us 19.00 us 2 READDIR
0.00 17.00 us 11.00 us 23.00 us 2 GETXATTR
0.00 8.00 us 8.00 us 8.00 us 5 ACCESS
0.00 13.00 us 10.00 us 21.00 us 11 MKNOD
0.01 22.45 us 8.00 us 110.00 us 69 STAT
0.01 26.43 us 10.00 us 76.00 us 80 STATFS
0.01 9.33 us 4.00 us 107.00 us 334 FLUSH
0.06 23.29 us 17.00 us 94.00 us 824 READLINK
0.40 351.87 us 21.00 us 26400.00 us 344 OPEN
0.47 411.65 us 2.00 us 26583.00 us 349 OPENDIR
0.78 3145.43 us 9.00 us 169975.00 us 76 FSTAT
3.49 974.91 us 6.00 us 271265.00 us 1091 MKDIR
4.31 1837.40 us 13.00 us 157695.00 us 714 READDIRP
6.66 581.22 us 6.00 us 271223.00 us 3489 ENTRYLK
7.93 4393.18 us 12.00 us 271284.00 us 550 READ
9.62 163.80 us 7.00 us 271279.00 us 17897 INODELK
10.47 943.05 us 59.00 us 157711.00 us 3381 WRITE
55.78 52.42 us 10.00 us 271265.00 us 324118 LOOKUP
Duration: 85 seconds
Data Read: 68275122 bytes
Data Written: 443154432 bytes
Brick: mvdcgluster01.us.alcatel-lucent.com:/export/raid/usr_global
------------------------------------------------------------------
Cumulative Stats:
Block Size: 1b+ 4b+ 8b+
No. of Reads: 13 1746 3782
No. of Writes: 0 1576 578
Block Size: 16b+ 32b+ 64b+
No. of Reads: 25092 51160 59288
No. of Writes: 575 10130 144168
Block Size: 128b+ 256b+ 512b+
No. of Reads: 59108 25067 135770
No. of Writes: 100741 401385 566681
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 224941 206135324 2539473
No. of Writes: 349461 49624 36760
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 2396315 1760796 812004
No. of Writes: 53198 58321 125855
Block Size: 65536b+ 131072b+ 262144b+
No. of Reads: 1933509 173791399 1536518
No. of Writes: 111824 1550296 26078
Block Size: 524288b+ 1048576b+
No. of Reads: 1134127 19611183
No. of Writes: 30228 6506594
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 26624408 FORGET
0.00 0.00 us 0.00 us 0.00 us 86463931 RELEASE
0.00 0.00 us 0.00 us 0.00 us 30579695 RELEASEDIR
0.00 57.50 us 29.00 us 86.00 us 2 SETATTR
0.00 42.55 us 14.00 us 441.00 us 387 GETXATTR
0.00 76.48 us 13.00 us 548.00 us 331 FSTAT
0.01 27.18 us 4.00 us 1454.00 us 4488 FLUSH
0.03 467.01 us 6.00 us 247505.00 us 569 ACCESS
0.03 50.79 us 18.00 us 1653.00 us 7108 READLINK
0.04 98.03 us 25.00 us 87558.00 us 4549 OPEN
0.06 452.24 us 9.00 us 464073.00 us 1332 STATFS
0.07 324.18 us 18.00 us 38166.00 us 2318 OPENDIR
0.08 448.67 us 7.00 us 362097.00 us 1888 STAT
1.43 17106.94 us 16.00 us 3987787.00 us 871 READDIRP
6.67 3830.71 us 15.00 us 3233930.00 us 18159 READ
9.57 4717.25 us 9.00 us 2787988.00 us 21142 ENTRYLK
17.67 2142.99 us 9.00 us 3233803.00 us 85989 INODELK
64.33 476.39 us 16.00 us 3554904.00 us 1407791 LOOKUP
Duration: 3736599 seconds
Data Read: 45350996156210 bytes
Data Written: 7079562097685 bytes
Interval 18 Stats:
Block Size: 512b+ 1024b+ 2048b+
No. of Reads: 4 25 1
No. of Writes: 0 0 0
Block Size: 4096b+ 8192b+ 16384b+
No. of Reads: 2 8 4
No. of Writes: 0 0 0
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 17 17 3404
No. of Writes: 0 0 0
Block Size: 262144b+ 524288b+ 1048576b+
No. of Reads: 17 44 1025
No. of Writes: 0 0 0
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 386 RELEASE
0.00 0.00 us 0.00 us 0.00 us 385 RELEASEDIR
0.00 71.28 us 48.00 us 156.00 us 74 FSTAT
0.00 30.44 us 6.00 us 98.00 us 176 ACCESS
0.01 36.78 us 6.00 us 1204.00 us 377 FLUSH
0.01 81.26 us 13.00 us 218.00 us 210 STATFS
0.02 51.38 us 7.00 us 357.00 us 460 STAT
0.07 50.53 us 21.00 us 680.00 us 2060 READLINK
0.12 477.57 us 20.00 us 27363.00 us 384 OPENDIR
0.13 529.38 us 29.00 us 87558.00 us 387 OPEN
0.77 7188.19 us 16.00 us 95548.00 us 168 READDIRP
8.56 2931.39 us 15.00 us 669991.00 us 4568 READ
12.90 4194.26 us 9.00 us 670751.00 us 4811 ENTRYLK
18.79 1641.57 us 10.00 us 1265702.00 us 17899 INODELK
58.62 282.56 us 16.00 us 1265255.00 us 324476 LOOKUP
Duration: 85 seconds
Data Read: 1561937784 bytes
Data Written: 0 bytes
Brick: mvdcgluster02.us.alcatel-lucent.com:/export/raid/usr_global
------------------------------------------------------------------
Cumulative Stats:
Block Size: 1b+ 4b+ 8b+
No. of Reads: 0 18 249
No. of Writes: 13 1701 980
Block Size: 16b+ 32b+ 64b+
No. of Reads: 54 184 4195
No. of Writes: 642 11075 153808
Block Size: 128b+ 256b+ 512b+
No. of Reads: 6875 8165 62389
No. of Writes: 108511 391996 551254
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 12326 11330 554780
No. of Writes: 340604 51964 39198
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 730401 85643 108218
No. of Writes: 54164 59395 124925
Block Size: 65536b+ 131072b+ 262144b+
No. of Reads: 332006 128511432 16262
No. of Writes: 112557 12932210 24746
Block Size: 524288b+ 1048576b+
No. of Reads: 15314 1883329
No. of Writes: 28521 6186781
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 22662075 FORGET
0.00 0.00 us 0.00 us 0.00 us 65009817 RELEASE
0.00 0.00 us 0.00 us 0.00 us 28358160 RELEASEDIR
0.00 28.00 us 28.00 us 28.00 us 2 SETATTR
0.00 26.88 us 7.00 us 330.00 us 276 ACCESS
0.00 73.30 us 12.00 us 549.00 us 771 FSTAT
0.00 85.99 us 11.00 us 640.00 us 872 STAT
0.00 85.36 us 11.00 us 459.00 us 1313 STATFS
0.01 49.04 us 20.00 us 849.00 us 3865 READLINK
0.03 63.22 us 18.00 us 1111.00 us 10811 GETXATTR
0.11 517.47 us 4.00 us 1284906.00 us 4610 FLUSH
0.12 569.76 us 25.00 us 2233115.00 us 4669 OPEN
0.12 4740.50 us 34.00 us 185529.00 us 590 READDIR
0.27 2755.84 us 16.00 us 2232282.00 us 2241 OPENDIR
1.12 8297.41 us 15.00 us 1032636.00 us 3043 READ
5.43 37085.31 us 15.00 us 3098471.00 us 3293 READDIRP
10.51 14343.59 us 62.00 us 2433267.00 us 16465 WRITE
12.72 13498.99 us 8.00 us 2893858.00 us 21173 ENTRYLK
16.27 4310.83 us 9.00 us 2893272.00 us 84833 INODELK
53.28 862.06 us 15.00 us 3159425.00 us 1389104 LOOKUP
Duration: 3435711 seconds
Data Read: 18884003605048 bytes
Data Written: 8234232111210 bytes
Interval 18 Stats:
Block Size: 512b+ 1024b+ 4096b+
No. of Reads: 9 14 1
No. of Writes: 0 0 0
Block Size: 131072b+
No. of Reads: 613
No. of Writes: 3382
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 18 FORGET
0.00 0.00 us 0.00 us 0.00 us 386 RELEASE
0.00 0.00 us 0.00 us 0.00 us 385 RELEASEDIR
0.00 29.55 us 7.00 us 212.00 us 73 ACCESS
0.00 66.09 us 12.00 us 208.00 us 143 FSTAT
0.00 84.50 us 13.00 us 357.00 us 210 STATFS
0.00 89.43 us 14.00 us 640.00 us 221 STAT
0.01 50.46 us 23.00 us 849.00 us 793 READLINK
0.01 82.87 us 19.00 us 359.00 us 637 READ
0.02 64.80 us 32.00 us 999.00 us 2302 GETXATTR
0.10 5043.18 us 36.00 us 185529.00 us 137 READDIR
0.13 2353.83 us 5.00 us 561674.00 us 377 FLUSH
0.37 6281.02 us 27.00 us 2233115.00 us 387 OPEN
0.58 10060.54 us 19.00 us 2232282.00 us 384 OPENDIR
4.50 95350.04 us 17.00 us 2763438.00 us 314 READDIRP
10.30 20285.20 us 64.00 us 1633793.00 us 3381 WRITE
13.81 19369.61 us 12.00 us 1646135.00 us 4748 ENTRYLK
17.10 6363.41 us 9.00 us 2233001.00 us 17897 INODELK
53.06 1089.02 us 16.00 us 2233060.00 us 324446 LOOKUP
Duration: 85 seconds
Data Read: 80376043 bytes
Data Written: 443285504 bytes
Raw
virtbeds_storage_mvdcgluster01 profile
Brick: mvdcgluster01.us.alcatel-lucent.com:/export/raid/virtbeds_storage_mvdcgluster01
--------------------------------------------------------------------------------------
Cumulative Stats:
Block Size: 1b+ 2b+ 4b+
No. of Reads: 197 1519 73
No. of Writes: 43196 24506 36181
Block Size: 8b+ 16b+ 32b+
No. of Reads: 107 3088 13018
No. of Writes: 24384 82268033 142227
Block Size: 64b+ 128b+ 256b+
No. of Reads: 7479 14019 29798
No. of Writes: 208488 288922 408008
Block Size: 512b+ 1024b+ 2048b+
No. of Reads: 120842596 490609 1335064
No. of Writes: 2160499 5519115 3258238
Block Size: 4096b+ 8192b+ 16384b+
No. of Reads: 33860074 6496661 23640933
No. of Writes: 544943103 183466183 158508669
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 14101147 16906001 12192425
No. of Writes: 59194083 68099668 84224255
Block Size: 262144b+ 524288b+ 1048576b+
No. of Reads: 5407564 2652017 12001846
No. of Writes: 2483793 1709265 19226124
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 4245324 FORGET
0.00 0.00 us 0.00 us 0.00 us 4053117 RELEASE
0.00 0.00 us 0.00 us 0.00 us 1268242 RELEASEDIR
0.00 149.78 us 89.00 us 353.00 us 9 RENAME
0.00 276.17 us 29.00 us 771.00 us 6 READLINK
0.00 52.11 us 14.00 us 222.00 us 36 INODELK
0.00 43.67 us 16.00 us 145.00 us 48 LK
0.00 54.91 us 23.00 us 389.00 us 47 SETXATTR
0.00 49.04 us 24.00 us 316.00 us 72 FLUSH
0.00 37.92 us 18.00 us 201.00 us 191 OPENDIR
0.00 63.64 us 33.00 us 461.00 us 196 FSTAT
0.00 14679.00 us 14679.00 us 14679.00 us 1 SYMLINK
0.00 454.12 us 64.00 us 11766.00 us 34 RMDIR
0.01 458.05 us 13.00 us 66164.00 us 160 STATFS
0.25 7147.82 us 122.00 us 160430.00 us 230 READDIRP
0.28 37578.04 us 117.00 us 298143.00 us 49 MKDIR
0.30 2893.17 us 69.00 us 1119306.00 us 673 UNLINK
0.81 608.50 us 12.00 us 428376.00 us 8656 SETATTR
1.23 1460.78 us 6.00 us 1252667.00 us 5518 ACCESS
1.93 1899.81 us 19.00 us 1303311.00 us 6637 FSYNC
4.10 39793.30 us 97.00 us 2304005.00 us 673 CREATE
4.58 8558.20 us 22.00 us 1668622.00 us 3497 LOOKUP
4.87 3945.71 us 63.00 us 1302733.00 us 8062 TRUNCATE
5.77 7464.95 us 14.00 us 1128485.00 us 5050 READ
13.96 1336.48 us 7.00 us 1300533.00 us 68234 STAT
61.89 7222.18 us 12.00 us 2317925.00 us 55971 WRITE
Duration: 3793207 seconds
Data Read: 20439988644880 bytes
Data Written: 47790392480366 bytes
Interval 12 Stats:
Block Size: 1b+ 2b+ 4b+
No. of Reads: 0 1 0
No. of Writes: 110 79 59
Block Size: 8b+ 16b+ 32b+
No. of Reads: 0 37 48
No. of Writes: 29 152125 314
Block Size: 64b+ 128b+ 256b+
No. of Reads: 12 21 76
No. of Writes: 472 736 998
Block Size: 512b+ 1024b+ 2048b+
No. of Reads: 488 59 307
No. of Writes: 3420 3628 4957
Block Size: 4096b+ 8192b+ 16384b+
No. of Reads: 31226 4650 13346
No. of Writes: 756837 199067 197538
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 11358 22440 9604
No. of Writes: 64720 88196 72146
Block Size: 262144b+ 524288b+ 1048576b+
No. of Reads: 6091 3563 16030
No. of Writes: 3910 2438 31181
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 9845 FORGET
0.00 0.00 us 0.00 us 0.00 us 7484 RELEASE
0.00 0.00 us 0.00 us 0.00 us 2720 RELEASEDIR
0.00 101.00 us 89.00 us 113.00 us 2 RENAME
0.00 27.00 us 19.00 us 44.00 us 8 INODELK
0.00 48.17 us 23.00 us 145.00 us 6 LK
0.00 33.90 us 28.00 us 40.00 us 10 SETXATTR
0.00 78.80 us 73.00 us 91.00 us 5 RMDIR
0.00 42.22 us 24.00 us 136.00 us 37 FLUSH
0.00 34.28 us 18.00 us 92.00 us 46 STATFS
0.00 276.17 us 29.00 us 771.00 us 6 READLINK
0.00 40.89 us 19.00 us 201.00 us 71 OPENDIR
0.00 77.21 us 35.00 us 461.00 us 84 FSTAT
0.27 226.36 us 22.00 us 42353.00 us 2635 SETATTR
0.31 319.07 us 6.00 us 270389.00 us 2142 ACCESS
0.32 8023.60 us 127.00 us 160430.00 us 89 READDIRP
0.38 70222.67 us 117.00 us 260540.00 us 12 MKDIR
0.59 9373.83 us 91.00 us 1119306.00 us 139 UNLINK
2.99 2119.37 us 19.00 us 717650.00 us 3133 FSYNC
4.03 6493.46 us 22.00 us 912968.00 us 1376 LOOKUP
5.48 31104.32 us 100.00 us 1044642.00 us 391 CREATE
6.04 656.49 us 8.00 us 905563.00 us 20423 STAT
10.32 9829.43 us 63.00 us 700910.00 us 2330 TRUNCATE
16.87 8351.56 us 14.00 us 1128485.00 us 4484 READ
52.40 5198.73 us 15.00 us 1466075.00 us 22376 WRITE
Duration: 4427 seconds
Data Read: 25237605635 bytes
Data Written: 63166547851 bytes
Raw
virtbeds_storage_mvdcgluster02 profile
Brick: mvdcgluster02.us.alcatel-lucent.com:/export/raid/virtbeds_storage_mvdcgluster02
--------------------------------------------------------------------------------------
Cumulative Stats:
Block Size: 1b+ 2b+ 4b+
No. of Reads: 51 937 613
No. of Writes: 81008 30647 60757
Block Size: 8b+ 16b+ 32b+
No. of Reads: 80 1561 3723
No. of Writes: 39428 83188792 262063
Block Size: 64b+ 128b+ 256b+
No. of Reads: 2573 5688 34701
No. of Writes: 362444 510366 774133
Block Size: 512b+ 1024b+ 2048b+
No. of Reads: 282258104 993835 2813070
No. of Writes: 4351186 7976384 7805019
Block Size: 4096b+ 8192b+ 16384b+
No. of Reads: 62343918 13469743 43215955
No. of Writes: 667018751 188758033 189024681
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 21852036 31697033 8293912
No. of Writes: 61219243 88495742 20901558
Block Size: 262144b+ 524288b+ 1048576b+
No. of Reads: 11300021 6072934 26480961
No. of Writes: 4599333 3380274 44054063
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 5427903 FORGET
0.00 0.00 us 0.00 us 0.00 us 5100182 RELEASE
0.00 0.00 us 0.00 us 0.00 us 1326532 RELEASEDIR
0.00 31.00 us 31.00 us 31.00 us 1 SETXATTR
0.00 62.00 us 62.00 us 62.00 us 1 OPENDIR
0.00 106.00 us 106.00 us 106.00 us 1 FSTAT
0.00 190.50 us 110.00 us 271.00 us 2 UNLINK
0.00 67.00 us 54.00 us 100.00 us 6 RENAME
0.00 52.17 us 19.00 us 205.00 us 12 INODELK
0.00 46.90 us 17.00 us 201.00 us 29 STATFS
0.00 86.27 us 21.00 us 719.00 us 152 FLUSH
0.00 381.23 us 21.00 us 3862.00 us 180 FSYNC
0.01 210235.00 us 210235.00 us 210235.00 us 1 MKDIR
0.03 44645.80 us 17.00 us 158160.00 us 10 CREATE
0.04 617631.00 us 617631.00 us 617631.00 us 1 READDIRP
0.59 1761.78 us 5.00 us 1105866.00 us 5070 ACCESS
0.67 28281.95 us 23.00 us 1511121.00 us 356 LOOKUP
1.11 1476.17 us 29.00 us 1119314.00 us 11408 SETATTR
2.88 10656.27 us 11.00 us 1686091.00 us 4089 READ
4.39 5834.01 us 65.00 us 1642436.00 us 11379 TRUNCATE
18.96 2927.45 us 6.00 us 1425155.00 us 97881 STAT
71.31 10021.48 us 17.00 us 2261342.00 us 107551 WRITE
Duration: 3492419 seconds
Data Read: 41775195866113 bytes
Data Written: 69979167478029 bytes
Interval 5 Stats:
Block Size: 1b+ 2b+ 4b+
No. of Reads: 0 0 0
No. of Writes: 97 48 36
Block Size: 8b+ 16b+ 32b+
No. of Reads: 0 4 5
No. of Writes: 40 143661 322
Block Size: 64b+ 128b+ 256b+
No. of Reads: 3 12 37
No. of Writes: 566 699 983
Block Size: 512b+ 1024b+ 2048b+
No. of Reads: 320284 1012 2977
No. of Writes: 5108 16825 7015
Block Size: 4096b+ 8192b+ 16384b+
No. of Reads: 68968 17612 49599
No. of Writes: 1159244 303115 288850
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 26412 43744 7625
No. of Writes: 78503 97308 14092
Block Size: 262144b+ 524288b+ 1048576b+
No. of Reads: 12369 5553 23220
No. of Writes: 5677 4073 55310
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 7147 FORGET
0.00 0.00 us 0.00 us 0.00 us 6642 RELEASE
0.00 0.00 us 0.00 us 0.00 us 1475 RELEASEDIR
0.00 31.00 us 31.00 us 31.00 us 1 SETXATTR
0.00 62.00 us 62.00 us 62.00 us 1 OPENDIR
0.00 106.00 us 106.00 us 106.00 us 1 FSTAT
0.00 110.00 us 110.00 us 110.00 us 1 UNLINK
0.00 67.80 us 54.00 us 100.00 us 5 RENAME
0.00 53.60 us 19.00 us 205.00 us 10 INODELK
0.00 48.44 us 18.00 us 201.00 us 16 STATFS
0.00 69.58 us 21.00 us 521.00 us 71 FLUSH
0.00 418.44 us 26.00 us 3862.00 us 72 FSYNC
0.02 210235.00 us 210235.00 us 210235.00 us 1 MKDIR
0.03 41769.43 us 18.00 us 158160.00 us 7 CREATE
0.05 617631.00 us 617631.00 us 617631.00 us 1 READDIRP
0.37 31345.64 us 23.00 us 1511121.00 us 131 LOOKUP
0.53 3116.13 us 5.00 us 1105866.00 us 1908 ACCESS
1.12 2987.18 us 29.00 us 1119314.00 us 4223 SETATTR
3.44 14888.39 us 11.00 us 1686091.00 us 2597 READ
5.54 14823.99 us 65.00 us 1642436.00 us 4198 TRUNCATE
19.51 5916.08 us 6.00 us 1425155.00 us 37070 STAT
69.40 16712.12 us 18.00 us 2261342.00 us 46683 WRITE
Duration: 4278 seconds
Data Read: 39309748400 bytes
Data Written: 87879444965 bytes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment