gluster add bricks.md

Created a replica 2 volume:

# gluster volume info test1

Volume Name: test1
Type: Replicate
Volume ID: e1d66be2-a9d4-4073-9af9-4df4390dbd4e
Status: Created
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: gluster1:/bricks/brick1/brick
Brick2: gluster2:/bricks/brick1/brick
Options Reconfigured:
nfs.disable: on

Mounted that volume on a client; and started a loop to test writes while performing Gluster operations:

$ time for i in A B C D E F G H I J K L; do for j in $(seq 10 20); do mkdir -p /mnt/$i/$j; dd if=/dev/urandom of=/mnt/$i/$j/data bs=1M count=25; done; done;
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.48052 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.45891 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.48406 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.50634 s, 10.5 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.5316 s, 10.4 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.44455 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.45351 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.4326 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.46512 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.44994 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.45568 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.43247 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.47077 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.43308 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.43612 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.47728 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.47313 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.51108 s, 10.4 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.45146 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.46933 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.43313 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.44823 s, 10.7 MB/s

At this point, on one of the gluster servers I performed this:

# gluster volume add-brick test1 replica 2 gluster1:/bricks/brick2/brick gluster2:/bricks/brick2/brick

The client writing data blew up:

mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/10/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/11/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/12/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/13/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/14/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/15/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/16/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/17/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/18/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/19/data': No such file or directory
mkdir: cannot create directory `/mnt/C': Permission denied
dd: opening `/mnt/C/20/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/10/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/11/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/12/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/13/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/14/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/15/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/16/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/17/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/18/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/19/data': No such file or directory
mkdir: cannot create directory `/mnt/D': Permission denied
dd: opening `/mnt/D/20/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/10/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/11/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/12/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/13/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/14/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/15/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/16/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/17/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/18/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/19/data': No such file or directory
mkdir: cannot create directory `/mnt/E': Permission denied
dd: opening `/mnt/E/20/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/10/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/11/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/12/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/13/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/14/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/15/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/16/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/17/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/18/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/19/data': No such file or directory
mkdir: cannot create directory `/mnt/F': Permission denied
dd: opening `/mnt/F/20/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/10/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/11/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/12/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/13/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/14/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/15/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/16/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/17/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/18/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/19/data': No such file or directory
mkdir: cannot create directory `/mnt/G': Permission denied
dd: opening `/mnt/G/20/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/10/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/11/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/12/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/13/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/14/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/15/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/16/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/17/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/18/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/19/data': No such file or directory
mkdir: cannot create directory `/mnt/H': Permission denied
dd: opening `/mnt/H/20/data': No such file or directory
mkdir: cannot create directory `/mnt/I': Permission denied
dd: opening `/mnt/I/10/data': No such file or directory
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.43536 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.44204 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.45516 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.47781 s, 10.6 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.49671 s, 10.5 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.49074 s, 10.5 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.49009 s, 10.5 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.44723 s, 10.7 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.43848 s, 10.8 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.4368 s, 10.8 MB/s
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/10/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/11/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/12/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/13/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/14/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/15/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/16/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/17/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/18/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/19/data': No such file or directory
mkdir: cannot create directory `/mnt/J': Permission denied
dd: opening `/mnt/J/20/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/10/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/11/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/12/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/13/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/14/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/15/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/16/data': No such file or directory
mkdir: cannot create directory `/mnt/K': Permission denied
dd: opening `/mnt/K/17/data': No such file or directory
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.5286 s, 10.4 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.63556 s, 9.9 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB) copied, 2.44343 s, 10.7 MB/s
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/10/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/11/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/12/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/13/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/14/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/15/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/16/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/17/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/18/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/19/data': No such file or directory
mkdir: cannot create directory `/mnt/L': Permission denied
dd: opening `/mnt/L/20/data': No such file or directory

real	1m27.789s
user	0m0.027s
sys	1m23.235s

any tips about exec gluster volume status ?