gluster confusion?

gistfile1.txt

$ parallel-ssh -H tiefighter2 -H tiefighter3 -H tiefighter4 -H tiefighter5 -H tiefighter6 -H tiefighter7 -H tiefighter8 -H tiefighter9 --inline 'md5sum /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png'
[1] 02:41:47 [SUCCESS] tiefighter2
93b3f694274a890a6cd9bbf96b90436d  /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png
[2] 02:41:47 [FAILURE] tiefighter3 Exited with error code 1
Stderr: md5sum: /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png: Invalid argument
[3] 02:41:47 [FAILURE] tiefighter6 Exited with error code 1
Stderr: md5sum: /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png: Invalid argument
[4] 02:41:47 [FAILURE] tiefighter4 Exited with error code 1
Stderr: md5sum: /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png: Invalid argument
[5] 02:41:47 [SUCCESS] tiefighter7
93b3f694274a890a6cd9bbf96b90436d  /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png
[6] 02:41:47 [FAILURE] tiefighter8 Exited with error code 1
Stderr: md5sum: /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png: Invalid argument
[7] 02:41:47 [FAILURE] tiefighter9 Exited with error code 1
Stderr: md5sum: /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png: Invalid argument
[8] 02:41:47 [FAILURE] tiefighter5 Exited with error code 1
Stderr: md5sum: /gv0/discourse-public-uploads/meteor/default/112/466c5214cada4753.png: Invalid argument

It's there!

$ parallel-ssh -H tiefighter8 -H tiefighter9 --inline 'ls -al /export/glusterfs/discourse-public-uploads/meteor/default/112/466c5214cada4753.png'
[1] 02:44:20 [SUCCESS] tiefighter8
-rw-r--r-- 2 build www-data 4645 Feb 26 21:03 /export/glusterfs/discourse-public-uploads/meteor/default/112/466c5214cada4753.png
[2] 02:44:20 [SUCCESS] tiefighter9
-rw-r--r-- 2 build www-data 4645 Feb 26 21:03 /export/glusterfs/discourse-public-uploads/meteor/default/112/466c5214cada4753.png

$ parallel-ssh -H tiefighter8 -H tiefighter9 --inline 'md5sum /export/glusterfs/discourse-public-uploads/meteor/default/112/466c5214cada4753.png'
[1] 02:42:17 [SUCCESS] tiefighter8
93b3f694274a890a6cd9bbf96b90436d  /export/glusterfs/discourse-public-uploads/meteor/default/112/466c5214cada4753.png
[2] 02:42:17 [SUCCESS] tiefighter9
93b3f694274a890a6cd9bbf96b90436d  /export/glusterfs/discourse-public-uploads/meteor/default/112/466c5214cada4753.png

From tf8 logs:
[2015-05-06 02:41:47.684847] W [client-rpc-fops.c:259:client3_3_mknod_cbk] 1-gv0-client-1: remote operation failed: Permission denied. Path: /discourse-public-uploads/meteor/default/112/466c5214cada4753.png (04c9aad7-4e97-43d4-9345-b2bd0ad61a40)
[2015-05-06 02:41:47.684873] W [client-rpc-fops.c:259:client3_3_mknod_cbk] 1-gv0-client-0: remote operation failed: Permission denied. Path: /discourse-public-uploads/meteor/default/112/466c5214cada4753.png (04c9aad7-4e97-43d4-9345-b2bd0ad61a40)
[2015-05-06 02:41:47.685036] W [fuse-bridge.c:915:fuse_fd_cbk] 0-glusterfs-fuse: 282517653: OPEN() /discourse-public-uploads/meteor/default/112/466c5214cada4753.png => -1 (Invalid argument)

From tf9 logs:
[2015-05-06 02:41:47.690497] W [client-rpc-fops.c:259:client3_3_mknod_cbk] 1-gv0-client-0: remote operation failed: Permission denied. Path: /discourse-public-uploads/meteor/default/112/466c5214cada4753.png (04c9aad7-4e97-43d4-9345-b2bd0ad61a40)
[2015-05-06 02:41:47.690537] W [client-rpc-fops.c:259:client3_3_mknod_cbk] 1-gv0-client-1: remote operation failed: Permission denied. Path: /discourse-public-uploads/meteor/default/112/466c5214cada4753.png (04c9aad7-4e97-43d4-9345-b2bd0ad61a40)
[2015-05-06 02:41:47.690733] W [fuse-bridge.c:915:fuse_fd_cbk] 0-glusterfs-fuse: 227212508: OPEN() /discourse-public-uploads/meteor/default/112/466c5214cada4753.png => -1 (Invalid argument)