Skip to content

Instantly share code, notes, and snippets.

@rossant
Last active August 29, 2015 14:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rossant/7fb413ea6a0e10112be9 to your computer and use it in GitHub Desktop.
Save rossant/7fb413ea6a0e10112be9 to your computer and use it in GitHub Desktop.
Summary of HDF5 parallel features

This table sums up what is and is not possible with concurrent accesses on HDF5 files using the h5py library.

<td><!-- read possible? --></td>
<td><!-- read fast? --></td>
<td><!-- read limitations? --></td>

<td>-</td>
<td>-</td>
<td>-</td>
<td>-</td>
<td>-</td>
<td>-</td>

<td><!-- write possible? --></td>
<td><!-- write fast? --></td>
<td><!-- write limitations? --></td>
<td><!-- read possible? --></td>
<td><!-- read fast? --></td>
<td><!-- read limitations? --></td>

<td><!-- write possible? --></td>
<td><!-- write fast? --></td>
<td><!-- write limitations? --></td>
<td>read only</td>

<td><!-- read possible? --></td>
<td><!-- read fast? --></td>
<td><!-- read limitations? --></td>

<td>-</td>
<td>-</td>
<td>-</td>
<td>-</td>
<td>-</td>
<td>-</td>

<td><!-- write possible? --></td>
<td><!-- write fast? --></td>
<td><!-- write limitations? --></td>
<td><!-- read possible? --></td>
<td><!-- read fast? --></td>
<td><!-- read limitations? --></td>

<td><!-- write possible? --></td>
<td><!-- write fast? --></td>
<td><!-- write limitations? --></td>
opened in access mode reading writing
possible? (yes/no/MPI required/...) fast? (yes/no/serial/multicore/...) limitations causes? (h5py/GIL/libhdf5/...) possible? fast? limitations causes?
one process, multiple threads read only
write only
read and write
multiple processes
write only
read and write
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment