This is merely an introduction to get you started quickly. This does not replace Mila's official cluster documentation => docs.mila.quebec which you should definitely go through, thoroughly before you start using the cluster.
Before starting: get your Mila cluster account ready. Should look something like surname[:6]firstname[0] but this may vary, it’s not a necessary condition.
| GPU fp32 | GPU fp16 | TPU fp32* | TPU fp16* | |
|---|---|---|---|---|
| Largest batch size | 32 | 64 | 1024 | 2048 |
| Min-inference batch size | 4 | 64 | 1024 | 2048 |
| Masker inference (s/i) | 0.059 | 0.019 | 3.80e-5 | 1.36e-5 |
| Painter inference (s/i) | 0.068 | 0.041 | 2.53e-5 | 1.16e-5 |
| Inference loop (s) | 130.382 | 60.567 | 0.073 | 0.0392 |
| Inference loop (i/s) | ~8 | ~17 | ~14 000 | ~26 000 |
| Full dataset with loading (s) | 151.546 | 76.953 | 18.05 | 15.31 |
| Total Device -> CPU (s) | 2.816 | 2.528 | inf | inf |
| // ----------------------- | |
| // ----- Functions ----- | |
| // ----------------------- | |
| /** | |
| * | |
| * @param {string} testId The string id for the element to find, | |
| * matchec against elements' `data-testid` attribute. | |
| * @returns HTML element | |
| */ |
