Instantly share code, notes, and snippets.

Embed
What would you like to do?

After failing to download any large files from HubiC using either the desktop or the web client, I decided to try clients using the REST API. The most mature one seems to be rclone, but even that (which supports retries) couldn't retrieve a given file after trying for more than 3 hours!

This is the last hours worth of logs from running rclone copy -vv Hubic:HubiC-DeskBackup_Pictures/Lightroom/Main.lrcat .

Elapsed time:     2h41m1s
Transferring:
 *                                    Main.lrcat: 40% done, 321.944 kBytes/s, ETA: 14m20s

2018/04/25 04:01:57 INFO  : 
Transferred:   4.133 GBytes (445.790 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h42m1s
Transferring:
 *                                    Main.lrcat: 47% done, 682.812 kBytes/s, ETA: 5m57s

2018/04/25 04:02:16 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:02:16 DEBUG : Main.lrcat: Received error: unexpected EOF - low level retry 8/10
2018/04/25 04:02:57 INFO  : 
Transferred:   4.158 GBytes (445.777 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h43m1s
Transferring:
 *                                    Main.lrcat:  3% done, 409.917 kBytes/s, ETA: 18m10s

2018/04/25 04:03:57 INFO  : 
Transferred:   4.187 GBytes (446.182 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h44m1s
Transferring:
 *                                    Main.lrcat: 10% done, 474.540 kBytes/s, ETA: 14m37s

2018/04/25 04:04:57 INFO  : 
Transferred:   4.211 GBytes (445.960 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h45m1s
Transferring:
 *                                    Main.lrcat: 15% done, 731.109 kBytes/s, ETA: 8m55s

2018/04/25 04:05:57 INFO  : 
Transferred:   4.235 GBytes (445.844 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h46m1s
Transferring:
 *                                    Main.lrcat: 21% done, 344.989 kBytes/s, ETA: 17m41s

2018/04/25 04:06:57 INFO  : 
Transferred:   4.260 GBytes (445.729 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h47m1s
Transferring:
 *                                    Main.lrcat: 26% done, 338.336 kBytes/s, ETA: 16m46s

2018/04/25 04:07:57 INFO  : 
Transferred:   4.289 GBytes (446.123 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h48m1s
Transferring:
 *                                    Main.lrcat: 33% done, 446.908 kBytes/s, ETA: 11m33s

2018/04/25 04:08:57 INFO  : 
Transferred:   4.320 GBytes (446.715 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h49m1s
Transferring:
 *                                    Main.lrcat: 40% done, 457.614 kBytes/s, ETA: 10m5s

2018/04/25 04:09:57 INFO  : 
Transferred:   4.347 GBytes (446.798 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h50m1s
Transferring:
 *                                    Main.lrcat: 46% done, 475.292 kBytes/s, ETA: 8m44s

2018/04/25 04:10:57 INFO  : 
Transferred:   4.375 GBytes (447.079 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h51m1s
Transferring:
 *                                    Main.lrcat: 52% done, 626.223 kBytes/s, ETA: 5m50s

2018/04/25 04:11:57 INFO  : 
Transferred:   4.398 GBytes (446.861 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h52m1s
Transferring:
 *                                    Main.lrcat: 58% done, 549.179 kBytes/s, ETA: 5m55s

2018/04/25 04:12:36 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:12:36 DEBUG : Main.lrcat: Received error: unexpected EOF - low level retry 9/10
2018/04/25 04:12:57 INFO  : 
Transferred:   4.419 GBytes (446.350 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h53m1s
Transferring:
 *                                    Main.lrcat:  1% done, 340.255 kBytes/s, ETA: 22m32s

2018/04/25 04:13:57 INFO  : 
Transferred:   4.445 GBytes (446.433 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h54m1s
Transferring:
 *                                    Main.lrcat:  7% done, 435.204 kBytes/s, ETA: 16m34s

2018/04/25 04:14:57 INFO  : 
Transferred:   4.469 GBytes (446.223 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h55m1s
Transferring:
 *                                    Main.lrcat: 12% done, 286.737 kBytes/s, ETA: 23m43s

2018/04/25 04:15:57 INFO  : 
Transferred:   4.498 GBytes (446.596 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h56m1s
Transferring:
 *                                    Main.lrcat: 18% done, 515.998 kBytes/s, ETA: 12m11s

2018/04/25 04:16:57 INFO  : 
Transferred:   4.523 GBytes (446.580 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h57m1s
Transferring:
 *                                    Main.lrcat: 24% done, 608.930 kBytes/s, ETA: 9m35s

2018/04/25 04:17:57 INFO  : 
Transferred:   4.547 GBytes (446.372 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h58m1s
Transferring:
 *                                    Main.lrcat: 29% done, 451.942 kBytes/s, ETA: 12m1s

2018/04/25 04:18:12 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:18:12 ERROR : Main.lrcat: Failed to copy: unexpected EOF
2018/04/25 04:18:12 ERROR : Attempt 2/3 failed with 1 errors and: unexpected EOF
2018/04/25 04:18:12 INFO  : Local file system at /home/carlerik/dev/dx-nuflo: Waiting for checks to finish
2018/04/25 04:18:12 INFO  : Local file system at /home/carlerik/dev/dx-nuflo: Waiting for transfers to finish
2018/04/25 04:18:57 INFO  : 
Transferred:   4.570 GBytes (446.167 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h59m1s
Transferring:
 *                                    Main.lrcat:  5% done, 352.048 kBytes/s, ETA: 20m52s

2018/04/25 04:19:57 INFO  : 
Transferred:   4.602 GBytes (446.722 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h0m1s
Transferring:
 *                                    Main.lrcat: 12% done, 397.755 kBytes/s, ETA: 17m5s

2018/04/25 04:20:57 INFO  : 
Transferred:   4.633 GBytes (447.271 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h1m1s
Transferring:
 *                                    Main.lrcat: 19% done, 604.209 kBytes/s, ETA: 10m21s

2018/04/25 04:21:57 INFO  : 
Transferred:   4.656 GBytes (447.064 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h2m1s
Transferring:
 *                                    Main.lrcat: 24% done, 349.155 kBytes/s, ETA: 16m44s

2018/04/25 04:22:57 INFO  : 
Transferred:   4.680 GBytes (446.859 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h3m1s
Transferring:
 *                                    Main.lrcat: 29% done, 326.218 kBytes/s, ETA: 16m39s

2018/04/25 04:23:10 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:23:10 DEBUG : Main.lrcat: Received error: unexpected EOF - low level retry 1/10
2018/04/25 04:23:57 INFO  : 
Transferred:   4.705 GBytes (446.843 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h4m1s
Transferring:
 *                                    Main.lrcat:  5% done, 614.509 kBytes/s, ETA: 11m54s

2018/04/25 04:24:57 INFO  : 
Transferred:   4.729 GBytes (446.642 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h5m1s
Transferring:
 *                                    Main.lrcat: 10% done, 385.759 kBytes/s, ETA: 17m53s

2018/04/25 04:25:57 INFO  : 
Transferred:   4.754 GBytes (446.626 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h6m1s
Transferring:
 *                                    Main.lrcat: 16% done, 444.177 kBytes/s, ETA: 14m32s

2018/04/25 04:26:57 INFO  : 
Transferred:   4.789 GBytes (447.522 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h7m1s
Transferring:
 *                                    Main.lrcat: 24% done, 555.643 kBytes/s, ETA: 10m31s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment