Create a gist now

Instantly share code, notes, and snippets.

Embed
What would you like to do?

After failing to download any large files from HubiC using either the desktop or the web client, I decided to try clients using the REST API. The most mature one seems to be rclone, but even that (which supports retries) couldn't retrieve a given file after trying for more than 3 hours!

This is the last hours worth of logs from running rclone copy -vv Hubic:HubiC-DeskBackup_Pictures/Lightroom/Main.lrcat .

Elapsed time:     2h41m1s
Transferring:
 *                                    Main.lrcat: 40% done, 321.944 kBytes/s, ETA: 14m20s

2018/04/25 04:01:57 INFO  : 
Transferred:   4.133 GBytes (445.790 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h42m1s
Transferring:
 *                                    Main.lrcat: 47% done, 682.812 kBytes/s, ETA: 5m57s

2018/04/25 04:02:16 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:02:16 DEBUG : Main.lrcat: Received error: unexpected EOF - low level retry 8/10
2018/04/25 04:02:57 INFO  : 
Transferred:   4.158 GBytes (445.777 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h43m1s
Transferring:
 *                                    Main.lrcat:  3% done, 409.917 kBytes/s, ETA: 18m10s

2018/04/25 04:03:57 INFO  : 
Transferred:   4.187 GBytes (446.182 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h44m1s
Transferring:
 *                                    Main.lrcat: 10% done, 474.540 kBytes/s, ETA: 14m37s

2018/04/25 04:04:57 INFO  : 
Transferred:   4.211 GBytes (445.960 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h45m1s
Transferring:
 *                                    Main.lrcat: 15% done, 731.109 kBytes/s, ETA: 8m55s

2018/04/25 04:05:57 INFO  : 
Transferred:   4.235 GBytes (445.844 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h46m1s
Transferring:
 *                                    Main.lrcat: 21% done, 344.989 kBytes/s, ETA: 17m41s

2018/04/25 04:06:57 INFO  : 
Transferred:   4.260 GBytes (445.729 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h47m1s
Transferring:
 *                                    Main.lrcat: 26% done, 338.336 kBytes/s, ETA: 16m46s

2018/04/25 04:07:57 INFO  : 
Transferred:   4.289 GBytes (446.123 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h48m1s
Transferring:
 *                                    Main.lrcat: 33% done, 446.908 kBytes/s, ETA: 11m33s

2018/04/25 04:08:57 INFO  : 
Transferred:   4.320 GBytes (446.715 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h49m1s
Transferring:
 *                                    Main.lrcat: 40% done, 457.614 kBytes/s, ETA: 10m5s

2018/04/25 04:09:57 INFO  : 
Transferred:   4.347 GBytes (446.798 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h50m1s
Transferring:
 *                                    Main.lrcat: 46% done, 475.292 kBytes/s, ETA: 8m44s

2018/04/25 04:10:57 INFO  : 
Transferred:   4.375 GBytes (447.079 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h51m1s
Transferring:
 *                                    Main.lrcat: 52% done, 626.223 kBytes/s, ETA: 5m50s

2018/04/25 04:11:57 INFO  : 
Transferred:   4.398 GBytes (446.861 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h52m1s
Transferring:
 *                                    Main.lrcat: 58% done, 549.179 kBytes/s, ETA: 5m55s

2018/04/25 04:12:36 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:12:36 DEBUG : Main.lrcat: Received error: unexpected EOF - low level retry 9/10
2018/04/25 04:12:57 INFO  : 
Transferred:   4.419 GBytes (446.350 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h53m1s
Transferring:
 *                                    Main.lrcat:  1% done, 340.255 kBytes/s, ETA: 22m32s

2018/04/25 04:13:57 INFO  : 
Transferred:   4.445 GBytes (446.433 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h54m1s
Transferring:
 *                                    Main.lrcat:  7% done, 435.204 kBytes/s, ETA: 16m34s

2018/04/25 04:14:57 INFO  : 
Transferred:   4.469 GBytes (446.223 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h55m1s
Transferring:
 *                                    Main.lrcat: 12% done, 286.737 kBytes/s, ETA: 23m43s

2018/04/25 04:15:57 INFO  : 
Transferred:   4.498 GBytes (446.596 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h56m1s
Transferring:
 *                                    Main.lrcat: 18% done, 515.998 kBytes/s, ETA: 12m11s

2018/04/25 04:16:57 INFO  : 
Transferred:   4.523 GBytes (446.580 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h57m1s
Transferring:
 *                                    Main.lrcat: 24% done, 608.930 kBytes/s, ETA: 9m35s

2018/04/25 04:17:57 INFO  : 
Transferred:   4.547 GBytes (446.372 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h58m1s
Transferring:
 *                                    Main.lrcat: 29% done, 451.942 kBytes/s, ETA: 12m1s

2018/04/25 04:18:12 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:18:12 ERROR : Main.lrcat: Failed to copy: unexpected EOF
2018/04/25 04:18:12 ERROR : Attempt 2/3 failed with 1 errors and: unexpected EOF
2018/04/25 04:18:12 INFO  : Local file system at /home/carlerik/dev/dx-nuflo: Waiting for checks to finish
2018/04/25 04:18:12 INFO  : Local file system at /home/carlerik/dev/dx-nuflo: Waiting for transfers to finish
2018/04/25 04:18:57 INFO  : 
Transferred:   4.570 GBytes (446.167 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     2h59m1s
Transferring:
 *                                    Main.lrcat:  5% done, 352.048 kBytes/s, ETA: 20m52s

2018/04/25 04:19:57 INFO  : 
Transferred:   4.602 GBytes (446.722 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h0m1s
Transferring:
 *                                    Main.lrcat: 12% done, 397.755 kBytes/s, ETA: 17m5s

2018/04/25 04:20:57 INFO  : 
Transferred:   4.633 GBytes (447.271 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h1m1s
Transferring:
 *                                    Main.lrcat: 19% done, 604.209 kBytes/s, ETA: 10m21s

2018/04/25 04:21:57 INFO  : 
Transferred:   4.656 GBytes (447.064 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h2m1s
Transferring:
 *                                    Main.lrcat: 24% done, 349.155 kBytes/s, ETA: 16m44s

2018/04/25 04:22:57 INFO  : 
Transferred:   4.680 GBytes (446.859 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h3m1s
Transferring:
 *                                    Main.lrcat: 29% done, 326.218 kBytes/s, ETA: 16m39s

2018/04/25 04:23:10 NOTICE: Main.lrcat: Removing partially written file on error: unexpected EOF
2018/04/25 04:23:10 DEBUG : Main.lrcat: Received error: unexpected EOF - low level retry 1/10
2018/04/25 04:23:57 INFO  : 
Transferred:   4.705 GBytes (446.843 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h4m1s
Transferring:
 *                                    Main.lrcat:  5% done, 614.509 kBytes/s, ETA: 11m54s

2018/04/25 04:24:57 INFO  : 
Transferred:   4.729 GBytes (446.642 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h5m1s
Transferring:
 *                                    Main.lrcat: 10% done, 385.759 kBytes/s, ETA: 17m53s

2018/04/25 04:25:57 INFO  : 
Transferred:   4.754 GBytes (446.626 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h6m1s
Transferring:
 *                                    Main.lrcat: 16% done, 444.177 kBytes/s, ETA: 14m32s

2018/04/25 04:26:57 INFO  : 
Transferred:   4.789 GBytes (447.522 kBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3h7m1s
Transferring:
 *                                    Main.lrcat: 24% done, 555.643 kBytes/s, ETA: 10m31s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment