Skip to content

Instantly share code, notes, and snippets.

@joerg

joerg/README.md

Created August 8, 2019 08:14
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save joerg/b88bf1de0ce824894ffc38f597cfef5f to your computer and use it in GitHub Desktop.
Save joerg/b88bf1de0ce824894ffc38f597cfef5f to your computer and use it in GitHub Desktop.
Download ZIP
restic_compress_comparison
Raw
README.md

TL;DR

Comparison

Tool Backup Time (m:s) Restore Time (m:s) Backup space (G) Backup space (%) Backup (MB/s) Restore (MB/s)
Tar 4:42 5:19 11 9.6% 404 357
Restic S3 local Upstream 10:04 30:56 102 89.5% 189 61
Restic S3 local Compress 5:43 19:28 8.6 7.5% 332 98
Restic Local Upstream 8:33 26:06 102 89.5% 222 73
Restic Local Compress 5:21 16:57 8.6 7.5% 355 112
Restic S3 Remote Upstream 17:12 46:06 102 89.5% 110 41
Restic S3 Remote Compress 5:27 21:42 8.6 7.5% 349 88

Findings

Minio is quite CPU intense. While writing to the remote server i saw that this 3 CPU server hat a load between 2 and 3 (about 2.4 most of the time) with minimal wait. Using restic with compression the load produced by minio is much much lower (usually around 1).

Prerequisites

Single server, old Baremetal machine.

Baremetal
24 CPUs: Intel(R) Xeon(R) CPU           X5670  @ 2.93GHz
126 GB RAM
OS: RedHat 7.5 latest patches applied
glibc: 2.17-222.el7
Docker version 17.06.2-ce, build cec0b72

Remote Minio server

Virtual machine
3 CPUs: Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
16 GB RAM
OS: RedHat 6.10 latest patches applied
glibc: 2.12-1.212.el6
Docker version 1.7.1, build 786b29d/1.7.1 # Latest available for RHEL 6

Disk: Single data disk (logical volume) with 1 TB formatted EXT4 at /data/joerg

% sudo mkdir /data/joerg/sas_data /data/joerg/restic_bare /data/joerg/minio1 /data/joerg/minio2 /data/joerg/restore
% du -sch /data/joerg/sas_data/*
54G     /data/joerg/sas_data/at
164K    /data/joerg/sas_data/configuration
4.0K    /data/joerg/sas_data/datamart
4.0K    /data/joerg/sas_data/dom_data
1.5G    /data/joerg/sas_data/input
4.0K    /data/joerg/sas_data/irb
11G     /data/joerg/sas_data/loc01
11G     /data/joerg/sas_data/loc02
720M    /data/joerg/sas_data/local
22G     /data/joerg/sas_data/output
136K    /data/joerg/sas_data/parameters
4.0K    /data/joerg/sas_data/predds
4.0K    /data/joerg/sas_data/predds_int
7.5G    /data/joerg/sas_data/rbl
7.2G    /data/joerg/sas_data/rbl_int
102M    /data/joerg/sas_data/rwa2gdwh
1.5G    /data/joerg/sas_data/rwabridge
4.0K    /data/joerg/sas_data/rwa_test_tmp
114G    total

Full commands

Prep (local)

% docker run -d --name minio1 --volume /data/joerg/minio1:/data -p 9001:9000 docker.rcrs.me/minio/minio:RELEASE.2018-09-25T21-34-43Z server /data
% docker logs minio1
Endpoint:  http://172.17.0.4:9000  http://127.0.0.1:9000
AccessKey: RDEMIAVPBST35YNJKHQT
SecretKey: SIW7KC9dEqbaBZj4ZOZ+wApQDprHPHSm1x875xZm
...

% /data/joerg/minio-client config host add minio1 http://localhost:9001 RDEMIAVPBST35YNJKHQT SIW7KC9dEqbaBZj4ZOZ+wApQDprHPHSm1x875xZm
% /data/joerg/minio-client mb minio1/backup

% docker run -d --name minio2 --volume /data/joerg/minio2:/data -p 9002:9000 docker.rcrs.me/minio/minio:RELEASE.2018-09-25T21-34-43Z server /data
% docker logs minio2
Endpoint:  http://172.17.0.5:9000  http://127.0.0.1:9000
AccessKey: AFX7B1RPU6OFEY3FTBLV
SecretKey: 04AhpRra7dOWYGPguNn+QEDGb8KijkfEc2P1Vd+t
...

% /data/joerg/minio-client config host add minio2 http://localhost:9002 AFX7B1RPU6OFEY3FTBLV 04AhpRra7dOWYGPguNn+QEDGb8KijkfEc2P1Vd+t
% /data/joerg/minio-client mb minio2/backup


% sudo mv /home/joerg/ubik-restic-2018-09-19.tar.xz .
% sudo tar -xvf ubik-restic-2018-09-19.tar.xz                                                                                   :(
ubik-restic-2018-09-19/
ubik-restic-2018-09-19/restic-compression
ubik-restic-2018-09-19/restic-upstream

Prep (remote)

This should eliminate disk performance problems...

% docker run -d --name minio1 --volume /opt/minio/minio1:/data -p 9001:9000 docker.rcrs.me/minio/minio:RELEASE.2018-09-25T21-34-43Z server /data
% docker logs minio1
Endpoint:  http://172.17.0.1:9000  http://127.0.0.1:9000
AccessKey: 1R0DGAWBPQDPUPA69G4E
SecretKey: PnesIZfk8xC6zvBwqZW6OtPMIX131zYgpIqUSjaH
...

% docker run -d --name minio2 --volume /opt/minio/minio2:/data -p 9002:9000 docker.rcrs.me/minio/minio:RELEASE.2018-09-25T21-34-43Z server /data
% docker logs minio2
Endpoint:  http://172.17.0.2:9000  http://127.0.0.1:9000
AccessKey: TYTRYKJ8E7AVSZDK0CC6
SecretKey: Z0C7SMXVDf7yVhwPQoLbfUpYdLgi9VDxyTkC/wEY
...

On test server (I have minio client on only one server currently)

% sudo -E /data/joerg/minio-client config host add minio1-r http://sl1t0rci25:9001 1R0DGAWBPQDPUPA69G4E PnesIZfk8xC6zvBwqZW6OtPMIX131zYgpIqUSjaH
% /data/joerg/minio-client mb minio1-r/backup

% /data/joerg/minio-client config host add minio2-r http://sl1t0rci25:9002 TYTRYKJ8E7AVSZDK0CC6 Z0C7SMXVDf7yVhwPQoLbfUpYdLgi9VDxyTkC/wEY
% /data/joerg/minio-client mb minio2/backup

% /data/joerg/minio-client mb minio1-r/speedtest
% ls -lah /data/joerg/sas_data/at/groups/rbro/master/results/regulatory/capital_detail_optimal.sas7bdat
-rw-rw-r-- 1 sasetl 5702 931M Oct 26  2017 /data/joerg/sas_data/at/groups/rbro/master/results/regulatory/capital_detail_optimal.sas7bdat

% sudo -E time /data/joerg/minio-client cp /data/joerg/sas_data/at/groups/rbro/master/results/regulatory/capital_detail_optimal.sas7bdat minio1-r/speedtest/
..._detail_optimal.sas7bdat:  930.80 MB / 930.80 MB ┃---┃ 100.00% 102.53 MB/s 9s6.37user 0.75system 0:09.15elapsed 77%CPU (0avgtext+0avgdata 14120maxresident)k
0inputs+32outputs (0major+4071minor)pagefaults 0swaps
sudo -E time /data/joerg/minio-client cp  minio1-r/speedtest/  6.38s user 0.76s system 77% cpu 9.169 total

Copy between servers is fast at about 1 Gib/s, so neither Network nor Disk should be an issue.

Testing

What we have now: Tar with pigz (parallel ZIP). We compare everything to this.

Compare Backup and Restore of restic with and without compression:

  • To local S3
  • To local disk
  • To remote S3

TAR/PIGZ

% export TAR_OPTIONS="--use-compress-program=pigz"
% sudo -E time tar -cf /data/joerg/rwa.tar.gz /data/joerg/sas_data
tar: Removing leading `/' from member names
3117.05user 230.52system 4:42.94elapsed 1183%CPU (0avgtext+0avgdata 16392maxresident)k
237407136inputs+21792128outputs (2major+356825minor)pagefaults 0swaps
sudo -E time tar -cf /data/joerg/rwa.tar.gz /data/joerg/sas_data  3117.06s user 230.53s system 1183% cpu 4:42.96 total
% ls -lah /data/joerg/rwa.tar.gz
-rw-r--r-- 1 root root 11G Oct  2 10:57 /data/joerg/rwa.tar.gz
% sudo -E rm -rf /data/joerg/restore/*
% sudo -E time tar -xf /data/joerg/rwa.tar.gz -C /data/joerg/restore
366.06user 241.33system 5:19.53elapsed 190%CPU (0avgtext+0avgdata 1332maxresident)k
15808208inputs+237395240outputs (3major+2367minor)pagefaults 0swaps
sudo -E time tar -xf /data/joerg/rwa.tar.gz -C /data/joerg/restore  366.07s user 241.34s system 190% cpu 5:19.66 total

Restic upstream to S3 (local)

% export AWS_ACCESS_KEY_ID=RDEMIAVPBST35YNJKHQT
% export AWS_SECRET_ACCESS_KEY=SIW7KC9dEqbaBZj4ZOZ+wApQDprHPHSm1x875xZm

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://localhost:9001/backup init
enter password for new repository: asdf
enter password again: asdf
created restic repository 491274901d at s3:http://localhost:9001/backup

Please note that knowledge of your password is required to access
the repository. Losing your password means that your data is
irrecoverably lost.
2.42user 0.06system 0:08.58elapsed 29%CPU (0avgtext+0avgdata 77164maxresident)k
27048inputs+0outputs (4major+27834minor)pagefaults 0swaps

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://localhost:9001/backup backup --verbose /data/joerg/sas_data
open repository
enter password for repository:
repository 49127490 opened successfully, password is correct
lock repository
load index files
start scan on [/data/joerg/sas_data]
start backup on [/data/joerg/sas_data]
scan finished in 4.832s: 56029 files, 113.198 GiB
uploaded intermediate index 56a3f587
uploaded intermediate index b2626b26
uploaded intermediate index 87ff9957
uploaded intermediate index 8e0efbc6

Files:       56029 new,     0 changed,     0 unmodified
Dirs:            2 new,     0 changed,     0 unmodified
Data Blobs:  89059 new
Tree Blobs:      3 new
Added to the repo: 101.716 GiB

processed 56029 files, 113.198 GiB in 10:04
snapshot e55242f2 saved
4401.77user 534.34system 10:04.76elapsed 816%CPU (0avgtext+0avgdata 960448maxresident)k
237503784inputs+213623512outputs (8major+16865746minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r  backup    4401.78s user 534.35s system 816% cpu 10:04.83 total

% sudo du -sh /data/joerg/minio1
102G    /data/joerg/minio1

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://localhost:9001/backup snapshots
enter password for repository:
repository 49127490 opened successfully, password is correct
ID        Time                 Host        Tags        Paths
---------------------------------------------------------------------------
e55242f2  2018-10-02 12:02:34  sl1t0rci28              /data/joerg/sas_data
---------------------------------------------------------------------------
1 snapshots
0.56user 0.02system 0:02.78elapsed 21%CPU (0avgtext+0avgdata 43844maxresident)k
352inputs+0outputs (2major+11183minor)pagefaults 0swaps

% sudo rm -rf /data/joerg/restore/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://localhost:9001/backup restore e55242f2 --target /data/joerg/restore
enter password for repository:
repository 49127490 opened successfully, password is correct
restoring <Snapshot e55242f2 of [/data/joerg/sas_data] at 2018-10-02 12:02:34.517504707 +0200 CEST by root@sl1t0rci28> to /data/joerg/restore
1170.13user 174.72system 30:56.21elapsed 72%CPU (0avgtext+0avgdata 110260maxresident)k
70392inputs+237395320outputs (2major+838513minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r  restore    1170.14s user 174.73s system 72% cpu 30:56.23 total

Restic compression to S3 (local)

% export AWS_ACCESS_KEY_ID=AFX7B1RPU6OFEY3FTBLV
% export AWS_SECRET_ACCESS_KEY=04AhpRra7dOWYGPguNn+QEDGb8KijkfEc2P1Vd+t

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://localhost:9002/backup init
enter password for new repository:
enter password again:
created restic repository 8e09bb4b29 at s3:http://localhost:9002/backup

Please note that knowledge of your password is required to access
the repository. Losing your password means that your data is
irrecoverably lost.
2.61user 0.04system 0:06.68elapsed 39%CPU (0avgtext+0avgdata 77360maxresident)k
0inputs+0outputs (0major+19562minor)pagefaults 0swaps

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://localhost:9002/backup backup --verbose /data/joerg/sas_data
open repository
enter password for repository:
repository 8e09bb4b opened successfully, password is correct
lock repository
load index files
start scan on [/data/joerg/sas_data]
start backup on [/data/joerg/sas_data]
scan finished in 5.037s: 56029 files, 113.198 GiB
uploaded intermediate index b7b2f572
uploaded intermediate index d68323b7

Files:       56029 new,     0 changed,     0 unmodified
Dirs:            2 new,     0 changed,     0 unmodified
Data Blobs:  88464 new
Tree Blobs:      3 new
Added to the repo: 101.692 GiB

processed 56029 files, 113.198 GiB in 5:43
snapshot b3507c95 saved
2523.15user 130.23system 5:43.73elapsed 771%CPU (0avgtext+0avgdata 922344maxresident)k
237457912inputs+17923152outputs (8major+14148919minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r  backup  2523.16s user 130.24s system 771% cpu 5:43.75 total
% sudo -E du -sh /data/joerg/minio2
8.6G    /data/joerg/minio2

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://localhost:9002/backup snapshots
enter password for repository:
repository 8e09bb4b opened successfully, password is correct
ID        Time                 Host        Tags        Paths
---------------------------------------------------------------------------
b3507c95  2018-10-02 13:02:00  sl1t0rci28              /data/joerg/sas_data
---------------------------------------------------------------------------
1 snapshots
0.56user 0.90system 0:03.71elapsed 39%CPU (0avgtext+0avgdata 43856maxresident)k
5880inputs+8outputs (3major+11175minor)pagefaults 0swaps

% sudo rm -rf /data/joerg/restore/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://localhost:9002/backup restore b3507c95 --target /data/joerg/restore
enter password for repository:
repository 8e09bb4b opened successfully, password is correct
restoring <Snapshot b3507c95 of [/data/joerg/sas_data] at 2018-10-02 13:02:00.14949605 +0200 CEST by root@sl1t0rci28> to /data/joerg/restore
910.36user 117.98system 19:28.72elapsed 87%CPU (0avgtext+0avgdata 114716maxresident)k
28112inputs+237407672outputs (3major+1030969minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r  restor  910.37s user 117.99s system 87% cpu 19:28.74 total

Restic upstream to local

% sudo -E rm -rf /data/joerg/restic_bare/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r /data/joerg/restic_bare init
enter password for new repository:
enter password again:
created restic repository 455ba9a76a at /data/joerg/restic_bare

Please note that knowledge of your password is required to access
the repository. Losing your password means that your data is
irrecoverably lost.
2.37user 0.29system 0:06.49elapsed 41%CPU (0avgtext+0avgdata 76044maxresident)k
27048inputs+16outputs (4major+19199minor)pagefaults 0swaps

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r /data/joerg/restic_bare backup --verbose /data/joerg/sas_data
open repository
enter password for repository:
repository 455ba9a7 opened successfully, password is correct
lock repository
load index files
start scan on [/data/joerg/sas_data]
start backup on [/data/joerg/sas_data]
scan finished in 4.286s: 56029 files, 113.198 GiB
uploaded intermediate index 64a716a5
uploaded intermediate index 7ed7184c
uploaded intermediate index 086d996f

Files:       56029 new,     0 changed,     0 unmodified
Dirs:            2 new,     0 changed,     0 unmodified
Data Blobs:  90009 new
Tree Blobs:      3 new
Added to the repo: 101.700 GiB

processed 56029 files, 113.198 GiB in 8:33
snapshot 7650d87a saved
2475.43user 365.24system 8:33.39elapsed 553%CPU (0avgtext+0avgdata 822940maxresident)k
237464976inputs+426961200outputs (11major+18389502minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r  backup    2475.44s user 365.25s system 553% cpu 8:33.41 total

% sudo du -sh /data/joerg/restic_bare
102G    /data/joerg/restic_bare

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r /data/joerg/restic_bare snapshots
enter password for repository:
repository 455ba9a7 opened successfully, password is correct
ID        Time                 Host        Tags        Paths
---------------------------------------------------------------------------
7650d87a  2018-10-02 13:37:29  sl1t0rci28              /data/joerg/sas_data
---------------------------------------------------------------------------
1 snapshots
0.55user 0.85system 0:03.68elapsed 38%CPU (0avgtext+0avgdata 42192maxresident)k
4088inputs+8outputs (3major+10742minor)pagefaults 0swaps

% sudo rm -rf /data/joerg/restore/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r /data/joerg/restic_bare restore 7650d87a --target /data/joerg/restore
enter password for repository:
repository 455ba9a7 opened successfully, password is correct
restoring <Snapshot 7650d87a of [/data/joerg/sas_data] at 2018-10-02 13:37:29.388698485 +0200 CEST by root@sl1t0rci28> to /data/joerg/restore
1065.91user 146.16system 26:06.40elapsed 77%CPU (0avgtext+0avgdata 142552maxresident)k
213524984inputs+237395336outputs (2major+1143184minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r  restore    1065.92s user 146.17s system 77% cpu 26:06.42 total

Restic compression to local

% sudo -E rm -rf /data/joerg/restic_bare/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r /data/joerg/restic_bare init
enter password for new repository:
enter password again:
created restic repository 8dae372f09 at /data/joerg/restic_bare

Please note that knowledge of your password is required to access
the repository. Losing your password means that your data is
irrecoverably lost.
2.39user 0.04system 0:06.26elapsed 38%CPU (0avgtext+0avgdata 76236maxresident)k
28200inputs+16outputs (4major+19257minor)pagefaults 0swaps

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r /data/joerg/restic_bare backup --verbose /data/joerg/sas_data
open repository
enter password for repository:
repository 8dae372f opened successfully, password is correct
lock repository
load index files
start scan on [/data/joerg/sas_data]
start backup on [/data/joerg/sas_data]
scan finished in 4.385s: 56029 files, 113.198 GiB
uploaded intermediate index a2974080
uploaded intermediate index 007ea3ab

Files:       56029 new,     0 changed,     0 unmodified
Dirs:            2 new,     0 changed,     0 unmodified
Data Blobs:  90772 new
Tree Blobs:      3 new
Added to the repo: 101.708 GiB

processed 56029 files, 113.198 GiB in 5:20
snapshot 144fce49 saved
2390.58user 121.04system 5:21.00elapsed 782%CPU (0avgtext+0avgdata 892392maxresident)k
237444960inputs+35854144outputs (5major+16574486minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r  backup  2390.59s user 121.06s system 782% cpu 5:21.02 total

% sudo du -sh /data/joerg/restic_bare
8.6G    /data/joerg/restic_bare

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r /data/joerg/restic_bare snapshots
enter password for repository:
repository 8dae372f opened successfully, password is correct
ID        Time                 Host        Tags        Paths
---------------------------------------------------------------------------
144fce49  2018-10-02 14:18:42  sl1t0rci28              /data/joerg/sas_data
---------------------------------------------------------------------------
1 snapshots
0.53user 0.03system 0:02.55elapsed 22%CPU (0avgtext+0avgdata 42336maxresident)k
8224inputs+8outputs (4major+10777minor)pagefaults 0swaps

% sudo rm -rf /data/joerg/restore/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r /data/joerg/restic_bare restore 144fce49 --target /data/joerg/restore
enter password for repository:
repository 8dae372f opened successfully, password is correct
restoring <Snapshot 144fce49 of [/data/joerg/sas_data] at 2018-10-02 14:18:42.769005961 +0200 CEST by root@sl1t0rci28> to /data/joerg/restore
830.91user 98.90system 16:57.77elapsed 91%CPU (0avgtext+0avgdata 109740maxresident)k
17901048inputs+237395288outputs (0major+1228463minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r  restor  830.92s user 98.91s system 91% cpu 16:57.79 total

Restic S3 remote upstream

% export AWS_ACCESS_KEY_ID=1R0DGAWBPQDPUPA69G4E
% export AWS_SECRET_ACCESS_KEY=PnesIZfk8xC6zvBwqZW6OtPMIX131zYgpIqUSjaH

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://sl1t0rci25:9001/backup init
enter password for new repository:
enter password again:
created restic repository 960c102357 at s3:http://sl1t0rci25:9001/backup

Please note that knowledge of your password is required to access
the repository. Losing your password means that your data is
irrecoverably lost.
2.38user 0.05system 0:06.38elapsed 38%CPU (0avgtext+0avgdata 77532maxresident)k
27032inputs+0outputs (4major+19598minor)pagefaults 0swaps

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://sl1t0rci25:9001/backup backup --verbose /data/joerg/sas_data
/data/joerg/sas_data
open repository
enter password for repository:
repository 960c1023 opened successfully, password is correct
lock repository
load index files
start scan on [/data/joerg/sas_data]
start backup on [/data/joerg/sas_data]
scan finished in 3.511s: 56029 files, 113.198 GiB
uploaded intermediate index 07e4d443
uploaded intermediate index 890feb8a
uploaded intermediate index a0ffa676
uploaded intermediate index 76ed308c
uploaded intermediate index b4b07aeb
uploaded intermediate index 112cbf10

Files:       56029 new,     0 changed,     0 unmodified
Dirs:            2 new,     0 changed,     0 unmodified
Data Blobs:  90591 new
Tree Blobs:      3 new
Added to the repo: 101.693 GiB

processed 56029 files, 113.198 GiB in 17:11
snapshot 3a013641 saved
2937.93user 302.30system 17:12.09elapsed 313%CPU (0avgtext+0avgdata 1029972maxresident)k
235509960inputs+213498496outputs (3major+31845840minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r  backup    2937.94s user 302.31s system 313% cpu 17:12.11 total

% sudo du -sh /opt/minio/minio1 # On remote server
102G    /opt/minio/minio1

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://sl1t0rci25:9001/backup snapshots
enter password for repository:
repository 960c1023 opened successfully, password is correct
ID        Time                 Host        Tags        Paths
---------------------------------------------------------------------------
3a013641  2018-10-02 16:21:16  sl1t0rci28              /data/joerg/sas_data
---------------------------------------------------------------------------
1 snapshots
0.53user 0.04system 0:02.87elapsed 20%CPU (0avgtext+0avgdata 44024maxresident)k
28208inputs+0outputs (4major+11171minor)pagefaults 0swaps

% sudo rm -rf /data/joerg/restore/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r s3:http://sl1t0rci25:9001/backup restore 3a013641 --target /data/joerg/restore
enter password for repository:
repository 960c1023 opened successfully, password is correct
restoring <Snapshot 3a013641 of [/data/joerg/sas_data] at 2018-10-02 16:21:16.32242115 +0200 CEST by root@sl1t0rci28> to /data/joerg/restore
1335.07user 338.42system 46:04.87elapsed 60%CPU (0avgtext+0avgdata 140972maxresident)k
66752inputs+237395376outputs (3major+796255minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-upstream -r  restore    1335.07s user 338.44s system 60% cpu 46:04.89 total

Restic S3 remote compression

% export AWS_ACCESS_KEY_ID=TYTRYKJ8E7AVSZDK0CC6
% export AWS_SECRET_ACCESS_KEY=Z0C7SMXVDf7yVhwPQoLbfUpYdLgi9VDxyTkC/wEY

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://sl1t0rci25:9002/backup init
enter password for new repository:
enter password again:
created restic repository 057b77859c at s3:http://sl1t0rci25:9002/backup

Please note that knowledge of your password is required to access
the repository. Losing your password means that your data is
irrecoverably lost.
2.49user 0.06system 0:05.88elapsed 43%CPU (0avgtext+0avgdata 77340maxresident)k
28200inputs+0outputs (4major+19538minor)pagefaults 0swaps

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://sl1t0rci25:9002/backup backup --verbose /data/joerg/sas_data
open repository
enter password for repository:
repository 057b7785 opened successfully, password is correct
lock repository
load index files
start scan on [/data/joerg/sas_data]
start backup on [/data/joerg/sas_data]
scan finished in 3.729s: 56029 files, 113.198 GiB
uploaded intermediate index aa48da8e
uploaded intermediate index 1cc18b62

Files:       56029 new,     0 changed,     0 unmodified
Dirs:            2 new,     0 changed,     0 unmodified
Data Blobs:  89713 new
Tree Blobs:      3 new
Added to the repo: 101.726 GiB

processed 56029 files, 113.198 GiB in 5:27
snapshot c3751f9f saved
2469.08user 116.40system 5:27.88elapsed 788%CPU (0avgtext+0avgdata 919140maxresident)k
237417480inputs+17933904outputs (6major+15768693minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r  backup  2469.09s user 116.42s system 788% cpu 5:27.91 total

% sudo du -sh /opt/minio/minio2 # On remote server
8.6G    /opt/minio/minio2

% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://sl1t0rci25:9002/backup snapshots
enter password for repository:
repository 057b7785 opened successfully, password is correct
ID        Time                 Host        Tags        Paths
---------------------------------------------------------------------------
c3751f9f  2018-10-02 17:32:04  sl1t0rci28              /data/joerg/sas_data
---------------------------------------------------------------------------
1 snapshots
0.54user 0.02system 0:02.60elapsed 22%CPU (0avgtext+0avgdata 44168maxresident)k
4880inputs+0outputs (2major+11265minor)pagefaults 0swaps

% sudo rm -rf /data/joerg/restore/*
% sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r s3:http://sl1t0rci25:9002/backup restore c3751f9f --target /data/joerg/restore
enter password for repository:
repository 057b7785 opened successfully, password is correct
restoring <Snapshot c3751f9f of [/data/joerg/sas_data] at 2018-10-02 17:32:04.903483835 +0200 CEST by root@sl1t0rci28> to /data/joerg/restore
939.82user 132.48system 21:42.80elapsed 82%CPU (0avgtext+0avgdata 117480maxresident)k
29256inputs+237395272outputs (2major+870316minor)pagefaults 0swaps
sudo -E time /data/joerg/ubik-restic-2018-09-19/restic-compression -r  restor  939.83s user 132.49s system 82% cpu 21:42.82 total
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment