Skip to content

Instantly share code, notes, and snippets.

View rustam18's full-sized avatar
🏠
Working from home

Rustam Kumar rustam18

🏠
Working from home
View GitHub Profile
@rustam18
rustam18 / Prallel_Rsynch.sh
Last active May 30, 2019 11:41
Concurrent sync with parallel threads increase your sync speed by 4 times
cat /home/rusti/<dir_list>.txt | parallel --will-cite -j4 time rsync -ahrzp user@<source>:<source_dir> <dest_dir>
The fastest remote directory rsync over ssh using GNU utility parallel which will run concurrent threads at the same time.
a: archive mode - rescursive, preserves owner, preserves permissions, preserves modification times, preserves group, copies symlinks as symlinks, preserves device files.
h: human-readable output numbers in a human-readable format
r: recursive
z: compress during transfer
p: progress
-will-cite -j4: four threads, it should not be more than the 1.5 * number of cpu chores you have on your system.