Skip to content

Instantly share code, notes, and snippets.

@altendky

altendky/x.sh Secret

Created April 28, 2018 02:21
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save altendky/76ea049c084eba4be3ff224e984165d1 to your computer and use it in GitHub Desktop.
Save altendky/76ea049c084eba4be3ff224e984165d1 to your computer and use it in GitHub Desktop.
✘  /data/Photos  rclone config
No remotes found - make a new one
n) New remote
s) Set configuration password
q) Quit config
n/s/q> n
name> acd_proxy
Type of storage to configure.
Choose a number from below, or type in your own value
1 / Alias for a existing remote
\ "alias"
2 / Amazon Drive
\ "amazon cloud drive"
3 / Amazon S3 (also Dreamhost, Ceph, Minio, IBM COS)
\ "s3"
4 / Backblaze B2
\ "b2"
5 / Box
\ "box"
6 / Cache a remote
\ "cache"
7 / Dropbox
\ "dropbox"
8 / Encrypt/Decrypt a remote
\ "crypt"
9 / FTP Connection
\ "ftp"
10 / Google Cloud Storage (this is not Google Drive)
\ "google cloud storage"
11 / Google Drive
\ "drive"
12 / Hubic
\ "hubic"
13 / Local Disk
\ "local"
14 / Microsoft Azure Blob Storage
\ "azureblob"
15 / Microsoft OneDrive
\ "onedrive"
16 / Openstack Swift (Rackspace Cloud Files, Memset Memstore, OVH)
\ "swift"
17 / Pcloud
\ "pcloud"
18 / QingCloud Object Storage
\ "qingstor"
19 / Webdav
\ "webdav"
20 / Yandex Disk
\ "yandex"
21 / http Connection
\ "http"
Storage> 2
Amazon Application Client Id - required.
client_id> rclone
Amazon Application Client Secret - required.
client_secret> acd
Auth server URL - leave blank to use Amazon's.
auth_url> https://quixotic-module-170120.appspot.com/auth
Token server url - leave blank to use Amazon's.
token_url> https://quixotic-module-170120.appspot.com/token
Remote config
Make sure your Redirect URL is set to "http://127.0.0.1:53682/" in your custom config.
Use auto config?
* Say Y if not sure
* Say N if you are working on a remote or headless machine
y) Yes
n) No
y/n> y
If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth
Log in and authorize rclone for access
Waiting for code...
Got code
--------------------
[acd_proxy]
type = amazon cloud drive
client_id = rclone
client_secret = acd
auth_url = https://quixotic-module-170120.appspot.com/auth
token_url = https://quixotic-module-170120.appspot.com/token
token = {"access_token":"<snip>","expiry":"2018-04-27T23:01:32.464176891-04:00"}
--------------------
y) Yes this is OK
e) Edit this remote
d) Delete this remote
y/e/d> y
Current remotes:
Name Type
==== ====
acd_proxy amazon cloud drive
e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> q
/data/Photos  rclone lsd acd_proxy
2018/04/27 22:02:02 ERROR : : error listing: directory not found
2018/04/27 22:02:02 Failed to lsd: directory not found
✘  /data/Photos  ./.rclone
2018/04/27 22:02:13 DEBUG : rclone: Version "v1.40-DEV" starting with parameters ["rclone" "-vv" "copy" "/data/Photos" "acd_proxy:Backup/Photos" "--exclude-from" "/data/Photos/.rclone.exclude"]
2018/04/27 22:02:13 DEBUG : Using config file from "/home/altendky/.rclone.conf"
2018/04/27 22:02:14 DEBUG : pacer: Rate limited, sleeping for 285.84214ms (1 consecutive low level retries)
2018/04/27 22:02:14 DEBUG : pacer: low level retry 1/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:02:14 DEBUG : pacer: Rate limited, sleeping for 739.060364ms (2 consecutive low level retries)
2018/04/27 22:02:14 DEBUG : pacer: low level retry 2/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:02:14 DEBUG : pacer: Rate limited, sleeping for 3.111097356s (3 consecutive low level retries)
2018/04/27 22:02:14 DEBUG : pacer: low level retry 3/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:02:15 DEBUG : pacer: Rate limited, sleeping for 1.459712717s (4 consecutive low level retries)
2018/04/27 22:02:15 DEBUG : pacer: low level retry 4/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
^C⏎ ✘  /data/Photos  cat .rclone
#!/bin/bash
# http://stackoverflow.com/a/246128
SOURCE="${BASH_SOURCE[0]}"
while [ -h "$SOURCE" ]; do # resolve $SOURCE until the file is no longer a symlink
DIR="$( cd -P "$( dirname "$SOURCE" )" && pwd )"
SOURCE="$(readlink "$SOURCE")"
[[ $SOURCE != /* ]] && SOURCE="$DIR/$SOURCE" # if $SOURCE was a relative symlink, we need to resolve it relative to the path where the symlink file was located
done
DIR="$( cd -P "$( dirname "$SOURCE" )" && pwd )"
source "${DIR}"/.rclone.config
if [ "$1" == "--limit" ]; then
export BWLIMIT=--bwlimit=500k
fi
rclone -vv copy "${DIR}" ${REMOTE}:"${NAME}" --exclude-from "${DIR}"/.rclone.exclude ${BWLIMIT}
/data/Photos  ./.rclone --limit
2018/04/27 22:08:52 DEBUG : rclone: Version "v1.40-DEV" starting with parameters ["rclone" "-vv" "copy" "/data/Photos" "acd_proxy:Backup/Photos" "--exclude-from" "/data/Photos/.rclone.exclude" "--bwlimit=500k"]
2018/04/27 22:08:52 DEBUG : Using config file from "/home/altendky/.rclone.conf"
2018/04/27 22:08:52 INFO : Starting bandwidth limiter at 500kBytes/s
2018/04/27 22:08:52 DEBUG : pacer: Rate limited, sleeping for 384.39611ms (1 consecutive low level retries)
2018/04/27 22:08:52 DEBUG : pacer: low level retry 1/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:08:52 DEBUG : pacer: Rate limited, sleeping for 1.889054837s (2 consecutive low level retries)
2018/04/27 22:08:52 DEBUG : pacer: low level retry 2/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:08:52 DEBUG : pacer: Rate limited, sleeping for 709.24363ms (3 consecutive low level retries)
2018/04/27 22:08:52 DEBUG : pacer: low level retry 3/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:08:54 DEBUG : pacer: Rate limited, sleeping for 3.77964623s (4 consecutive low level retries)
2018/04/27 22:08:54 DEBUG : pacer: low level retry 4/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:08:55 DEBUG : pacer: Rate limited, sleeping for 9.985400953s (5 consecutive low level retries)
2018/04/27 22:08:55 DEBUG : pacer: low level retry 5/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
2018/04/27 22:08:59 DEBUG : pacer: Rate limited, sleeping for 7.88635999s (6 consecutive low level retries)
2018/04/27 22:08:59 DEBUG : pacer: low level retry 6/10 (error HTTP code 429: "429 Too Many Requests": response body: "{\"message\":\"Rate exceeded\"}")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment