-
-
Save JonasGroeger/1b5155e461036b557d0fb4b3307e1e75 to your computer and use it in GitHub Desktop.
| #!/usr/bin/env bash | |
| # Documentation | |
| # https://docs.gitlab.com/ce/api/projects.html#list-projects | |
| NAMESPACE="YOUR_NAMESPACE" | |
| BASE_PATH="https://gitlab.example.com/" | |
| PROJECT_SEARCH_PARAM="" | |
| PROJECT_SELECTION="select(.namespace.name == \"$NAMESPACE\")" | |
| PROJECT_PROJECTION="{ "path": .path, "git": .ssh_url_to_repo }" | |
| if [ -z "$GITLAB_PRIVATE_TOKEN" ]; then | |
| echo "Please set the environment variable GITLAB_PRIVATE_TOKEN" | |
| echo "See ${BASE_PATH}profile/account" | |
| exit 1 | |
| fi | |
| FILENAME="repos.json" | |
| trap "{ rm -f $FILENAME; }" EXIT | |
| curl -s "${BASE_PATH}api/v3/projects?private_token=$GITLAB_PRIVATE_TOKEN&search=$PROJECT_SEARCH_PARAM&per_page=999" \ | |
| | jq --raw-output --compact-output ".[] | $PROJECT_SELECTION | $PROJECT_PROJECTION" > "$FILENAME" | |
| while read repo; do | |
| THEPATH=$(echo "$repo" | jq -r ".path") | |
| GIT=$(echo "$repo" | jq -r ".git") | |
| if [ ! -d "$THEPATH" ]; then | |
| echo "Cloning $THEPATH ( $GIT )" | |
| git clone "$GIT" --quiet & | |
| else | |
| echo "Pulling $THEPATH" | |
| (cd "$THEPATH" && git pull --quiet) & | |
| fi | |
| done < "$FILENAME" | |
| wait |
I opened an issue on ghorg and you can now specify your gitlab instance: gabrie30/ghorg#41
Lots of good solutions detailed above. However, you can also try using ghorg which is small cli that will do most of the work for you. It supports github, gitlab, and bitbucket.
This doesn't seem to work with GitLab Community edition, only gitlab.com, right?
No, it supports all gitlab installations. If you run into any problems feel free to raise issue.
https://github.com/ozaydinb/gitlab-clonner I was inspired by this gist. my version is to clone all projects and sub-projects to different directories. it works for me, without any issue.
Hey @JonasGroeger , when I tried using your script, got an error of "parse error: Invalid numeric literal at line 1, column 16". Not sure exactly what Iam giving wrong, here is the snippet of my code -
#!/usr/bin/env bash
Documentation
https://docs.gitlab.com/ce/api/projects.html#list-projects
NAMESPACE="fsgbu-pbsm/fsgbu-ofspacs/dimension-management"
GITLAB_PRIVATE_TOKEN="xxxx7fcxx32xxxxw4xx"
BASE_PATH="https://cloudlab.us.oracle.com/"
PROJECT_SEARCH_PARAM=""
PROJECT_SELECTION="select(.namespace.name == "$NAMESPACE")"
PROJECT_PROJECTION="{ "path": .path, "git": .ssh_url_to_repo }"
if [ -z "$GITLAB_PRIVATE_TOKEN" ]; then
echo "Please set the environment variable GITLAB_PRIVATE_TOKEN"
echo "See ${BASE_PATH}profile/account"
exit 1
fi
FILENAME="repos.json"
............
Note-> I need to pull all subgroups under group dimension-management.
I wanted to clone also subgroups while keeping the tree structure. Since none of the solutions worked flawless, I wrote my own simple script => https://github.com/adroste/gitlab-clone-group
This doesn't seem to work with GitLab Community edition, only gitlab.com, right?