Skip to content

Instantly share code, notes, and snippets.

@dangra

dangra/start-crawl

Created March 31, 2017 16:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dangra/59e4071cca43ff74889fbde634c3f696 to your computer and use it in GitHub Desktop.
Save dangra/59e4071cca43ff74889fbde634c3f696 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
start-crawl
#!/bin/sh
set -e
SPIDER=$(echo "$SHUB_JOB_DATA" |jq -r .spider)
ARGS="$(echo "$SHUB_JOB_DATA" |jq -r '.spider_args|to_entries|.[]|"--\(.key)=\(.value)"')"
echo "$SPIDER" $ARGS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment