shiondev/create_crawl_sample

Last active August 29, 2015 13:57

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/shiondev/9628133.js"></script>
Save shiondev/9628133 to your computer and use it in GitHub Desktop.

Download ZIP

Create a crawl

Raw

create_crawl_sample

> curl -X PUT https://your_user_token:@api.80legs.com/v2/crawls/name_of_crawl -H "Content-Type: application/json" -d "{\"app\": \"full_page_content.js\", \"urllist\": \"name_of_url_list\", \"data\": \"name_of_data_file\", \"max_depth\": 1, \"max_urls\": 10 }" -i

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment