Skip to content

Instantly share code, notes, and snippets.

@fernandez14
Created March 29, 2017 01:54
Show Gist options
  • Save fernandez14/5c83e1148d3fc505ee411b3418916956 to your computer and use it in GitHub Desktop.
Save fernandez14/5c83e1148d3fc505ee411b3418916956 to your computer and use it in GitHub Desktop.
Spider-srv API calls examples.
{
"name": {"use": "text", "value": "h1 span", "filters": ["trim-space"]},
"screen": {"use": "text", "value": "#phone div[data-gallery] .col-xs-16 div.bor-t-1", "filters": ["trim-space"]},
"os": {"use": "text", "value": "#phone div[data-gallery] .col-xs-16 div.bor-t-1", "i": 1, "filters": ["trim-space"]},
"camera": {"use": "text", "value": "#phone div[data-gallery] .col-xs-16 div.bor-t-1", "i": 2, "filters": ["trim-space"]},
"storage": {"use": "text", "value": "#phone div[data-gallery] .col-xs-16 div.bor-t-1", "i": 3, "filters": ["trim-space"]},
}
micro query sg.micro.srv.spider Spider.TrackSitemap '{
"from": "https://data.domain/motorcycles",
"name": "Motorcycles",
"depth": 4,
"patterns": {
"home": "^https://data\\.domain/motorcycles/?$",
"motorcycle-brand": "^https://data\\.domain/motorcycles/([[:alnum:]\\-]+)$",
"motorcycle": "^https://data\\.domain/motorcycles/([[:alnum:]\\-]+)/([[:alnum:]\\-]+)$"
}
}'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment