Methodology:
- Access mobile site using Chrome device debugging tools
- Record network activity
- Save as HAR
- Clean recording
Using jq
(brew install jq
):
cat mobile.nytimes.com.20151006.har | \
jq '.log.entries | map( [.startedDateTime, .time, .request.url, .response.content.mimeType, .response.content.size, (.response.content.size - (.response.content.compression // 0)) ] | @tsv ) | .[]' > mobile.nytimes.com.20151006.tsv
V2:
cat mobile.nytimes.com.har | \
jq '.log.entries | map( [.startedDateTime, .time, .request.url, .response.content.mimeType, .response.content.size, (.response.content.size - (.response.content.compression // 0)), .response._transferSize, .response.status, .response.statusText ] ) | .[] | @csv' -r >> mobile.nytimes.com.csv
``