Andy Davies andydavies

## gist:42dcdd49d21a6ad1b26e
# Parses JSON results from WPT e.g. http://www.webpagetest.org/result/140506_W2_c46551bac76ab45d87e7e2f32c3159e6/?f=json
# Relies on JSON to be locally downloaded first (avoid's timeouts when results need to be retrieved from archive)
# Produces a data.frame with selected values from all test results

# url in code is really a path to a file, all.urls is a data frame with a list of files


require(RCurl)
require(stringr)
require(rjson)

## gist:abcca48135ef85e4af7b
1. Install nginx

sudo apt-get install nginx

configure nginx.conf

2. Install PHP

# Fast socket version

## resourcesperpage.sql
-- Extracts data to plot histogram of resources vs count of pages from HTTP Archive data
-- For bigger groupings change ROUND(resources, 0): -1 = 10, -2 = 100

SELECT ROUND(resources, 0) AS ResourcesPerPage,
COUNT(*) AS Pages
FROM (select count(*) as resources from requests group by pageid) as temp
GROUP BY ResourcesPerPage;

## gist:2517046
-- Find the favicon in HTTPArchive.org data
-- TODO: filter just of favicon.ico (still need mimetype?)

select * from requests where mimeType = 'image/x-icon'

## gist:2a82839e30bff61dcffb
Save this script as a bookmark, then use it to test the current page

javascript:(function(){hostname=document.location.hostname;window.open('https://securityheaders.io/?q=' + hostname);})();

## gist:4358912
javascript:(function(){i=document.createElement('iframe');i.setAttribute('viewsource');i.setAttribute('width', '100%');i.src=location.href;document.body.insertBefore(i, document.body.childNodes[0]);i.style.backgroundColor='#fff';})();

## gist:3cdcca42bd9f4289424c
select pages.url, pages.rank, req.url
from [httparchive:runs.latest_requests] as req
join (
  select url, rank, pageid, reqFont from [httparchive:runs.latest_pages]
) as pages on pages.pageid = req.pageid
where lower(req.mimetype) contains "font"
and pages.rank <= 100 and pages.reqFont > 0
order by pages.rank

## gist:5489399
{
   "ipinfo":{
      "ip_address":"212.183.128.252",
      "ip_type":"Mapped",
      "Network":{
         "organization":"vodafone limited",
         "carrier":"vodafone limited",
         "asn":25135,
         "connection_type":"mobile wireless",
         "line_speed":"low",

## gist:5917537
@courtneynash
@estellevw
@tameverts
@bbinto
@denisejacobs
@daianacheng
@kaelifa
@anna_debenham
@gerbille
@viviancromwell

## gist:6006984
Andy-Daviess-MacBook-Pro:tmp ad$ wget https://t.co/tdI2DYxUZh
--2013-07-16 09:33:56--  https://t.co/tdI2DYxUZh
Resolving t.co... 199.16.156.11, 199.16.156.75
Connecting to t.co|199.16.156.11|:443... failed: Operation timed out.
Connecting to t.co|199.16.156.75|:443... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://itunes.apple.com/gb/app/ia-writer/id439623248?mt=12 [following]
--2013-07-16 09:35:13--  https://itunes.apple.com/gb/app/ia-writer/id439623248?mt=12
Resolving itunes.apple.com... 95.100.130.217
Connecting to itunes.apple.com|95.100.130.217|:443... connected.