Skip to content

Instantly share code, notes, and snippets.

View gist:42dcdd49d21a6ad1b26e
# Parses JSON results from WPT e.g.
# Relies on JSON to be locally downloaded first (avoid's timeouts when results need to be retrieved from archive)
# Produces a data.frame with selected values from all test results
# url in code is really a path to a file, all.urls is a data frame with a list of files
View gist:abcca48135ef85e4af7b
1. Install nginx
sudo apt-get install nginx
configure nginx.conf
2. Install PHP
# Fast socket version
andydavies / resourcesperpage.sql
Created Apr 18, 2012
Extracts data to plot a histogram of resources vs count of pages from HTTP Archive data
View resourcesperpage.sql
-- Extracts data to plot histogram of resources vs count of pages from HTTP Archive data
-- For bigger groupings change ROUND(resources, 0): -1 = 10, -2 = 100
SELECT ROUND(resources, 0) AS ResourcesPerPage,
COUNT(*) AS Pages
FROM (select count(*) as resources from requests group by pageid) as temp
GROUP BY ResourcesPerPage;
andydavies / gist:2517046
Created Apr 28, 2012
Find icons in HTTPArchive.ord data
View gist:2517046
-- Find the favicon in data
-- TODO: filter just of favicon.ico (still need mimetype?)
select * from requests where mimeType = 'image/x-icon'
andydavies / gist:2a82839e30bff61dcffb
Created Dec 9, 2015
Bookmarklet for
View gist:2a82839e30bff61dcffb
Save this script as a bookmark, then use it to test the current page
javascript:(function(){hostname=document.location.hostname;'' + hostname);})();
andydavies / gist:4358912
Created Dec 22, 2012
View-Source bookmarklet for webkit (only ?) browsers works on iOS Safari e.g. iPad too Based on @weisjohn's bookmarklet with background colour forced to white (
View gist:4358912
javascript:(function(){i=document.createElement('iframe');i.setAttribute('viewsource');i.setAttribute('width', '100%');i.src=location.href;document.body.insertBefore(i, document.body.childNodes[0]);'#fff';})();
andydavies / gist:3cdcca42bd9f4289424c
Created Dec 10, 2015
Query for HTTPArchive BigQuery data to list all font files for sites x top sites
View gist:3cdcca42bd9f4289424c
select pages.url, pages.rank, req.url
from [httparchive:runs.latest_requests] as req
join (
select url, rank, pageid, reqFont from [httparchive:runs.latest_pages]
) as pages on pages.pageid = req.pageid
where lower(req.mimetype) contains "font"
and pages.rank <= 100 and pages.reqFont > 0
order by pages.rank
andydavies / gist:5489399
Created Apr 30, 2013
Quova API example - when tested it didn't support IPv6 and cellular gateways were always reported as line_speed:low regardless of end user connection
View gist:5489399
"organization":"vodafone limited",
"carrier":"vodafone limited",
"connection_type":"mobile wireless",
View gist:5917537
andydavies / gist:6006984
Created Jul 16, 2013
DNS records for publish and but connections to fail so effectively waiting for TCP timeout before resolution
View gist:6006984
Andy-Daviess-MacBook-Pro:tmp ad$ wget
--2013-07-16 09:33:56--
Connecting to||:443... failed: Operation timed out.
Connecting to||:443... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: [following]
--2013-07-16 09:35:13--
Connecting to||:443... connected.
You can’t perform that action at this time.