Skip to content

Instantly share code, notes, and snippets.

@davidread
Created November 18, 2016 15:37
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save davidread/6a2148797e9ad3807f3cd167b29a05c2 to your computer and use it in GitHub Desktop.
Save davidread/6a2148797e9ad3807f3cd167b29a05c2 to your computer and use it in GitHub Desktop.
Top domains in data.gov.uk resources
SELECT substring( R.url from '.*://([^/]*)' ) as hostname, count(substring( R.url from '.*://([^/]*)' )) from resource R
JOIN resource_group RG ON R.resource_group_id = RG.id
JOIN Package P ON P.id = RG.package_id
WHERE R.state='active' and P.state='active'
GROUP BY hostname
ORDER BY count desc;
hostname | count
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------
www.gov.uk | 20151
www.ons.gov.uk | 7016
aws2.caris.com | 4194
publications.naturalengland.org.uk | 4188
data.defra.gov.uk | 3389
data.gov.uk | 3351
environment.data.gov.uk | 2640
geoportal.statistics.gov.uk | 2332
www.cps.gov.uk | 2151
wales.gov.uk | 1921
data.cefas.co.uk | 1628
www.hscic.gov.uk | 1553
inspire.misoportal.com | 1488
data.jncc.gov.uk | 1426
data.yorkopendata.org | 1326
s3-eu-west-1.amazonaws.com | 1308
misoportal.com | 1088
files.datapress.com | 979
ons-inspire.esriuk.com | 879
www.isdscotland.org | 866
aql.datapress.com | 860
www.scotland.gov.uk | 795
opendata.camden.gov.uk | 786
ea.sharefile.com | 765
data.ogauthority.opendata.arcgis.com | 676
data.wycombe.gov.uk | 648
indicators.hscic.gov.uk | 617
www.metoffice.gov.uk | 579
eidc.ceh.ac.uk | 577
essex.astuntechnology.com | 527
www.lichfielddc.gov.uk | 515
www.uktradeinfo.com | 501
www.opendatani.gov.uk | 486
opendata.cambridgeshireinsight.org.uk | 461
data.barrowbc.gov.uk | 457
itportal.decc.gov.uk | 454
catalogue.ceh.ac.uk | 446
www.places.communities.gov.uk | 443
ratings.food.gov.uk | 438
www.ofcom.org.uk | 436
www.england.nhs.uk | 436
datashare.colchester.gov.uk | 432
hmrc.gov.uk | 431
www.dh.gov.uk | 423
www.gmtu.gov.uk | 421
www.bis.gov.uk | 369
data.peterborough.gov.uk | 367
datagov.ic.nhs.uk | 366
data.hounslow.gov.uk | 359
webgis1.barrowbc.gov.uk | 314
data.n-somerset.gov.uk | 313
www.dhsspsni.gov.uk | 311
www.hesa.ac.uk | 305
data.highways.gov.uk | 305
www.forestry.gov.uk | 302
data.horsham.gov.uk | 301
opendatacommunities.org | 293
transparency.dh.gov.uk | 287
www.detini.gov.uk | 284
www.datanorthyorkshire.org | 281
data.dft.gov.uk | 280
www.spatialni.gov.uk | 267
www.decc.gov.uk | 264
www.nisra.gov.uk | 260
www.gistrategyni.gov.uk | 256
www.nationalarchives.gov.uk | 251
www.food.gov.uk | 246
www.sfo.gov.uk | 241
osni.spatial-ni.opendata.arcgis.com | 239
maps.runnymede.gov.uk | 236
sedsh127.sedsh.gov.uk | 232
systems.hscic.gov.uk | 231
www.bgs.ac.uk | 231
www.justice.gov.uk | 228
dataportal.orr.gov.uk | 220
www.ic.nhs.uk | 217
maps.norfolk.gov.uk | 208
www.thedataservice.org.uk | 205
feeds.getmapping.com | 200
www.ordnancesurvey.co.uk | 200
www.landregistry.gov.uk | 199
www.communities.gov.uk | 198
uploads.scarborough.gov.uk | 196
stakeholders.ofcom.org.uk | 191
data.bassetlaw.gov.uk | 188
www.gro-scotland.gov.uk | 184
directgovinnovate.s3.amazonaws.com | 179
media.education.gov.uk | 176
www.sns.gov.uk | 174
www.ofwat.gov.uk | 174
www.dcsf.gov.uk | 174
www.midyorks.nhs.uk | 172
www.hse.gov.uk | 172
gistch1.copelandbc.org.uk | 168
ons.maps.arcgis.com | 166
baberghfme.babergh.gov.uk | 166
www.oceannet.org | 165
data.surreycc.gov.uk | 163
data.cyc.opendata.arcgis.com | 161
mapapps2.bgs.ac.uk | 159
app.newark-sherwooddc.gov.uk | 157
www.southlakeland.gov.uk | 154
www.bristol.gov.uk | 154
www.neighbourhood.statistics.gov.uk | 151
statistics.defra.gov.uk | 150
maps.cheshire.gov.uk | 149
www.rochdale.gov.uk | 148
inspire.nationalparks.gov.uk | 148
www.bbsrc.ac.uk | 147
www.emodnet-seabedhabitats.eu | 146
www.fcoservices.gov.uk | 145
publicdata.landregistry.gov.uk | 143
www.ahrc.ac.uk | 142
geowessex.astuntechnology.com | 140
www.cravendc.gov.uk | 139
www.nhsbsa.nhs.uk | 138
webarchive.nationalarchives.gov.uk | 136
www.epsrc.ac.uk | 133
www.mrc.ac.uk | 130
www.acas.org.uk | 130
www.education.gov.uk | 128
www.ecodriver.uk.com | 128
www.eastcambs.gov.uk | 126
www.hmprisonservice.gov.uk | 126
gis.lichfielddc.gov.uk | 126
www.ucl.ac.uk | 125
data.forestry.opendata.arcgis.com | 125
www.derby.gov.uk | 124
www.hefce.ac.uk | 123
lichfielddc.maps.arcgis.com | 122
map.salford.gov.uk | 121
www.calderdale.gov.uk | 121
www.slc.co.uk | 119
www.tmbc.gov.uk | 117
www.ros.gov.uk | 115
research.dwp.gov.uk | 115
www.channelcoast.org | 114
www.hackney.gov.uk | 114
www.nomisweb.co.uk | 114
www.valuationtribunal.gov.uk | 114
www.rail-reg.gov.uk | 114
www.cheltenham.gov.uk | 112
arcgisweb.fife.gov.uk | 112
www.hpa.org.uk | 111
data.nbn.org.uk | 111
opendatani.blob.core.windows.net | 110
www.justiceinspectorates.gov.uk | 110
www.pendle.gov.uk | 109
www.dft.gov.uk | 107
www.nice.org.uk | 106
maps.northlincs.gov.uk | 106
www.sotw.nhs.uk | 105
inspire.halton.gov.uk | 105
apps1.wdm.co.uk | 104
www.walsallhealthcare.nhs.uk | 104
www.audit-commission.gov.uk | 103
www.allerdale.gov.uk | 102
geonet.allerdale.gov.uk | 102
data.rushmoor.gov.uk | 101
www.tsol.gov.uk | 101
www.sunderland.gov.uk | 100
www.ofsted.gov.uk | 100
www.westernsussexhospitals.nhs.uk | 98
stats.berr.gov.uk | 98
www.manchester.nhs.uk | 97
www.defra.gov.uk | 97
gisservices.spatialni.gov.uk | 97
www.nhfd.co.uk | 96
prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com | 96
www.esrc.ac.uk | 96
www.bpcssa.nhs.uk | 96
www.companieshouse.gov.uk | 96
www.stfc.ac.uk | 95
badc.nerc.ac.uk | 95
www.warrington.gov.uk | 95
nsandi-corporate.com | 93
www.blaby.gov.uk | 92
data.passengerfocus.org.uk | 92
www.doeni.gov.uk | 91
orr.gov.uk | 91
new.wales.gov.uk | 91
www.cqc.org.uk | 90
www.channelcoast.org | 114
www.hackney.gov.uk | 114
www.nomisweb.co.uk | 114
www.valuationtribunal.gov.uk | 114
www.rail-reg.gov.uk | 114
www.cheltenham.gov.uk | 112
arcgisweb.fife.gov.uk | 112
www.hpa.org.uk | 111
data.nbn.org.uk | 111
opendatani.blob.core.windows.net | 110
www.justiceinspectorates.gov.uk | 110
www.pendle.gov.uk | 109
www.dft.gov.uk | 107
www.nice.org.uk | 106
maps.northlincs.gov.uk | 106
www.sotw.nhs.uk | 105
inspire.halton.gov.uk | 105
apps1.wdm.co.uk | 104
www.walsallhealthcare.nhs.uk | 104
www.audit-commission.gov.uk | 103
www.allerdale.gov.uk | 102
geonet.allerdale.gov.uk | 102
data.rushmoor.gov.uk | 101
www.tsol.gov.uk | 101
www.sunderland.gov.uk | 100
www.ofsted.gov.uk | 100
www.westernsussexhospitals.nhs.uk | 98
stats.berr.gov.uk | 98
www.manchester.nhs.uk | 97
www.defra.gov.uk | 97
gisservices.spatialni.gov.uk | 97
www.nhfd.co.uk | 96
prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com | 96
www.esrc.ac.uk | 96
www.bpcssa.nhs.uk | 96
www.companieshouse.gov.uk | 96
www.stfc.ac.uk | 95
badc.nerc.ac.uk | 95
www.warrington.gov.uk | 95
nsandi-corporate.com | 93
www.blaby.gov.uk | 92
data.passengerfocus.org.uk | 92
www.doeni.gov.uk | 91
orr.gov.uk | 91
new.wales.gov.uk | 91
www.cqc.org.uk | 90
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment