Skip to content

Instantly share code, notes, and snippets.

@cb372
Created June 9, 2016 13:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save cb372/5b60dfbead0e9067af9737ea63e4951f to your computer and use it in GitHub Desktop.
Save cb372/5b60dfbead0e9067af9737ea63e4951f to your computer and use it in GitHub Desktop.
1000 most frequent words in recent Guardian articles in "UK news" section
the: 458186
to: 222092
of: 201833
and: 184094
a: 175172
in: 158131
was: 83367
that: 82857
for: 73595
on: 71485
he: 61466
is: 58295
it: 49634
with: 47746
at: 44885
as: 44690
said: 43517
by: 41256
be: 40769
have: 39826
had: 38852
his: 36201
from: 35976
has: 32448
been: 31521
are: 31215
not: 30683
were: 29980
i: 29255
who: 29045
they: 28829
an: 28084
but: 28083
police: 27739
she: 26792
this: 26316
her: 25198
we: 23986
will: 21677
after: 20423
would: 20389
their: 20260
which: 18952
about: 17613
there: 17080
or: 16553
people: 15886
one: 15821
when: 15216
more: 14729
out: 13329
all: 13061
london: 12956
you: 12740
up: 12504
also: 12462
told: 12055
no: 11912
over: 11819
two: 11516
if: 11449
into: 11387
being: 11091
what: 10816
its: 10567
than: 10564
him: 10314
court: 10230
could: 10028
so: 9836
years: 9805
them: 9560
time: 9501
last: 9355
some: 9075
home: 8920
other: 8831
public: 8773
services: 8646
uk: 8621
our: 8612
before: 8527
can: 8450
new: 8433
year: 7960
any: 7951
my: 7904
just: 7704
family: 7616
now: 7574
officers: 7535
first: 7456
where: 7448
man: 7446
found: 7435
those: 7396
very: 7254
because: 7246
made: 7184
may: 7116
do: 7037
only: 6974
government: 6888
should: 6705
how: 6585
three: 6488
while: 6427
british: 6135
did: 6041
between: 5962
like: 5957
then: 5856
many: 5655
case: 5612
most: 5597
work: 5559
us: 5548
against: 5544
these: 5419
under: 5391
get: 5382
back: 5302
during: 5292
former: 5254
day: 5197
such: 5113
children: 5046
office: 5034
including: 4972
way: 4951
down: 4937
heard: 4906
service: 4893
me: 4893
around: 4869
labour: 4766
report: 4755
make: 4750
through: 4697
take: 4676
since: 4641
evidence: 4592
part: 4592
local: 4569
death: 4547
investigation: 4520
scotland: 4426
still: 4390
number: 4338
going: 4288
taken: 4279
community: 4227
life: 4173
another: 4145
says: 4134
see: 4127
four: 4097
much: 4090
say: 4089
trial: 4055
place: 4051
well: 4049
city: 4040
later: 4037
asked: 4024
even: 4023
young: 4020
support: 3999
know: 3997
northern: 3977
off: 3963
men: 3963
both: 3933
information: 3932
arrested: 3920
national: 3868
think: 3862
come: 3855
murder: 3849
left: 3836
help: 3803
west: 3793
officer: 3772
week: 3757
next: 3755
go: 3749
died: 3717
council: 3716
called: 3714
used: 3690
house: 3608
need: 3599
chief: 3594
britain: 3578
school: 3561
want: 3551
further: 3545
woman: 3532
world: 3521
put: 3509
following: 3498
child: 3466
never: 3452
royal: 3428
across: 3402
group: 3371
staff: 3354
area: 3349
hospital: 3340
crime: 3304
north: 3297
your: 3295
south: 3291
england: 3289
met: 3270
women: 3261
party: 3248
secretary: 3245
given: 3233
described: 3199
five: 3176
months: 3174
own: 3171
whether: 3162
news: 3160
security: 3147
same: 3145
minister: 3144
david: 3141
days: 3097
working: 3092
took: 3089
went: 3086
got: 3083
incident: 3079
seen: 3078
high: 3077
inquiry: 3067
judge: 3043
set: 3041
attack: 3003
good: 2990
country: 2986
right: 2967
too: 2946
without: 2941
members: 2925
having: 2922
ireland: 2898
use: 2893
until: 2847
might: 2843
jury: 2840
sexual: 2828
came: 2823
however: 2817
end: 2807
force: 2805
head: 2804
mother: 2778
long: 2772
legal: 2763
road: 2759
money: 2758
hours: 2752
justice: 2751
night: 2748
involved: 2734
abuse: 2733
east: 2732
centre: 2703
why: 2701
thought: 2698
victims: 2697
scottish: 2690
health: 2689
street: 2682
already: 2660
alleged: 2635
decision: 2634
john: 2617
tax: 2597
car: 2576
crown: 2541
away: 2537
body: 2527
here: 2520
every: 2491
killed: 2461
manchester: 2460
political: 2457
due: 2457
six: 2447
social: 2429
wales: 2429
believed: 2426
far: 2424
second: 2422
statement: 2409
senior: 2398
really: 2394
anyone: 2383
friday: 2375
serious: 2369
fire: 2369
must: 2358
tuesday: 2356
charged: 2351
find: 2351
outside: 2350
known: 2343
guilty: 2342
pay: 2336
earlier: 2333
monday: 2328
defence: 2321
within: 2312
times: 2300
clear: 2297
wednesday: 2296
according: 2293
state: 2292
face: 2281
believe: 2279
accused: 2278
expected: 2266
director: 2237
families: 2233
claims: 2232
spokesman: 2228
few: 2228
month: 2211
thursday: 2202
old: 2198
likely: 2197
action: 2197
company: 2185
private: 2183
allegations: 2181
able: 2161
campaign: 2158
friends: 2158
give: 2153
happened: 2144
held: 2141
early: 2141
morning: 2130
near: 2127
something: 2119
making: 2117
mr: 2114
ago: 2106
media: 2099
phone: 2096
cameron: 2095
yet: 2094
act: 2092
each: 2085
saying: 2085
general: 2079
system: 2078
always: 2058
wanted: 2050
taking: 2050
sunday: 2050
am: 2046
others: 2044
done: 2039
law: 2036
added: 2035
care: 2027
father: 2027
housing: 2020
business: 2019
transport: 2016
again: 2016
does: 2015
past: 2005
call: 2004
girl: 1993
claimed: 1990
look: 1989
show: 1986
prison: 1975
among: 1975
little: 1972
least: 1971
become: 1968
full: 1963
close: 1959
guardian: 1958
order: 1952
great: 1951
immigration: 1949
led: 1929
policy: 1929
station: 1910
dead: 1909
team: 1907
son: 1906
prosecution: 1903
boy: 1902
change: 1901
review: 1901
mp: 1896
reported: 1892
victim: 1892
homes: 1891
less: 1889
trying: 1888
university: 1887
risk: 1882
member: 1879
forces: 1866
criminal: 1862
war: 1857
march: 1856
safety: 1853
parents: 1851
saw: 1844
things: 1830
syria: 1827
operation: 1826
person: 1825
living: 1825
prime: 1825
plans: 1811
released: 1809
rail: 1804
best: 1795
several: 1795
doing: 1794
executive: 1793
leader: 1793
better: 1793
possible: 1791
figures: 1787
job: 1781
open: 1774
search: 1771
international: 1767
run: 1764
rather: 1761
point: 1759
although: 1756
hearing: 1753
power: 1753
weeks: 1752
despite: 1751
received: 1742
charges: 1739
building: 1737
scene: 1720
course: 1710
once: 1708
continue: 1705
felt: 1703
line: 1698
cases: 1698
sent: 1693
behind: 1691
almost: 1687
offences: 1685
future: 1681
missing: 1680
ever: 1674
independent: 1672
sex: 1672
issue: 1669
greater: 1669
small: 1667
important: 1665
election: 1658
april: 1658
daughter: 1654
lost: 1654
whose: 1654
committee: 1653
prince: 1652
feel: 1649
though: 1649
stop: 1644
concerns: 1644
became: 1642
air: 1636
big: 1635
bbc: 1635
wife: 1632
using: 1630
deal: 1625
areas: 1624
different: 1621
park: 1621
along: 1621
aged: 1618
result: 1618
large: 1618
live: 1606
name: 1605
quite: 1603
education: 1599
yorkshire: 1599
johnson: 1598
mps: 1598
trust: 1596
cuts: 1595
seven: 1593
friend: 1592
contact: 1592
inquest: 1592
black: 1589
july: 1575
qc: 1573
assault: 1567
recent: 1562
major: 1562
budget: 1562
knew: 1561
white: 1559
george: 1558
himself: 1553
train: 1553
lives: 1549
move: 1549
looking: 1548
fact: 1548
brought: 1547
today: 1538
someone: 1537
military: 1536
worked: 1535
keep: 1534
mrs: 1534
together: 1534
nothing: 1533
process: 1531
central: 1526
admitted: 1524
story: 1523
cannot: 1523
property: 1521
paid: 1520
saturday: 1518
january: 1513
charge: 1513
sir: 1512
army: 1511
james: 1507
mayor: 1505
lot: 1503
eu: 1494
mark: 1492
intelligence: 1490
water: 1488
rights: 1485
role: 1484
workers: 1483
failed: 1479
appeared: 1474
forward: 1471
reports: 1469
appeal: 1466
official: 1466
attacks: 1455
enough: 1452
anything: 1452
real: 1452
september: 1449
meeting: 1446
belfast: 1446
hit: 1444
coming: 1442
metropolitan: 1440
published: 1440
often: 1439
jailed: 1437
hope: 1433
town: 1429
parliament: 1428
significant: 1428
remain: 1424
caused: 1421
difficult: 1420
december: 1417
human: 1412
top: 1412
leave: 1411
named: 1410
suspicion: 1400
couple: 1396
coulson: 1395
cut: 1394
response: 1393
vote: 1393
green: 1392
claim: 1390
groups: 1388
gave: 1387
increase: 1385
injuries: 1384
carried: 1384
union: 1382
tried: 1381
august: 1380
half: 1379
getting: 1379
parts: 1378
authorities: 1377
ensure: 1376
confirmed: 1375
bring: 1367
foreign: 1363
remains: 1361
officials: 1361
detectives: 1361
eight: 1360
began: 1359
cost: 1358
suffered: 1356
killing: 1354
warned: 1353
start: 1351
control: 1351
cause: 1351
issues: 1351
arrest: 1347
thing: 1347
weather: 1342
return: 1342
denied: 1340
armed: 1338
osborne: 1337
started: 1333
project: 1333
free: 1332
site: 1326
interest: 1323
michael: 1322
threat: 1317
june: 1314
towards: 1314
programme: 1313
spent: 1313
st: 1312
raised: 1311
provide: 1300
schools: 1292
hard: 1288
queen: 1286
plan: 1284
everyone: 1282
charity: 1280
spending: 1279
european: 1276
passengers: 1276
november: 1275
powers: 1275
particularly: 1273
announced: 1273
capital: 1270
wrong: 1268
current: 1267
october: 1266
planning: 1265
whole: 1265
late: 1265
conservative: 1263
letter: 1263
means: 1259
needs: 1259
previous: 1255
front: 1252
ministers: 1248
evening: 1246
english: 1244
terrorism: 1239
travel: 1238
asylum: 1237
level: 1237
revealed: 1235
age: 1234
it's: 1233
richard: 1233
sun: 1233
period: 1232
shot: 1231
hacking: 1231
impact: 1231
europe: 1228
thousands: 1227
migrants: 1226
birmingham: 1225
girls: 1225
unit: 1224
ira: 1223
sure: 1222
lord: 1220
problems: 1214
history: 1211
numbers: 1211
showed: 1210
convicted: 1209
running: 1208
vulnerable: 1201
potential: 1201
personal: 1200
training: 1199
custody: 1198
bus: 1197
khan: 1195
needed: 1192
paul: 1191
safe: 1189
commission: 1189
residents: 1187
questions: 1185
online: 1179
third: 1178
peter: 1177
rise: 1177
room: 1174
violence: 1173
giving: 1173
details: 1169
lead: 1167
account: 1162
position: 1162
previously: 1160
conditions: 1158
record: 1157
tell: 1156
press: 1155
moved: 1155
concerned: 1155
key: 1154
jurors: 1151
short: 1151
decided: 1151
policing: 1150
network: 1144
allowed: 1142
problem: 1140
scheme: 1139
higher: 1139
forced: 1138
special: 1136
tory: 1136
speaking: 1135
gone: 1133
hall: 1128
land: 1128
financial: 1126
data: 1125
strong: 1124
february: 1124
access: 1121
series: 1121
matter: 1121
sentence: 1119
investigating: 1118
arrived: 1117
launched: 1116
communities: 1115
closed: 1114
huge: 1112
editor: 1112
leading: 1109
emergency: 1109
glasgow: 1108
question: 1108
jobs: 1108
relationship: 1101
medical: 1101
themselves: 1097
church: 1097
side: 1092
airport: 1088
terrorist: 1088
weekend: 1086
based: 1086
inside: 1085
view: 1084
try: 1084
terms: 1081
charles: 1081
turned: 1080
discovered: 1076
agency: 1075
include: 1073
aware: 1071
read: 1069
ground: 1069
meet: 1068
bailey: 1068
costs: 1067
bit: 1065
main: 1060
bank: 1060
deputy: 1059
nhs: 1056
treated: 1055
event: 1053
minutes: 1051
visit: 1050
cash: 1048
pressure: 1048
agreed: 1046
commissioner: 1046
events: 1045
muslim: 1044
iraq: 1044
soon: 1043
average: 1042
allow: 1040
let: 1039
address: 1039
appear: 1037
crash: 1037
longer: 1037
either: 1037
westminster: 1036
industry: 1036
treatment: 1035
trains: 1034
wrote: 1033
currently: 1032
department: 1032
debate: 1030
teenager: 1028
nine: 1027
hand: 1027
kind: 1027
rape: 1026
william: 1025
protect: 1023
board: 1022
comes: 1022
funding: 1020
latest: 1019
instead: 1016
included: 1016
total: 1012
brooks: 1011
bill: 1010
midlands: 1009
calls: 1009
idea: 1007
love: 1005
whom: 1005
everything: 1003
husband: 1001
economic: 1001
driver: 1000
actually: 998
behaviour: 997
brother: 996
leaving: 996
identified: 996
issued: 994
ahead: 993
ambulance: 986
single: 983
heart: 983
suggested: 983
yard: 982
chancellor: 978
understand: 974
affected: 973
low: 973
mean: 972
society: 970
lived: 969
rest: 964
civil: 964
circumstances: 963
duty: 962
countries: 962
witness: 961
paper: 961
planned: 960
allegedly: 958
bridge: 958
recently: 955
returned: 955
association: 955
similar: 955
undercover: 952
harris: 952
isis: 951
andrew: 951
food: 950
research: 948
bristol: 947
strike: 947
garden: 946
complaints: 945
rain: 945
christmas: 944
extra: 943
stories: 942
dr: 942
offer: 938
changes: 938
rescue: 937
speak: 936
letters: 936
ask: 936
college: 928
experience: 928
estate: 927
majority: 927
video: 926
market: 920
mental: 918
injured: 918
concern: 917
summer: 917
simply: 916
boys: 915
constable: 914
damage: 914
chair: 912
final: 912
knife: 912
development: 912
companies: 911
consider: 909
prevent: 909
economy: 908
article: 908
kent: 908
hundreds: 906
attempt: 905
warning: 905
crisis: 900
jones: 899
politicians: 898
spoke: 897
committed: 897
interview: 896
fall: 896
refused: 893
nearby: 892
fight: 891
situation: 891
hear: 891
stage: 890
shows: 890
bad: 890
seems: 889
baby: 889
light: 888
carry: 887
measures: 885
nuclear: 885
responsible: 884
protection: 884
message: 882
recorded: 882
probably: 882
looked: 882
king: 881
deaths: 879
music: 879
welfare: 879
rate: 878
million: 878
hands: 876
organisation: 874
students: 874
emerged: 872
lawyers: 872
door: 871
french: 871
extremely: 870
secret: 870
authority: 868
suspect: 868
source: 868
benefits: 866
nearly: 864
hotel: 862
available: 861
offence: 861
counts: 860
meant: 858
journalists: 856
reasons: 856
built: 854
continued: 854
written: 852
followed: 851
amount: 850
telling: 850
biggest: 848
form: 848
offered: 848
stay: 847
shortly: 846
student: 845
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment