Skip to content

Instantly share code, notes, and snippets.

@defunkt
Forked from dentarg/githubber.rb
Created October 31, 2023 18:16
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save defunkt/dea58d75d3faa091593046b2cc18dd47 to your computer and use it in GitHub Desktop.
Save defunkt/dea58d75d3faa091593046b2cc18dd47 to your computer and use it in GitHub Desktop.
require 'mechanize'
require 'yaml'
$results = []
def find(a, link)
puts "find started on #{link}"
a.get link do |page|
page.search(:css, ".blog-post").each do |post|
h2 = post.search(:css, "h2").first
permalink = "https://github.com" + h2.search(:css, "a").first.attributes["href"].value
if h2.text =~ /githubber/i
begin
published = Time.parse(post.search(:css, ".blog-post-meta").first).strftime("%F")
rescue
end
name = $1.strip if h2.text =~ /(.*) is/
row = [ published, name, permalink ]
$results << row
p row
end
end
next_link = page.links.find { |a| a.rel == ["next"] }
if next_link
find(a, next_link.href)
end
end
end
find(Mechanize.new, "https://github.com/blog")
File.open "output.csv", "w" do |f|
f.puts $results.map { |g| g.join(",") }.join("\n")
end
We can make this file beautiful and searchable if this error is corrected: Illegal quoting in line 142.
2013-03-12,Ciara McGuire,https://github.com/blog/1435-ciara-mcguire-is-a-githubber
2013-03-06,Ben Balter,https://github.com/blog/1432-ben-balter-is-a-githubber
2013-03-05,Grant Rodgers,https://github.com/blog/1431-grant-rodgers-is-a-githubber
2013-03-05,Chrissie Brodigan,https://github.com/blog/1428-chrissie-brodigan-is-a-githubber
2013-03-05,Matt Diephouse,https://github.com/blog/1430-matt-diephouse-is-a-githubber
2013-02-18,Jason Rudolph,https://github.com/blog/1416-jason-rudolph-is-a-githubber
2013-02-18,Derek Sorkin,https://github.com/blog/1418-derek-sorkin-is-a-githubber
2013-02-18,Peter Furia,https://github.com/blog/1417-peter-furia-is-a-githubber
2013-02-05,Jessica Roll,https://github.com/blog/1403-jessica-roll-is-a-githubber
2013-02-04,Markus Olsson,https://github.com/blog/1400-markus-olsson-is-a-githubber
2013-01-17,Brian Levine,https://github.com/blog/1383-brian-levine-is-a-githubber
2013-01-14,Pat Nakajima,https://github.com/blog/1380-pat-nakajima-is-a-githubber
2013-01-08,Haleigh Sheehan,https://github.com/blog/1376-haleigh-sheehan-is-a-githubber
2013-01-08,Brent Beer,https://github.com/blog/1373-brent-beer-is-a-githubber
2013-01-07,Garen Torikian,https://github.com/blog/1372-garen-torikian-is-a-githubber
2012-12-19,Sara Pyle,https://github.com/blog/1362-sara-pyle-is-a-githubber
2012-12-10,Julio Avalos,https://github.com/blog/1352-julio-avalos-is-a-githubber
2012-12-10,Michael Gorsuch,https://github.com/blog/1350-michael-gorsuch-is-a-githubber
2012-12-10,Alex Howells,https://github.com/blog/1351-alex-howells-is-a-githubber
2012-12-03,Elizabeth Naramore,https://github.com/blog/1342-elizabeth-naramore-is-a-githubber
2012-12-03,Vlado Herman,https://github.com/blog/1343-vlado-herman-is-a-githubber
2012-12-03,Mike Adolphs,https://github.com/blog/1341-mike-adolphs-is-a-githubber
2012-12-03,Daniel Hengeveld,https://github.com/blog/1338-daniel-hengeveld-is-a-githubber
2012-11-29,Craig Reyes,https://github.com/blog/1333-craig-reyes-is-a-githubber
2012-11-26,Ben Toews,https://github.com/blog/1330-ben-toews-is-a-githubber
2012-11-26,Andy Delcambre,https://github.com/blog/1329-andy-delcambre-is-a-githubber
2012-11-14,Robert Sese,https://github.com/blog/1317-robert-sese-is-a-githubber
2012-11-13,Scott Roberts,https://github.com/blog/1315-scott-roberts-is-a-githubber
2012-11-12,Mutwin Kraus,https://github.com/blog/1314-mutwin-kraus-is-a-githubber
,Alyson Heineman La,https://github.com/blog/1305-alyson-heineman-la-is-a-githubber
2012-10-22,Mark Otto,https://github.com/blog/1304-mark-otto-is-a-githubber
2012-10-18,Aden Beihl,https://github.com/blog/1298-aden-beihl-is-a-githubber
2012-10-15,Jared Pace,https://github.com/blog/1295-jared-pace-is-a-githubber
2012-10-15,Liz Clinkenbeard,https://github.com/blog/1294-liz-clinkenbeard-is-a-githubber
2012-10-15,James Fryman,https://github.com/blog/1293-james-fryman-is-a-githubber
2012-10-15,James Kang,https://github.com/blog/1292-james-kang-is-a-githubber
2012-10-02,Peter Williams,https://github.com/blog/1279-peter-williams-is-a-githubber
2012-09-26,Amber Agard,https://github.com/blog/1278-amber-agard-is-a-githubber
2012-09-24,Matt Yoho,https://github.com/blog/1275-matt-yoho-is-a-githubber
2012-09-24,Matt Burke,https://github.com/blog/1273-matt-burke-is-a-githubber
2012-09-17,Josh Vera,https://github.com/blog/1265-josh-vera-is-a-githubber
2012-09-17,Alan Rogers,https://github.com/blog/1263-alan-rogers-is-a-githubber
2012-09-17,Mark Imbriaco,https://github.com/blog/1262-mark-imbriaco-is-a-githubber
2012-09-05,Nicolás Sanguinetti,https://github.com/blog/1251-nicol-s-sanguinetti-is-a-githubber
2012-09-04,Saloni Dudziak,https://github.com/blog/1250-saloni-dudziak-is-a-githubber
2012-08-27,Ben Lavender,https://github.com/blog/1238-ben-lavender-is-a-githubber
2012-08-27,Lincoln Stoll,https://github.com/blog/1237-lincoln-stoll-is-a-githubber
2012-08-20,Steve Ward,https://github.com/blog/1231-steve-ward-is-a-githubber
2012-08-20,John Britton,https://github.com/blog/1233-john-britton-is-a-githubber
2012-08-20,David Barr,https://github.com/blog/1232-david-barr-is-a-githubber
2012-08-07,Shay Frendt,https://github.com/blog/1225-shay-frendt-is-a-githubber
2012-08-06,Curt Micol,https://github.com/blog/1222-curt-micol-is-a-githubber
2012-08-01,Tim Berglund,https://github.com/blog/1216-tim-berglund-is-a-githubber
2012-07-23,Jenifer Duke,https://github.com/blog/1206-jenifer-duke-is-a-githubber
2012-07-23,Patrick Dunnam,https://github.com/blog/1205-patrick-dunnam-is-a-githubber
2012-07-23,John Greet,https://github.com/blog/1208-john-greet-is-a-githubber
2012-07-23,Jerry Cheung,https://github.com/blog/1207-jerry-cheung-is-a-githubber
2012-07-16,Justin Spahr-Summers,https://github.com/blog/1201-justin-spahr-summers-is-a-githubber
2012-07-09,Jason Dixon,https://github.com/blog/1193-jason-dixon-is-a-githubber
2012-07-09,Derek Greentree,https://github.com/blog/1192-derek-greentree-is-a-githubber
2012-07-09,Austin Spires,https://github.com/blog/1191-austin-spires-is-a-githubber
2012-07-09,Zachary Kaplan,https://github.com/blog/1190-zachary-kaplan-is-a-githubber
2012-07-09,Luke Hefson,https://github.com/blog/1186-luke-hefson-is-a-githubber
2012-07-09,Drew Miller,https://github.com/blog/1188-drew-miller-is-a-githubber
2012-06-25,Yossef Mendelssohn,https://github.com/blog/1179-yossef-mendelssohn-is-a-githubber
2012-06-25,Kevin Barnes,https://github.com/blog/1177-kevin-barnes-is-a-githubber
2012-06-25,Rick Bradley,https://github.com/blog/1176-rick-bradley-is-a-githubber
2012-06-25,Jared Koumentis,https://github.com/blog/1175-jared-koumentis-is-a-githubber
2012-06-19,Emma Bryant,https://github.com/blog/1171-emma-bryant-is-a-githubber
2012-06-19,Julia West,https://github.com/blog/1172-julia-west-is-a-githubber
2012-06-18,Scott Goldman,https://github.com/blog/1167-scott-goldman-is-a-githubber
2012-06-18,Ted Nyman,https://github.com/blog/1166-ted-nyman-is-a-githubber
2012-06-18,Keavy McMinn,https://github.com/blog/1165-keavy-mcminn-is-a-githubber
2012-06-12,Chad Humphries,https://github.com/blog/1159-chad-humphries-is-a-githubber
2012-06-11,Slava Shirokov,https://github.com/blog/1158-slava-shirokov-is-a-githubber
2012-06-04,Paul Sadauskas,https://github.com/blog/1148-paul-sadauskas-is-a-githubber
2012-06-04,Coby Chapple,https://github.com/blog/1147-coby-chapple-is-a-githubber
2012-06-04,Mike Skalnik,https://github.com/blog/1145-mike-skalnik-is-a-githubber
2012-06-04,Drew Woods,https://github.com/blog/1146-drew-woods-is-a-githubber
2012-05-29,Will Farrington,https://github.com/blog/1143-will-farrington-is-a-githubber
2012-05-21,David Graham,https://github.com/blog/1141-david-graham-is-a-githubber
2012-05-21,Wynn Netherland,https://github.com/blog/1140-wynn-netherland-is-a-githubber
2012-05-15,Billy Roh,https://github.com/blog/1136-billy-roh-is-a-githubber
2012-05-07,Ryan Waldron,https://github.com/blog/1132-ryan-waldron-is-a-githubber
2012-05-07,Tony Jaramillo,https://github.com/blog/1131-tony-jaramillo-is-a-githubber
2012-05-07,Jeremy Mcanally,https://github.com/blog/1130-jeremy-mcanally-is-a-githubber
2012-04-30,Shawn Davenport,https://github.com/blog/1117-shawn-davenport-is-a-githubber
2012-04-30,Tim Pease,https://github.com/blog/1116-tim-pease-is-a-githubber
2012-04-23,Rob Sanheim,https://github.com/blog/1110-rob-sanheim-is-a-githubber
2012-04-23,Ben Straub,https://github.com/blog/1109-ben-straub-is-a-githubber
2012-04-23,David Calavera,https://github.com/blog/1108-david-calavera-is-a-githubber
2012-04-09,Jason Salaz,https://github.com/blog/1099-jason-salaz-is-a-githubber
2012-04-09,Sean Bryant,https://github.com/blog/1097-sean-bryant-is-a-githubber
2012-04-09,Danish Khan,https://github.com/blog/1096-danish-khan-is-a-githubber
2012-04-02,Kyros Starr,https://github.com/blog/1092-kyros-starr-is-a-githubber
2012-03-26,Jason Long,https://github.com/blog/1087-jason-long-is-a-githubber
2012-03-26,John Barnette,https://github.com/blog/1086-john-barnette-is-a-githubber
2012-03-19,Lee Huffman,https://github.com/blog/1083-lee-huffman-is-a-githubber
2012-03-19,Julie Ann Horvath,https://github.com/blog/1082-julie-ann-horvath-is-a-githubber
2012-03-12,David Newman,https://github.com/blog/1078-david-newman-is-a-githubber
2012-03-05,Adam Roben,https://github.com/blog/1072-adam-roben-is-a-githubber
2012-03-05,Matthew McCullough,https://github.com/blog/1071-matthew-mccullough-is-a-githubber
2012-02-20,Garrett Bjerkhoel,https://github.com/blog/1043-garrett-bjerkhoel-is-a-githubber
2012-02-20,Brian Doll,https://github.com/blog/1042-brian-doll-is-a-githubber
2012-02-13,Jake Douglas,https://github.com/blog/1038-jake-douglas-is-a-githubber
2012-01-17,Russell Belfer,https://github.com/blog/1026-russell-belfer-is-a-githubber
2012-01-16,Danny Greg,https://github.com/blog/1025-danny-greg-is-a-githubber
2011-12-09,Eric Gerhardt,https://github.com/blog/1006-eric-gerhardt-is-a-githubber
2011-12-08,Nathan Sobo,https://github.com/blog/1005-nathan-sobo-is-a-githubber
2011-12-07,Phil Haack,https://github.com/blog/1002-phil-haack-is-a-githubber
2011-12-06,Jon Rohan,https://github.com/blog/999-jon-rohan-is-a-githubber
2011-12-05,Matt Graham,https://github.com/blog/998-matt-graham-is-a-githubber
2011-12-05,Brandon Keepers,https://github.com/blog/997-brandon-keepers-is-a-githubber
2011-12-05,Jonathan Hoyt,https://github.com/blog/996-jonathan-hoyt-is-a-githubber
2011-12-05,John Nunemaker,https://github.com/blog/995-john-nunemaker-is-a-githubber
2011-12-05,Steve Smith,https://github.com/blog/994-steve-smith-is-a-githubber
2011-12-05,Ordered List,https://github.com/blog/993-ordered-list-is-a-githubber
2011-12-01,Sonya Green,https://github.com/blog/991-sonya-green-is-a-githubber
2011-11-07,Joel Watson,https://github.com/blog/983-joel-watson-is-a-githubber
2011-10-26,Jake Boxer,https://github.com/blog/973-jake-boxer-is-a-githubber
2011-10-24,Lee Reilly,https://github.com/blog/972-lee-reilly-is-a-githubber
2011-10-18,Nick Hengeveld,https://github.com/blog/963-nick-hengeveld-is-a-githubber
2011-10-10,Roberto Tyley,https://github.com/blog/954-roberto-tyley-is-a-githubber
2011-09-26,Justin Palmer,https://github.com/blog/940-justin-palmer-is-a-githubber
2011-09-08,Jina Bolton,https://github.com/blog/927-jina-bolton-is-a-githubber
2011-08-25,Jesse Newland,https://github.com/blog/915-jesse-newland-is-a-githubber
2011-08-22,Alex Williams,https://github.com/blog/913-alex-williams-is-a-githubber
2011-08-01,Paul Betts,https://github.com/blog/899-paul-betts-is-a-githubber
2011-07-18,Jon Maddox,https://github.com/blog/887-jon-maddox-is-a-githubber
2011-06-07,Matt Todd,https://github.com/blog/869-matt-todd-is-a-githubber
2011-06-02,Kami Lott,https://github.com/blog/867-kami-lott-is-a-githubber
2011-05-02,Ben Burkert,https://github.com/blog/849-ben-burkert-is-a-githubber
2011-04-19,Jason Costello,https://github.com/blog/839-jason-costello-is-a-githubber
2011-04-04,Ben Bleikamp,https://github.com/blog/830-ben-bleikamp-is-a-githubber
2011-04-01,Josh Peek,https://github.com/blog/827-josh-peek-is-a-githubber
2011-03-29,Vicent Marti,https://github.com/blog/826-vicent-marti-is-a-githubber
2011-03-28,Alex Malinovich,https://github.com/blog/824-alex-malinovich-is-a-githubber
2011-03-15,Kevin Sawicki,https://github.com/blog/814-kevin-sawicki-is-a-githubber
2011-02-28,Josh Abernathy,https://github.com/blog/801-josh-abernathy-is-a-githubber
2011-02-11,Tater,https://github.com/blog/794-tater-is-a-githubber
2011-02-10,Aman Gupta (tmm1),https://github.com/blog/792-aman-gupta-tmm1-is-a-githubber
2011-02-09,Simon "sr" Rozet,https://github.com/blog/790-simon-sr-rozet-is-a-githubber
2011-02-08,Mislav Marohnić,https://github.com/blog/788-mislav-marohni-is-a-githubber
2011-02-07,Tim Clem,https://github.com/blog/786-tim-clem-is-a-githubber
2011-02-01,Corey Johnson,https://github.com/blog/779-corey-johnson-is-a-githubber
2011-01-17,Cameron McEfee,https://github.com/blog/772-cameron-mcefee-is-a-githubber
2011-01-03,Jeff King (Peff),https://github.com/blog/766-jeff-king-peff-is-a-githubber
2011-01-03,Bryan Veloso,https://github.com/blog/764-bryan-veloso-is-a-githubber
2010-11-01,Brian Lopez,https://github.com/blog/740-brian-lopez-is-a-githubber
2010-09-24,Tim Sharpe,https://github.com/blog/723-tim-sharpe-is-a-githubber
2010-09-15,Eston Bond,https://github.com/blog/719-eston-bond-is-a-githubber
2010-08-30,Corey Donohoe,https://github.com/blog/711-corey-donohoe-is-a-githubber
2010-04-05,Rick Olson,https://github.com/blog/629-rick-olson-is-a-githubber
2010-03-16,Zach Holman,https://github.com/blog/619-zach-holman-is-a-githubber
2009-10-19,Ryan Tomayko,https://github.com/blog/529-ryan-tomayko-is-a-githubber
2009-10-05,Kyle Neath,https://github.com/blog/512-kyle-neath-is-a-githubber
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment