Skip to content

Instantly share code, notes, and snippets.

@mikecmpbll
Last active August 29, 2015 14:26
Show Gist options
  • Save mikecmpbll/e6b149846cd51396ebf9 to your computer and use it in GitHub Desktop.
Save mikecmpbll/e6b149846cd51396ebf9 to your computer and use it in GitHub Desktop.
just a whole load of "\x00"...
2.1.1 :038 > detail_page = agent.get("http://www.soccerpunter.com/soccer-statistics/England/Premier-League-2014-2015/match/1704235_Arsenal_FC_vs_West_Bromwich_Albion_FC")
I, [2015-08-06T10:27:21.186779 #41902] INFO -- : Net::HTTP::Get: /soccer-statistics/England/Premier-League-2014-2015/match/1704235_Arsenal_FC_vs_West_Bromwich_Albion_FC
D, [2015-08-06T10:27:21.187194 #41902] DEBUG -- : request-header: accept-encoding => gzip,deflate,identity
D, [2015-08-06T10:27:21.187319 #41902] DEBUG -- : request-header: accept => */*
D, [2015-08-06T10:27:21.187548 #41902] DEBUG -- : request-header: user-agent => Mechanize/2.7.3 Ruby/2.1.1p76 (http://github.com/sparklemotion/mechanize/)
D, [2015-08-06T10:27:21.187687 #41902] DEBUG -- : request-header: accept-charset => ISO-8859-1,utf-8;q=0.7,*;q=0.7
D, [2015-08-06T10:27:21.187802 #41902] DEBUG -- : request-header: accept-language => en-us,en;q=0.5
D, [2015-08-06T10:27:21.187925 #41902] DEBUG -- : request-header: cookie => PHPSESSID=f4a8b8f3cd44a37f1e076b3a506b8c31; auth=ok; bb_sessionhash=b81bf0d665009d2fca30e2d4b695346d; bet_userid=45972; dad=45972
D, [2015-08-06T10:27:21.188046 #41902] DEBUG -- : request-header: host => www.soccerpunter.com
I, [2015-08-06T10:27:21.477479 #41902] INFO -- : status: Net::HTTPOK 1.1 200 OK
D, [2015-08-06T10:27:21.477757 #41902] DEBUG -- : response-header: date => Thu, 06 Aug 2015 09:27:20 GMT
D, [2015-08-06T10:27:21.478003 #41902] DEBUG -- : response-header: server => Apache/2.2.29 (Unix) mod_ssl/2.2.29 OpenSSL/0.9.8e-fips-rhel5 mod_bwlimited/1.4 PHP/5.5.22
D, [2015-08-06T10:27:21.478177 #41902] DEBUG -- : response-header: x-powered-by => PHP/5.5.22
D, [2015-08-06T10:27:21.478420 #41902] DEBUG -- : response-header: expires => Thu, 19 Nov 1981 08:52:00 GMT
D, [2015-08-06T10:27:21.478616 #41902] DEBUG -- : response-header: cache-control => no-store, no-cache, must-revalidate, post-check=0, pre-check=0
D, [2015-08-06T10:27:21.478830 #41902] DEBUG -- : response-header: pragma => no-cache
D, [2015-08-06T10:27:21.479038 #41902] DEBUG -- : response-header: content-encoding => gzip
D, [2015-08-06T10:27:21.479260 #41902] DEBUG -- : response-header: content-length => 101791
D, [2015-08-06T10:27:21.479468 #41902] DEBUG -- : response-header: vary => User-Agent
D, [2015-08-06T10:27:21.479753 #41902] DEBUG -- : response-header: connection => close
D, [2015-08-06T10:27:21.479949 #41902] DEBUG -- : response-header: content-type => text/html; charset=utf-8
D, [2015-08-06T10:27:21.480946 #41902] DEBUG -- : Read 924 bytes (924 total)
D, [2015-08-06T10:27:21.495070 #41902] DEBUG -- : Read 1368 bytes (2292 total)
D, [2015-08-06T10:27:21.517702 #41902] DEBUG -- : Read 1368 bytes (3660 total)
D, [2015-08-06T10:27:21.617711 #41902] DEBUG -- : Read 1368 bytes (5028 total)
D, [2015-08-06T10:27:21.636134 #41902] DEBUG -- : Read 1368 bytes (6396 total)
D, [2015-08-06T10:27:21.657365 #41902] DEBUG -- : Read 1368 bytes (7764 total)
D, [2015-08-06T10:27:21.676954 #41902] DEBUG -- : Read 1368 bytes (9132 total)
D, [2015-08-06T10:27:21.697509 #41902] DEBUG -- : Read 1368 bytes (10500 total)
D, [2015-08-06T10:27:21.739559 #41902] DEBUG -- : Read 1368 bytes (11868 total)
D, [2015-08-06T10:27:21.758081 #41902] DEBUG -- : Read 1368 bytes (13236 total)
D, [2015-08-06T10:27:21.778786 #41902] DEBUG -- : Read 1368 bytes (14604 total)
D, [2015-08-06T10:27:21.800315 #41902] DEBUG -- : Read 1368 bytes (15972 total)
D, [2015-08-06T10:27:21.818212 #41902] DEBUG -- : Read 1368 bytes (17340 total)
D, [2015-08-06T10:27:21.835731 #41902] DEBUG -- : Read 1368 bytes (18708 total)
D, [2015-08-06T10:27:21.854428 #41902] DEBUG -- : Read 1368 bytes (20076 total)
D, [2015-08-06T10:27:21.873063 #41902] DEBUG -- : Read 1368 bytes (21444 total)
D, [2015-08-06T10:27:21.893458 #41902] DEBUG -- : Read 1368 bytes (22812 total)
D, [2015-08-06T10:27:21.914486 #41902] DEBUG -- : Read 1368 bytes (24180 total)
D, [2015-08-06T10:27:21.933046 #41902] DEBUG -- : Read 1368 bytes (25548 total)
D, [2015-08-06T10:27:21.951199 #41902] DEBUG -- : Read 1368 bytes (26916 total)
D, [2015-08-06T10:27:21.969805 #41902] DEBUG -- : Read 1368 bytes (28284 total)
D, [2015-08-06T10:27:21.992043 #41902] DEBUG -- : Read 1368 bytes (29652 total)
D, [2015-08-06T10:27:22.015980 #41902] DEBUG -- : Read 1368 bytes (31020 total)
D, [2015-08-06T10:27:22.035729 #41902] DEBUG -- : Read 1368 bytes (32388 total)
D, [2015-08-06T10:27:22.054800 #41902] DEBUG -- : Read 1368 bytes (33756 total)
D, [2015-08-06T10:27:22.074014 #41902] DEBUG -- : Read 1368 bytes (35124 total)
D, [2015-08-06T10:27:22.094319 #41902] DEBUG -- : Read 1368 bytes (36492 total)
D, [2015-08-06T10:27:22.113417 #41902] DEBUG -- : Read 1368 bytes (37860 total)
D, [2015-08-06T10:27:22.135913 #41902] DEBUG -- : Read 1368 bytes (39228 total)
D, [2015-08-06T10:27:22.155356 #41902] DEBUG -- : Read 1368 bytes (40596 total)
D, [2015-08-06T10:27:22.172951 #41902] DEBUG -- : Read 1368 bytes (41964 total)
D, [2015-08-06T10:27:22.191260 #41902] DEBUG -- : Read 1368 bytes (43332 total)
D, [2015-08-06T10:27:22.211340 #41902] DEBUG -- : Read 1368 bytes (44700 total)
D, [2015-08-06T10:27:22.235376 #41902] DEBUG -- : Read 1368 bytes (46068 total)
D, [2015-08-06T10:27:22.259392 #41902] DEBUG -- : Read 1368 bytes (47436 total)
D, [2015-08-06T10:27:22.279603 #41902] DEBUG -- : Read 1368 bytes (48804 total)
D, [2015-08-06T10:27:22.297596 #41902] DEBUG -- : Read 1368 bytes (50172 total)
D, [2015-08-06T10:27:22.314845 #41902] DEBUG -- : Read 1368 bytes (51540 total)
D, [2015-08-06T10:27:22.337982 #41902] DEBUG -- : Read 1368 bytes (52908 total)
D, [2015-08-06T10:27:22.360606 #41902] DEBUG -- : Read 1368 bytes (54276 total)
D, [2015-08-06T10:27:22.384538 #41902] DEBUG -- : Read 1368 bytes (55644 total)
D, [2015-08-06T10:27:22.406143 #41902] DEBUG -- : Read 1368 bytes (57012 total)
D, [2015-08-06T10:27:22.424683 #41902] DEBUG -- : Read 1368 bytes (58380 total)
D, [2015-08-06T10:27:22.442183 #41902] DEBUG -- : Read 1368 bytes (59748 total)
D, [2015-08-06T10:27:22.466887 #41902] DEBUG -- : Read 1368 bytes (61116 total)
D, [2015-08-06T10:27:22.489583 #41902] DEBUG -- : Read 1368 bytes (62484 total)
D, [2015-08-06T10:27:22.513525 #41902] DEBUG -- : Read 1368 bytes (63852 total)
D, [2015-08-06T10:27:22.537492 #41902] DEBUG -- : Read 1368 bytes (65220 total)
D, [2015-08-06T10:27:22.557387 #41902] DEBUG -- : Read 1368 bytes (66588 total)
D, [2015-08-06T10:27:22.574903 #41902] DEBUG -- : Read 1368 bytes (67956 total)
D, [2015-08-06T10:27:22.593457 #41902] DEBUG -- : Read 1368 bytes (69324 total)
D, [2015-08-06T10:27:22.615865 #41902] DEBUG -- : Read 1368 bytes (70692 total)
D, [2015-08-06T10:27:22.639812 #41902] DEBUG -- : Read 1368 bytes (72060 total)
D, [2015-08-06T10:27:22.663800 #41902] DEBUG -- : Read 1368 bytes (73428 total)
D, [2015-08-06T10:27:22.684667 #41902] DEBUG -- : Read 1368 bytes (74796 total)
D, [2015-08-06T10:27:22.702201 #41902] DEBUG -- : Read 1368 bytes (76164 total)
D, [2015-08-06T10:27:22.720202 #41902] DEBUG -- : Read 1368 bytes (77532 total)
D, [2015-08-06T10:27:22.739015 #41902] DEBUG -- : Read 1368 bytes (78900 total)
D, [2015-08-06T10:27:22.761552 #41902] DEBUG -- : Read 1368 bytes (80268 total)
D, [2015-08-06T10:27:22.782403 #41902] DEBUG -- : Read 1368 bytes (81636 total)
D, [2015-08-06T10:27:22.802346 #41902] DEBUG -- : Read 1368 bytes (83004 total)
D, [2015-08-06T10:27:22.819912 #41902] DEBUG -- : Read 1368 bytes (84372 total)
D, [2015-08-06T10:27:22.837900 #41902] DEBUG -- : Read 1368 bytes (85740 total)
D, [2015-08-06T10:27:22.856502 #41902] DEBUG -- : Read 1368 bytes (87108 total)
D, [2015-08-06T10:27:22.877005 #41902] DEBUG -- : Read 1368 bytes (88476 total)
D, [2015-08-06T10:27:22.895914 #41902] DEBUG -- : Read 1368 bytes (89844 total)
D, [2015-08-06T10:27:22.916486 #41902] DEBUG -- : Read 1368 bytes (91212 total)
D, [2015-08-06T10:27:22.934437 #41902] DEBUG -- : Read 1368 bytes (92580 total)
D, [2015-08-06T10:27:22.952087 #41902] DEBUG -- : Read 1368 bytes (93948 total)
D, [2015-08-06T10:27:22.970950 #41902] DEBUG -- : Read 1368 bytes (95316 total)
D, [2015-08-06T10:27:22.991192 #41902] DEBUG -- : Read 1368 bytes (96684 total)
D, [2015-08-06T10:27:23.011526 #41902] DEBUG -- : Read 1368 bytes (98052 total)
D, [2015-08-06T10:27:23.031777 #41902] DEBUG -- : Read 1368 bytes (99420 total)
D, [2015-08-06T10:27:23.049959 #41902] DEBUG -- : Read 1368 bytes (100788 total)
D, [2015-08-06T10:27:23.063371 #41902] DEBUG -- : Read 1003 bytes (101791 total)
D, [2015-08-06T10:27:23.064963 #41902] DEBUG -- : gzip response
=> #<Mechanize::Page
{url
#<URI::HTTP:0x00000101c58508 URL:http://www.soccerpunter.com/soccer-statistics/England/Premier-League-2014-2015/match/1704235_Arsenal_FC_vs_West_Bromwich_Albion_FC>}
{meta_refresh}
{title nil}
{iframes}
{frames}
{links}
{forms}>
2.1.1 :039 > detail_page.content.length
=> 104857600
2.1.1 :040 > detail_page.body.length
=> 104857600
2.1.1 :041 > detail_page.body.first
=> "\x00"
2.1.1 :042 > detail_page.body.last
=> "\x00"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment