rdaneel-verbose-output.txt

[814196581] [2010-08-07 02:08:31] * Started fetching robots.txt from: http://127.0.0.1:8080/robots.txt for: http://127.0.0.1:8080/redirect_me
[814196581] [2010-08-07 02:08:31] * Found robots.txt at http://127.0.0.1:8080/robots.txt:
[814196581] [2010-08-07 02:08:31] * User-agent: *
[814196581] [2010-08-07 02:08:31] * Disallow: /private
[814196581] [2010-08-07 02:08:31] * Robots identified by user agent: RDaneel are allowed to access: http://127.0.0.1:8080/redirect_me
[814196581] [2010-08-07 02:08:31] * Started fetching: http://127.0.0.1:8080/redirect_me
[814196581] [2010-08-07 02:08:31] > user-agent: RDaneel
[814196581] [2010-08-07 02:08:31] * Redirected to: http://127.0.0.1:8080/hello_world from: http://127.0.0.1:8080/redirect_me
[814196581] [2010-08-07 02:08:31] < 301
[814196581] [2010-08-07 02:08:31] < CONTENT_LENGTH: 0
[814196581] [2010-08-07 02:08:31] < DATE: Sat, 07 Aug 2010 06:46:31 GMT
[814196581] [2010-08-07 02:08:31] < LOCATION: http://127.0.0.1:8080/hello_world
[814196581] [2010-08-07 02:08:31] < SERVER: WEBrick/1.3.1 (Ruby/1.8.7/2010-06-23)
[814196581] [2010-08-07 02:08:31] < CONNECTION: Keep-Alive
[814196581] [2010-08-07 02:08:31] * Found cached robots.txt:
[814196581] [2010-08-07 02:08:31] * User-agent: *
[814196581] [2010-08-07 02:08:31] * Disallow: /private for: http://127.0.0.1:8080/hello_world
[814196581] [2010-08-07 02:08:31] * Robots identified by user agent: RDaneel are allowed to access: http://127.0.0.1:8080/hello_world
[814196581] [2010-08-07 02:08:31] * Started fetching: http://127.0.0.1:8080/hello_world
[814196581] [2010-08-07 02:08:31] > user-agent: RDaneel
[814196581] [2010-08-07 02:08:31] * Succeded fetching: http://127.0.0.1:8080/hello_world
[814196581] [2010-08-07 02:08:31] < 200
[814196581] [2010-08-07 02:08:31] < CONTENT_LENGTH: 12
[814196581] [2010-08-07 02:08:31] < DATE: Sat, 07 Aug 2010 06:46:31 GMT
[814196581] [2010-08-07 02:08:31] < SERVER: WEBrick/1.3.1 (Ruby/1.8.7/2010-06-23)
[814196581] [2010-08-07 02:08:31] < CONNECTION: Keep-Alive