Skip to content

Instantly share code, notes, and snippets.

@Strubbl

Strubbl/gist:94152c5b0790d290c8b2b8c5be542880

Created May 9, 2017 21:32
Show Gist options
  • Save Strubbl/94152c5b0790d290c8b2b8c5be542880 to your computer and use it in GitHub Desktop.
Save Strubbl/94152c5b0790d290c8b2b8c5be542880 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
[2017-05-09 23:21:30] graby.DEBUG: Graby is ready to fetch [] []
[2017-05-09 23:21:30] graby.DEBUG: . looking for site config for hueniverse.com in primary folder {"host":"hueniverse.com"} []
[2017-05-09 23:21:30] graby.DEBUG: Appending site config settings from global.txt [] []
[2017-05-09 23:21:30] graby.DEBUG: . looking for site config for global in primary folder {"host":"global"} []
[2017-05-09 23:21:30] graby.DEBUG: ... found site config global.txt {"host":"global.txt"} []
[2017-05-09 23:21:30] graby.DEBUG: Cached site config with key: hueniverse.com {"key":"hueniverse.com"} []
[2017-05-09 23:21:30] graby.DEBUG: . looking for site config for global in primary folder {"host":"global"} []
[2017-05-09 23:21:30] graby.DEBUG: ... found site config global.txt {"host":"global.txt"} []
[2017-05-09 23:21:30] graby.DEBUG: Appending site config settings from global.txt [] []
[2017-05-09 23:21:30] graby.DEBUG: Cached site config with key: global {"key":"global"} []
[2017-05-09 23:21:30] graby.DEBUG: Cached site config with key: hueniverse.com.merged {"key":"hueniverse.com.merged"} []
[2017-05-09 23:21:30] graby.DEBUG: Fetching url: https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529 {"url":"https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529"} []
[2017-05-09 23:21:30] graby.DEBUG: cleanupUrl start: https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529 {"url":"https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529"} []
[2017-05-09 23:21:30] graby.DEBUG: cleanupUrl end: https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529 {"url":"https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529"} []
[2017-05-09 23:21:30] graby.DEBUG: Trying using method "get" on url "https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529" {"method":"get","url":"https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529"} []
[2017-05-09 23:21:30] graby.DEBUG: Use default user-agent "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.92 Safari/535.2" for url "https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529" {"user-agent":"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.92 Safari/535.2","url":"https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529"} []
[2017-05-09 23:21:30] graby.DEBUG: Use default referer "http://www.google.co.uk/url?sa=t&source=web&cd=1" for url "https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529" {"referer":"http://www.google.co.uk/url?sa=t&source=web&cd=1","url":"https://hueniverse.com/oauth-2-0-and-the-road-to-hell-8eec45921529"} []
[2017-05-09 23:21:32] graby.DEBUG: effectiveUrl: https://medium.com/ {"data":"https://medium.com/"} []
[2017-05-09 23:21:32] graby.DEBUG: Data fetched: [array] {"data":{"effective_url":"https://medium.com/","body":"(only length for debug): 585362","headers":"text/html; charset=utf-8","status":200}} []
[2017-05-09 23:21:32] graby.DEBUG: Treating as UTF-8 {"encoding":"utf-8"} []
[2017-05-09 23:21:32] graby.DEBUG: Opengraph data: [array] {"ogData":{"og_title":"Medium – Read, write and share stories that matter","og_url":"https://medium.com/","og_description":"Welcome to Medium, a place to read, write, and interact with the stories that matter most to you. Every day, thousands of voices read, write, and share important stories on Medium.","og_site_name":"Medium"}} []
[2017-05-09 23:21:32] graby.DEBUG: Looking for site config files to see if single page link exists [] []
[2017-05-09 23:21:32] graby.DEBUG: . looking for site config for medium.com in primary folder {"host":"medium.com"} []
[2017-05-09 23:21:32] graby.DEBUG: ... found site config medium.com.txt {"host":"medium.com.txt"} []
[2017-05-09 23:21:32] graby.DEBUG: Appending site config settings from global.txt [] []
[2017-05-09 23:21:32] graby.DEBUG: . looking for site config for global in primary folder {"host":"global"} []
[2017-05-09 23:21:32] graby.DEBUG: ... site config for global already loaded in this request {"host":"global"} []
[2017-05-09 23:21:32] graby.DEBUG: Cached site config with key: medium.com {"key":"medium.com"} []
[2017-05-09 23:21:32] graby.DEBUG: . looking for site config for global in primary folder {"host":"global"} []
[2017-05-09 23:21:32] graby.DEBUG: ... site config for global already loaded in this request {"host":"global"} []
[2017-05-09 23:21:32] graby.DEBUG: Appending site config settings from global.txt [] []
[2017-05-09 23:21:32] graby.DEBUG: Cached site config with key: medium.com.merged {"key":"medium.com.merged"} []
[2017-05-09 23:21:32] graby.DEBUG: No "single_page_link" config found [] []
[2017-05-09 23:21:32] graby.DEBUG: Attempting to extract content [] []
[2017-05-09 23:21:32] graby.DEBUG: Returning cached and merged site config for medium.com {"host":"medium.com"} []
[2017-05-09 23:21:32] graby.DEBUG: Returning cached and merged site config for medium.com {"host":"medium.com"} []
[2017-05-09 23:21:32] graby.DEBUG: Appending site config settings from medium.com (fingerprint match) {"host":"medium.com"} []
[2017-05-09 23:21:32] graby.DEBUG: HTML parser html5php not listed, using libxml instead {"parser":"html5php","default_parser":"libxml"} []
[2017-05-09 23:21:32] graby.DEBUG: Attempting to parse HTML with libxml {"parser":"libxml"} []
[2017-05-09 23:21:32] graby.DEBUG: Trying //meta[@property="og:title"]/@content for title {"pattern":"//meta[@property=\"og:title\"]/@content"} []
[2017-05-09 23:21:32] graby.DEBUG: Title matched: Medium – Read, write and share stories that matter {"title":"Medium – Read, write and share stories that matter"} []
[2017-05-09 23:21:32] graby.DEBUG: ...XPath match: {pattern} ["pattern","//meta[@property=\"og:title\"]/@content"] []
[2017-05-09 23:21:32] graby.DEBUG: Trying //html[@lang]/@lang for language {"pattern":"//html[@lang]/@lang"} []
[2017-05-09 23:21:32] graby.DEBUG: Trying //meta[@name="DC.language"]/@content for language {"pattern":"//meta[@name=\"DC.language\"]/@content"} []
[2017-05-09 23:21:32] graby.DEBUG: Trying supplementalPostContent to strip element {"string":"supplementalPostContent"} []
[2017-05-09 23:21:32] graby.DEBUG: Trying //main[contains(@class, 'postArticle-content')] for body {"pattern":"//main[contains(@class, 'postArticle-content')]"} []
[2017-05-09 23:21:32] graby.DEBUG: Trying //div[contains(@class, 'postArticle-content')] for body {"pattern":"//div[contains(@class, 'postArticle-content')]"} []
[2017-05-09 23:21:32] graby.DEBUG: Trying //div[contains(@class, 'section-inner')] for body {"pattern":"//div[contains(@class, 'section-inner')]"} []
[2017-05-09 23:21:32] graby.DEBUG: Using Readability [] []
[2017-05-09 23:21:33] graby.DEBUG: Detecting body [] []
[2017-05-09 23:21:33] graby.DEBUG: Success ? 1 {"is_success":true} []
[2017-05-09 23:21:33] graby.DEBUG: Returning data (most interesting ones): [array] {"data":{"title":"Medium – Read, write and share stories that matter","language":null,"url":"https://medium.com/","content_type":"text/html"}} []
[2017-05-09 23:21:33] graby.DEBUG: Filtering HTML to remove XSS [] []
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment