Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
Simple Curl web scraper
<?php
/**
* @param string $url - the url you wish to fetch.
* @return string - the raw html respose.
*/
function web_scrape($url) {
$ch = curl_init($url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, TRUE);
$response = curl_exec($ch);
curl_close($ch);
return $response;
}
/**
*
* @param string $url - the url you wish to fetch.
* @return array - the http headers returned
*/
function fetch_headers($url) {
$ch = curl_init($url);
curl_setopt($ch, CURLOPT_HEADER, 1);
$response = curl_exec($ch);
curl_close($ch);
return $response;
}
//var_dump(get_headers("https://www.google.se/"));
// echo web_scrape('https://www.google.se/');
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment