[SOLVED] PHP curl - how to get the content of a page without processing the page

robertjinx · 01-13-2016, 11:42 AM

Hello, I'm trying to get a page using curl (url), but that contains some script, which redirects the user or curl in this case to a website. I would like to get the script (as a string) and use 'preg_match' and do something, but when doing this in the browser, I get redirected and I cant processes the variable:

PHP Code:



function get_data($url) { 
    $ch = curl_init(); 
    $timeout = 5; 
    curl_setopt($ch, CURLOPT_URL, $url); 
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1); 
    curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, $timeout); 
    $data = curl_exec($ch); 
    curl_close($ch); 
    return $data; 
} 
 
$url = "http://webhost4christ.com/7744a.php?=88"; // this is spam, really 
$data = get_data($url); 
 
echo $data // this will redirect me to the final page

Im building a function which checks any pages for a certain content for spam, the content looks like this:

Quote:

This is a spam page and its a script. Using curl, I wanna get this and preg_match to find for example '/report/spam/' or something similar.

Any help would be welcomed. Thanks

thesnow · 01-13-2016, 12:15 PM

Have you tried file_get_contents instead of curl ?

robertjinx · 01-13-2016, 12:16 PM

Yes, but requires url_fopen to be enabled. Find it a bit of a security risk.

Quote:

PHP Warning: file_get_contents(): http:// wrapper is disabled in the server configuration by allow_url_fopen=0

thesnow · 01-13-2016, 12:52 PM

If you skip echoing $data you should be able to find the string,

Code:

$results = strpos($data,'/report/spam');
echo $results;

Or use highlight_string($data);, which should return the contents of the script instead of running it.

robertjinx · 01-13-2016, 01:43 PM

Quote:

Originally Posted by thesnow

If you skip echoing $data you should be able to find the string,

Code:

$results = strpos($data,'/report/spam');
echo $results;

Or use highlight_string($data);, which should return the contents of the script instead of running it.

This actually sounds good, Danke man!

Not sure how exact it will be, but keeping my fingers crossed

robertjinx · 01-13-2016, 02:08 PM

One more question, what could I use in PHP to check for multiple 'strings', something like this, simplified?

Quote:

$results = strpos($data, 'var host =');
if ($results) {
$results = strpos($data, '/?cid=');
if ($results) {
$results = strpos($data, '/report/spam/');
if ($results)
echo "Spam!";
}
}

thesnow · 01-13-2016, 03:54 PM

Sure, or something like this:

Code:

$s1 = strpos($data,'var host =');
$s2 = strpos($data, '/?cid=');
$s3 = strpos($data, '/report/spam/');

if ( $s1 && $s2 && $s3 ) {
  echo "SPAM!";
}

robertjinx · 01-14-2016, 01:04 AM

Quote:

Originally Posted by thesnow

Sure, or something like this:

Code:

$s1 = strpos($data,'var host =');
$s2 = strpos($data, '/?cid=');
$s3 = strpos($data, '/report/spam/');

if ( $s1 && $s2 && $s3 ) {
  echo "SPAM!";
}

Well, thats kind of the same as me, just from the different angle.

robertjinx · 01-14-2016, 01:57 AM

BTW, since I've implemented that little 'code', I've got 57 (bad/spam urls) baddies, not even Google Safe Browsing works this fast

So somewhat it works!