Question

我有这个代码可以获取页面的HTML源代码：

$page = file_get_contents('http://example.com/page.html');
$page = htmlentities($page);

我想从中搜集一些内容。例如，假设页面的源包含：

<strong>technorati.com</strong><br />
Connection failed<br /><br />Pinging <strong>icerocket.com</strong><br />
Connection failed<br /><br />Pinging <strong>weblogs.com</strong><br />
Done<br /><br />Pinging <strong>newsgator.com</strong><br />
Done<br /><br />Pinging <strong>blo.gs</strong><br />
Done<br /><br />Pinging <strong>feedburner.com</strong><br />
Done<br /><br />Pinging <strong>blogstreet.com</strong><br />
Done<br /><br />Pinging <strong>my.yahoo.com</strong><br />
Connection failed<br /><br />Pinging <strong>moreover.com</strong><br />
Connection failed<br /><br />Pinging <strong>newsisfree.com</strong><br />
Done<br />

有没有办法可以从源代码中删除它并将其存储在变量中，所以它看起来像这样：

technorati.com 连接失败
   icerocket.com 连接失败
   eblogs.com 完成
  等。

原因是页面是动态的，这就是我遇到问题的原因。我可以搜索源中的每个站点吗？但那我怎么得到它之后的结果呢？（连接失败/完成）
非常感谢您的帮助！

Answer 1

我尝试使用简单的HTML DOM PHP库抓取多个网站，可以在此处获取：http://simplehtmldom.sourceforge.net/

然后使用这样的代码：

<?php
include_once 'simple_html_dom.php';

$url = "http://slashdot.org/";
$html = file_get_html($url);

//remove additional spaces
$pat[0] = "/^\s+/";
$pat[1] = "/\s{2,}/";
$pat[2] = "/\s+\$/";
$rep[0] = "";
$rep[1] = " ";
$rep[2] = "";

foreach($html->find('h2') as $heading) { //for each heading
        //find all spans with a inside then echo the found text out
        echo preg_replace($pat, $rep, $heading->find('span a', 0)->plaintext) . "\n"; 
}
?>

这导致类似：

5.8 Earthquake Hits East Coast of the US
Origins of Lager Found In Argentina
Inside Oregon State University's Open Source Lab
WebAPI: Mozilla Proposes Open App Interface For Smartphones
Using Tablets Becoming Popular Bathroom Activity
The Syrian Government's Internet Strategy
Deus Ex: Human Revolution Released
Taken Over By Aliens? Google Has It Covered
The GIMP Now Has a Working Single-Window Mode
Zombie Cookies Just Won't Die
Motorola's Most Important 18 Patents
MK-1 Robotic Arm Capable of Near-Human Dexterity, Dancing
Evangelical Scientists Debate Creation Story
Android On HP TouchPad
Google Street View Gets Israeli Government's Nod
Internet Restored In Tripoli As Rebels Take Control
GA Tech: Internet's Mid-Layers Vulnerable To Attack
Serious Crypto Bug Found In PHP 5.3.7
Twitter To Meet With UK Government About Riots
EU Central Court Could Validate Software Patents

Answer 2

这不是最好的解决方案，但它有效：

$page = file_get_contents('http://example.com/page.html');
preg_match_all('#<strong>([^<]+)</strong><br />\s*([^<]+)<#', $page, 
                                             $result, PREG_SET_ORDER);
foreach ($result as $row) {
    echo "<p><b>$row[1]</b> $row[2]</p>\n";
}

如果需要更复杂的事情，请考虑DOMDocument。

Answer 3

您可以使用Regular Expressions。

修改

正则表达式不是解决大问题的最佳解决方案，但对于标准格式的简单页面，正则表达式通常最简单易用。

如何从页面源“抓取”内容？

3 个答案: