Question

我使用此代码通过HtmlAgilityPack获取url的html源代码：

private string GetUrlSource(string urlAddress)
        {
            string content = string.Empty;
            HttpWebRequest request = (HttpWebRequest)WebRequest.Create(urlAddress);
            HttpWebResponse response = (HttpWebResponse)request.GetResponse();
            if (response.StatusCode == HttpStatusCode.OK)
            {
                Stream receiveStream = response.GetResponseStream();
                StreamReader readStream = null;
                if (response.CharacterSet == null)
                    readStream = new StreamReader(receiveStream);
                else
                    readStream = new StreamReader(receiveStream, Encoding.GetEncoding(response.CharacterSet));
                content = readStream.ReadToEnd();
                response.Close();
                readStream.Close();
            }
            return content;
        }

然后，使用此代码获取数据：

                var source = GetUrlSource(urlAddress);
                var htmlDoc = new HtmlAgilityPack.HtmlDocument();
                htmlDoc.LoadHtml(source);
var nodes = htmlDoc.DocumentNode.SelectNodes("//div[@class='linear-view']/table/tr/td");

我的节点结果是：

<tr>
  <th>Title</th>
  <th>Publisher</th>
</tr>
<tr>
  <td><a href="http://link1.com" id="14.4">Title1</a></td>
  <td>Publisher1</td>
</tr>
<tr>
  <td><a href="http://link2.com" id="12.0">Title2</a></td>
  <td>Publisher2</td>
</tr>
<tr>
  <td><a href="http://link3.com/" id="84.4">Title3</a></td>
  <td>Publisher3</td>
</tr>

我使用此代码获取数据：

foreach (var node in nodes)
                {
                    HtmlNodeCollection rows = node.SelectNodes(".//a");
                    if (rows != null)
                    {
                        for (int j = 0; j < rows.Count; ++j)
                        {
                            var link = rows[j].Attributes["href"].Value;
                            var title = rows[j].InnerText;
                        }
                    }
                    else
                    {
                        var publisher = node.InnerText;
                    }
                }

我如何获得链接，标题和＆amp;每个tr标签的发布者没有if＆amp;其他？例如：http://link1.com , Title1 , Publisher1和http://link2.com , Title2 , Publisher2以及http://link3.com , Title3 , Publisher3

Answer 1

许多可能的方法之一：

//select <tr> having child node <td>
var tr = doc.DocumentNode.SelectNodes("//div[@class='linear-view']/table/tr[td]");
foreach (HtmlNode node in tr)
{
    //select <td> having child node <a>
    var td1 = node.SelectSingleNode("./td[a]"); //or using index: ./td[1]
    var link = td1.FirstChild.Attributes["href"].Value;
    var title = td1.InnerText;
    //select <td> not having child node <a>
    var publisher = node.SelectSingleNode("./td[not(a)]") //using index: ./td[2]
                        .InnerText;
}

如何通过HtmlAgilityPack获取tr链接和内容？

1 个答案: