C# parsing screen-scraping html-agility-pack

无法抓取包含格式错误内容的网页

发布于 2024-08-14 18:29:36 字数 578 浏览 9 评论 0原文

我编写了 C# 代码，它利用 HtmlAgilityPack 库来抓取位于以下位置的页面：世界上最大的城市区域 (第 2 页）。不幸的是，该页面包含格式错误的内容。

我对如何抓取此页面陷入了僵局。我当前的代码（如下所示）在解析 HTML 时冻结：

 HtmlNodeCollection cityRecords = _htmlDocument.DocumentNode.SelectNodes("//table[@class='boldtable']//tr[position() != 1]");
 CityNodes = (from node in cityRecords.Descendants()
              where node.Name == "td"
              select node).ToList();

目标是使用每个数据点解析页面上列出的每个城市；而已。寻找有关如何修改上述代码或使用另一个免费提供的库的建议。

谢谢！

原文

I have written c# code which utilizes the HtmlAgilityPack library in order to scrape a page located at: World's Largest Urban Areas (Page 2). Unfortunately the page consists of malformed content.

I'm at an impasse on how to scrape this page. The current code I have (appearing below) freezes on parsing the HTML:

 HtmlNodeCollection cityRecords = _htmlDocument.DocumentNode.SelectNodes("//table[@class='boldtable']//tr[position() != 1]");
 CityNodes = (from node in cityRecords.Descendants()
              where node.Name == "td"
              select node).ToList();

The goal is to parse each and every city listed on the page with each of the data points; nothing more. Looking for recommendations on how to modify the above code or use another freely available library.

Thanks!

分享到QQ

分享到微博