HTTP Live Headers（Firefox 扩展）或 eqv。将 Javascript 请求逆向工程为原始 GET / POST，以便您可以使用 Mechanize 或 LWP 等来模仿。
正如其他发帖者已经提到的，一个好的无头浏览器是 WWW::Mechanize 模块。
我建议花一些时间学习 HTML::TreeBuilder &特别是 HTML::TreeBuilder::XPath 和 HTML::Query。当您想要从 HTML 文档获取实际数据时，后两个将变得非常方便。
HTML::TableExtract 也是一个很好的模块，可以在需要时从 HTML 表中提取数据。
基本上，使用以上所有内容将使您能够抓取大多数网站。
享受爬行的乐趣（-：
Tools you will need besides Perl:
HTTP Live Headers (Firefox extension) or eqv. to reverse engineer Javascript requests to primitive GET / POST so you can mimic that with Mechanize or LWP, etc.
As already mentioned by other posters, a good headless-browser is WWW::Mechanize module.
I would suggest spending some time learning HTML::TreeBuilder & especially HTML::TreeBuilder::XPath and HTML::Query. the last two will become very handy when you will want to get actual data from HTML documents.
HTML::TableExtract is also a nice module to extract data from HTML tables when needed.
basically, using all of the above will give you the ability to crawl most sites.
发布评论
评论（3）
我过去使用过 WWW-Mechanize 来实现基本的网络爬行功能，包括表单提交等。
有一些非常好的示例。
I've used WWW-Mechanize in the past to achieve the basic web crawling functionality, including form submission and the like.
There are some pretty good examples.
这些应该几乎涵盖了您正在寻找的所有内容：
http://www .perl.com/pub/2002/08/20/perlandlwp.html
http://lwp.interglacial.com/
http://www.perl.com/pub/2003/01/22/mechanize.html
http://gd.tuwien.ac.at/linux/ldp /LDP/LGNET/108/oregan2.html
These should pretty much cover everything you're looking for:
http://www.perl.com/pub/2002/08/20/perlandlwp.html
http://lwp.interglacial.com/
http://www.perl.com/pub/2003/01/22/mechanize.html
http://gd.tuwien.ac.at/linux/ldp/LDP/LGNET/108/oregan2.html
除了 Perl 之外，您还需要的工具：
WWW::Mechanize模块。HTML::TreeBuilder&特别是HTML::TreeBuilder::XPath和HTML::Query。当您想要从 HTML 文档获取实际数据时，后两个将变得非常方便。HTML::TableExtract也是一个很好的模块，可以在需要时从 HTML 表中提取数据。基本上，使用以上所有内容将使您能够抓取大多数网站。
享受爬行的乐趣（-：
Tools you will need besides Perl:
WWW::Mechanizemodule.HTML::TreeBuilder& especiallyHTML::TreeBuilder::XPathandHTML::Query. the last two will become very handy when you will want to get actual data from HTML documents.HTML::TableExtractis also a nice module to extract data from HTML tables when needed.basically, using all of the above will give you the ability to crawl most sites.
Have fun crawling (-: