您可以链接到同义词和反义词,这既方便用户又方便爬虫。但我认为,要改进抓取(尤其是 Google 抓取),您可以做的最重要的事情就是添加站点地图:
站点地图是网站管理员向搜索引擎通报其网站上可供抓取的页面的一种简单方法。站点地图最简单的形式是一个 XML 文件,其中列出了站点的 URL 以及有关每个 URL 的附加元数据(上次更新时间、通常更改的频率以及相对于站点中其他 URL 的重要性) )以便搜索引擎能够更智能地抓取网站。
Google 在 大量信息 http://www.google.com/support/webmasters/bin/answer.py?hl=zh-CN&answer=156184&from=40318&rd=1" rel="nofollow">站点地图以及如何生成他们的网站站长帮助页面上。
You could link to synonyms and antonyms, which would be both user-friendly and crawler-friendly. But I think the biggest thing you could do to improve crawling, particularly by Google, would be to add a sitemap:
Sitemaps are an easy way for webmasters to inform search engines about pages on their sites that are available for crawling. In its simplest form, a Sitemap is an XML file that lists URLs for a site along with additional metadata about each URL (when it was last updated, how often it usually changes, and how important it is, relative to other URLs in the site) so that search engines can more intelligently crawl the site.
发布评论
评论(1)
您可以链接到同义词和反义词,这既方便用户又方便爬虫。但我认为,要改进抓取(尤其是 Google 抓取),您可以做的最重要的事情就是添加站点地图:
Google 在 大量信息 http://www.google.com/support/webmasters/bin/answer.py?hl=zh-CN&answer=156184&from=40318&rd=1" rel="nofollow">站点地图以及如何生成他们的网站站长帮助页面上。
You could link to synonyms and antonyms, which would be both user-friendly and crawler-friendly. But I think the biggest thing you could do to improve crawling, particularly by Google, would be to add a sitemap:
Google has lots of information on Sitemaps and how to generate them on their webmaster help pages.