创建包含以下文本的 robots.txt：
robots.txt
User-Agent: * Disallow: /page1.html Disallow: /page2.html
该文件必须放置在 http://www.site.com/robots.txt。
http://www.site.com/robots.txt
有关更多信息，请参阅维基百科。
此外，Google 还有一个 robots.txt 测试器，可以从他们的网站站长工具中获取，它可以让您验证其格式是否正确。
Create a robots.txt containing the following text:
The file must then be placed at http://www.site.com/robots.txt.
For more information, see Wikipedia.
In addition, Google has a robots.txt tester, available from their Webmaster Tools, which lets you verify that it is formatted correctly.
robots.txt 必须放置在您网站的根目录中，它将包含：
User-agent: * Disallow: page1.html Disallow: page2.html
“User-agent: *”意味着每个 SE 都不会跟踪禁止目录/页面上的链接
编辑：您还应该将此元标记放在您的网站中第 1 页和第 2 页
<meta name="robots" content="NOINDEX, NOFOLLOW"/>
robots.txt must be placed in the root of your website, ad it will contain:
"User-agent: *" means that every SE will not follow links on the disallow dirs / pages
Edit: You should also place this meta tag inside your page1 and page2
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
暂无简介
文章 0 评论 0
接受
发布评论
评论（2）
创建包含以下文本的
robots.txt：该文件必须放置在
http://www.site.com/robots.txt。有关更多信息，请参阅维基百科。
此外，Google 还有一个 robots.txt 测试器，可以从他们的网站站长工具中获取，它可以让您验证其格式是否正确。
Create a
robots.txtcontaining the following text:The file must then be placed at
http://www.site.com/robots.txt.For more information, see Wikipedia.
In addition, Google has a robots.txt tester, available from their Webmaster Tools, which lets you verify that it is formatted correctly.
robots.txt 必须放置在您网站的根目录中，它将包含：
“User-agent: *”意味着每个 SE 都不会跟踪禁止目录/页面上的链接
编辑：您还应该将此元标记放在您的网站中第 1 页和第 2 页
robots.txt must be placed in the root of your website, ad it will contain:
"User-agent: *" means that every SE will not follow links on the disallow dirs / pages
Edit: You should also place this meta tag inside your page1 and page2