不要让谷歌抓取我的网站
有没有办法让 googlebots 隐藏我的 drupal 网站?我不希望我的网站在仍处于开发阶段时出现在搜索引擎中。
Is there a way to hide my drupal site from the googlebots? I don't want my site to show up in the search engines while it's still in the development stage.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(6)
使用 robots.txt 。
Use robots.txt.
使用 robots.txt 阻止搜索引擎...
但是!
您需要考虑将您的网站远离实际领域开发。当您上线时,您将如何为您的网站开发增强功能?您现在需要一个开发环境。
此外,在将网站现场直播之前,您可能会构建入站链接和搜索引擎排名。防止您的网站被Google索引,直到您上线将停止这种情况。
我建议在您的主域上放置一个登陆页面,其中包含反映您网站用途的消息,以及可能向该网站“注册兴趣”的功能。这将使您可以在那里获取域名。
推出一个新网站几乎总是在一片寂静中进行。在发布之前对您的域名进行排名是一项非常有价值的活动。
Use robots.txt to block search engines...
But!
You need to consider developing your site away from the real domain. When you go live, how are you going to develop enhancements to your site? You need a development environment now.
Additionally you could be building your inbound links and search engine ranking before you put your site live. Preventing your site being indexed by Google until you go live will stop this happening.
I would suggest putting a landing page on your main domain, with messaging that reflects the purpose of your site, and the ability to perhaps 'register interest' with the site. This will allow you to get your domain name out there.
Launching a new website will almost always happen with thunderous silence. Getting your domain ranked before launch is a highly worthwhile activity.
在网络服务器的基本目录中创建一个包含以下内容的文件,名为 robots.txt
Create a file containing the following in the base directory of your webserver called robots.txt
另一种选择是将类似的内容放入
.htaccess
中,并仅使用您的 IP 地址,或者如果站点上有多个远程位置,则使用多个 IP 地址。
但我赞同关于从主域开发的评论。获取一个 VPS 帐户,使用虚拟主机在主域上建立一个启动站点,并为其创建子域和虚拟主机(并如上所示保护它),并将其用于开发。
One more option is to put something like this in you
.htaccess
and just use your IP address, or multiple IP addresses if there are multiple remote locations working on the site.
But I do second the comment about developing off of the main domain. Get a VPS account, put up a splash site on the main domain using a virtual host, and create a subdomain and virtual host for it (and protect it like shown above), and use that for development.
使用 robots.txt 例如:
如果您愿意,您可以允许搜索某些目录,或者根本不使用
禁止:/
更多信息请访问 robotstxt.org :-)
Dave
Use robots.txt such as :
You can allow searching of some directories if you wish or none at all using
Disallow: /
More info at robotstxt.org :-)
Dave
需要登录。我认为 Google 机器人不会登录...
Require a login. I don't think the Google bot will log in...