Google 仍然将我的域名编入索引吗?
我有一个像下面这样的 robots.txt,但 Google 仍然为我的域名编制了索引。基本上他们已经索引了 mydomain.com 但没有索引 mydomain.com/any_page
UserAgent: *
Disallow: /
我的意思是我怎样才能比我认为是域根的 /
更进一步?
请注意,该域名正在开发中,因此我不希望 Google 或任何其他搜索引擎看到它。
I have a robots.txt like below but Google has still indexed my domain. Basically they've indexed mydomain.com but not mydomain.com/any_page
UserAgent: *
Disallow: /
I mean how can I go back further than /
which I thought was the root of domain?
Note this domain is a work in progess, hence I don't want Google or any other search engines seeing it for a minute.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
如果您还没有一个 Google 网站站长工具帐户。它包含一个可能适合您的 URL 删除工具。
当然,这并不能解决搜索引擎可能忽略或误解您的 robots.txt 文件的问题。
如果您确实希望您的网站在发布之前停止播出,那么最好的选择就是实际停止播出。使该网站无法访问,除非使用密码。如果您将 HTTP Basic 身份验证 放在文档根目录上,则搜索引擎将不会能够索引任何内容,但您将拥有密码的完全访问权限。
If you don't have one already, get a Google Webmaster Tools account. It includes a URL removal tool that may work for you.
This doesn't address the problem of search engines possibly ignoring or misinterpreting your robots.txt file, of course.
If you REALLY want your site to be off the air until it's launched, your best bet is to actually take it off the air. Make the site inaccessible except by password. If you put HTTP Basic authentication on your documentroot, then no search engine will be able to index anything, but you'll have full access with a password.