Also I believe that the bot goes down the page and takes the first directive that applies to it. In your case, Googlebot and Googlebot-Image would never see their specific directives because they would respect the "User-Agent: *" first.
Disregard this answer. I found information that points to this not being the case. The bot should find the directive specific to it and respect it
发布评论
评论（4）
它应该是
Disallow:，而不是Disabled:。It should be
Disallow:, notDisabled:.也许可以尝试一下 Google robots.txt 检查器
Maybe give the Google robots.txt checker a try
Google 有一个用于检查 robots.txt 条目的分析工具，在此处阅读相关信息
您可能还想检查“流氓”机器人的 IP 地址，看看它们是否确实属于 Google 所有。
Google have an analysis tool for checking robots.txt entries, read about it here
You might also want to check the IP addresses of the "rogue" robots to see if they really are owned by Google.
我还相信机器人会向下浏览页面并采取第一个适用于它的指令。 在你的情况下，Googlebot和Googlebot-Image永远不会看到他们的具体指令，因为他们会首先尊重“用户代理：*”。
忽略这个答案。 我发现的信息表明情况并非如此。 机器人应该找到特定于它的指令并尊重它
Also I believe that the bot goes down the page and takes the first directive that applies to it. In your case, Googlebot and Googlebot-Image would never see their specific directives because they would respect the "User-Agent: *" first.
Disregard this answer. I found information that points to this not being the case. The bot should find the directive specific to it and respect it