The search engines will only index what an anonymous user sees. If you don't already, I would create a listing page to browse the user profiles in which you only show the data you want to. This ensures that a link exists for every userProfile.aspx?uid=XXXXXX you have. The search engine spiders will not be able to see any data that is behind a password protected.
I would also add a site map to ensure the search engine spiders get to the listing page. Don't assume that Google will magically find ALL of your pages though typically they do based on links to your content. Submit a site map to Google.
Edit regarding Site Maps and Search Results In order for spiders to crawl search results, I would specify an entry in the site map that points spiders to the search results page that displays all (e.g. search.aspx?param=all).
You don't have to do anything. Search bots won't be able to access to your protected pages while they'll access without problems to the public content as long as you don't explicitly disallow it on robots.txt
发布评论
评论（2）
搜索引擎只会索引匿名用户看到的内容。如果您还没有这样做，我将创建一个列表页面来浏览用户个人资料，在其中您只显示您想要的数据。这可以确保您拥有的每个
userProfile.aspx?uid=XXXXXX都存在一个链接。搜索引擎蜘蛛将无法看到受密码保护的任何数据。我还会添加站点地图以确保搜索引擎蜘蛛到达列表页面。不要以为 Google 会神奇地找到您的所有页面，尽管它们通常是根据您内容的链接找到的。向 Google 提交站点地图。
编辑站点地图和搜索结果
为了让蜘蛛抓取搜索结果，我会在站点地图中指定一个条目，将蜘蛛指向显示所有搜索结果的页面（例如 search.aspx?param=all）。
The search engines will only index what an anonymous user sees. If you don't already, I would create a listing page to browse the user profiles in which you only show the data you want to. This ensures that a link exists for every
userProfile.aspx?uid=XXXXXXyou have. The search engine spiders will not be able to see any data that is behind a password protected.I would also add a site map to ensure the search engine spiders get to the listing page. Don't assume that Google will magically find ALL of your pages though typically they do based on links to your content. Submit a site map to Google.
Edit regarding Site Maps and Search Results
In order for spiders to crawl search results, I would specify an entry in the site map that points spiders to the search results page that displays all (e.g. search.aspx?param=all).
你不需要做任何事。搜索机器人将无法访问您的受保护页面，但只要您不在 robots.txt 上明确禁止，它们就可以毫无问题地访问公共内容
You don't have to do anything. Search bots won't be able to access to your protected pages while they'll access without problems to the public content as long as you don't explicitly disallow it on robots.txt