CloudFlare检测使用Python Selenium I; m

Question

我不知道Cloudflare如何检测我正在使用Python Selenium。当我在默认浏览器中浏览网站时，它可以正常工作。我还研究了Stackoverflow，但没有解决任何解决方案。

这是代码。

from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
options = webdriver.ChromeOptions()
options.add_argument("--disable-dev-shm-usage")
options.add_argument('--no-sandbox')  
options.add_argument("--disable-extensions")
options.add_argument("--disable-gpu")
options.add_argument('user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36') 
options.add_experimental_option("excludeSwitches", ["enable-automation"])
options.add_experimental_option('useAutomationExtension', False)
driver = webdriver.Chrome(ChromeDriverManager().install(),options=options)

我还尝试了：

from selenium import webdriver
from selenium_stealth import stealth

options = webdriver.ChromeOptions()
options.add_argument("start-maximized")
options.add_experimental_option("excludeSwitches", ["enable-automation"])
options.add_experimental_option('useAutomationExtension', False)
driver = webdriver.Chrome(ChromeDriverManager().install(),options=options)

stealth(driver,
        languages=["en-US", "en"],
        vendor="Google Inc.",
        platform="Win32",
        webgl_vendor="Intel Inc.",
        renderer="Intel Iris OpenGL Engine",
        fix_hairline=True,
        )

driver.get('https://www.merinfo.se/search?who=a&where')

正确加载网站所需的更改是什么？

Answer 1

您可以只使用Beautifure尝试一下吗？

import requests
from bs4 import BeautifulSoup


url = "https://www.merinfo.se/search?who=a&where"

soup = BeautifulSoup(requests.get(url).content, "html.parser")

for a in soup.select("h2"):
    print(a.text.strip())

印刷：

A Tam Tran
P-A Olsson
Carl A Karlsson
A Mui Bang
P A Pettersson
A Kieu Dan
A Buu Phung
A Luc Tran
M A Jony
A M Sundberg Reed
P-A Sköld
A Sat Voong
Hassan A Hayawi Hayawi
P-A Ingemar Pettersson
Elisabeth A-C Orrghen Paulsson
Kicki A E Freskgård
A-C Ingegerd Davidsson
P-A Per-Anders Jakobsson
P-A Sigurd Viking Lundkvist
Muna A A A Alqattan