在Apache气流上运行硒时的错误

Question

在气流上运行硒时，我会遇到此错误。气流使用AWS存储文件，我使用以下代码行：

OP = webdriver.ChromeOptions()
# op = FirefoxOptions()
# op.add_argument("--headless")
OP.add_experimental_option("excludeSwitches", ["enable-automation"])
OP.add_experimental_option('useAutomationExtension', False)
# op.add_argument("start-maximized")
# op.add_argument("--window-size=1100,1000")
# op.add_argument("--headless")
OP.add_argument("--disable-gpu")
OP.add_argument('--disable-dev-shm-usage')
OP.add_argument('--no-sandbox')
#serv = Service(ChromeDriverManager().install())
driver = webdriver.Chrome(executable_path = "/usr/lib/chromium-browser/chromedriver", options=OP)
# s = Service(executable_path=GeckoDriverManager().install())
# driver = webdriver.Firefox(service=s, firefox_options=op)
# agent = driver.execute_script("return navigator.userAgent")
# # print(agent)
path =os.getcwd()

错误日志如下：

Broken DAG: [/<my-path>/scraping.py] Traceback (most recent call last):
  File "<my-path-name>.local/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/<my-path-name>/.local/lib/python3.6/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: unknown error: Chrome failed to start: exited abnormally.
  (unknown error: DevToolsActivePort file doesn't exist)
  (The process started from chrome location /usr/bin/chromium-browser is no longer running, so ChromeDriver is assuming that Chrome has crashed.)

由于它显示未知错误，我不确定问题是否在哪里，是使用可执行路径还是其他内容？我尝试使用service（），但这也会给出错误。