win10运行pyspider all之后报错,不知道是pycurl还是openssl哪里的问题

发布于 2022-09-13 01:20:13 字数 2459 浏览 26 评论 0

C:\Users\Administrator>pyspider all
E:\python39\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
warnings.warn("timeout is not supported on your platform.", FutureWarning)
[W 210902 19:51:03 run:413] phantomjs not found, continue running without it.
[I 210902 19:51:05 result_worker:49] result_worker starting...
[I 210902 19:51:06 processor:211] processor starting...
Exception in thread Thread-4:
Traceback (most recent call last):
File "E:\python39\lib\threading.py", line 973, in _bootstrap_inner

self.run()

File "E:\python39\lib\threading.py", line 910, in run

self._target(*self._args, **self._kwargs)

File "E:\python39\lib\site-packages\click\core.py", line 763, in invoke

return __callback(*args, **kwargs)

File "E:\python39\lib\site-packages\click\decorators.py", line 26, in new_func

return f(get_current_context(), *args, **kwargs)

File "E:\python39\lib\site-packages\pyspider\run.py", line 236, in fetcher
[I 210902 19:51:06 scheduler:647] scheduler starting...

Fetcher = load_cls(None, None, fetcher_cls)

File "E:\python39\lib\site-packages\pyspider\run.py", line 48, in load_cls

return utils.load_object(value)

File "E:\python39\lib\site-packages\pyspider\libs\utils.py", line 369, in load_object

module = __import__(module_name, globals(), locals(), [object_name])

File "E:\python39\lib\site-packages\pyspider\fetcher\__init__.py", line 1, in <module>

from .tornado_fetcher import Fetcher

File "E:\python39\lib\site-packages\pyspider\fetcher\tornado_fetcher.py", line 30, in <module>

from tornado.curl_httpclient import CurlAsyncHTTPClient

File "E:\python39\lib\site-packages\tornado\curl_httpclient.py", line 24, in <module>

import pycurl  # type: ignore

ImportError: pycurl: libcurl link-time ssl backends (schannel) do not include compile-time ssl backend (openssl)
[I 210902 19:51:06 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 210902 19:51:06 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0

1.卸载过pycurl,用whl文件重装过
2.环境配置参照网上的办法配置了openssl的lib和include目录,并且PYCURL_SSL_LIBRARY=schannel
3.运行了还是报错

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

予囚 2022-09-20 01:20:13

你安装的pycurl版本太高了
建议安装:pip install pycurl==7.43.0.5

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文