win10运行pyspider all之后报错,不知道是pycurl还是openssl哪里的问题
C:\Users\Administrator>pyspider all
E:\python39\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
warnings.warn("timeout is not supported on your platform.", FutureWarning)
[W 210902 19:51:03 run:413] phantomjs not found, continue running without it.
[I 210902 19:51:05 result_worker:49] result_worker starting...
[I 210902 19:51:06 processor:211] processor starting...
Exception in thread Thread-4:
Traceback (most recent call last):
File "E:\python39\lib\threading.py", line 973, in _bootstrap_inner
self.run()
File "E:\python39\lib\threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File "E:\python39\lib\site-packages\click\core.py", line 763, in invoke
return __callback(*args, **kwargs)
File "E:\python39\lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "E:\python39\lib\site-packages\pyspider\run.py", line 236, in fetcher
[I 210902 19:51:06 scheduler:647] scheduler starting...
Fetcher = load_cls(None, None, fetcher_cls)
File "E:\python39\lib\site-packages\pyspider\run.py", line 48, in load_cls
return utils.load_object(value)
File "E:\python39\lib\site-packages\pyspider\libs\utils.py", line 369, in load_object
module = __import__(module_name, globals(), locals(), [object_name])
File "E:\python39\lib\site-packages\pyspider\fetcher\__init__.py", line 1, in <module>
from .tornado_fetcher import Fetcher
File "E:\python39\lib\site-packages\pyspider\fetcher\tornado_fetcher.py", line 30, in <module>
from tornado.curl_httpclient import CurlAsyncHTTPClient
File "E:\python39\lib\site-packages\tornado\curl_httpclient.py", line 24, in <module>
import pycurl # type: ignore
ImportError: pycurl: libcurl link-time ssl backends (schannel) do not include compile-time ssl backend (openssl)
[I 210902 19:51:06 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 210902 19:51:06 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
1.卸载过pycurl,用whl文件重装过
2.环境配置参照网上的办法配置了openssl的lib和include目录,并且PYCURL_SSL_LIBRARY=schannel
3.运行了还是报错
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
你安装的pycurl版本太高了
建议安装:pip install pycurl==7.43.0.5