AWS胶图像证书相关的问题
我是Docker的新手。请帮助解决问题。
我已经创建了下面提到的Docker组成文件:
version: "2"
services:
spark:
image: glue/spark:latest
container_name: spark
** build: ./spark**
hostname: spark
ports:
- "8888:8888"
- "4040:4040"
entrypoint : sh
command : -c "/home/glue_user/jupyter/jupyter_start.sh"
volumes:
- ../app/territoryhub-replication:/home/glue_user/workspace/jupyter_workspace
在构建部分中被调用的Docker文件如下:
FROM amazon/aws-glue-libs:glue_libs_3.0.0_image_01
USER root
RUN mkdir -p /root/.aws
RUN echo "[default]\nregion=us-east-1" >> /root/.aws/config
Docker的日志如下:
Starting Jupyter with SSL
/home/glue_user/jupyter/jupyter_start.sh: line 4: livy-server: command not found
[I 2022-05-12 15:41:33.032 ServerApp] jupyterlab | extension was successfully linked.
[I 2022-05-12 15:41:33.044 ServerApp] nbclassic | extension was successfully linked.
[I 2022-05-12 15:41:33.046 ServerApp] Writing Jupyter server cookie secret to /root/.local/share/jupyter/runtime/jupyter_cookie_secret
[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was found and enabled by notebook_shim. Consider moving the extension to Jupyter Server's extension paths.
[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was successfully linked.
[I 2022-05-12 15:41:33.541 ServerApp] notebook_shim | extension was successfully linked.
[W 2022-05-12 15:41:33.556 ServerApp] All authentication is disabled. Anyone who can connect to this server will be able to run code.
[I 2022-05-12 15:41:33.558 ServerApp] notebook_shim | extension was successfully loaded.
[I 2022-05-12 15:41:33.560 LabApp] JupyterLab extension loaded from /usr/local/lib/python3.7/site-packages/jupyterlab
[I 2022-05-12 15:41:33.560 LabApp] JupyterLab application directory is /usr/local/share/jupyter/lab
[I 2022-05-12 15:41:33.565 ServerApp] jupyterlab | extension was successfully loaded.
[I 2022-05-12 15:41:33.569 ServerApp] nbclassic | extension was successfully loaded.
[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic extension enabled!
[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic | extension was successfully loaded.
Traceback (most recent call last):
File "/usr/local/bin/jupyter-lab", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 584, in launch_instance
serverapp = cls.initialize_server(argv=args)
File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 557, in initialize_server
find_extensions=find_extensions,
File "/usr/local/lib/python3.7/site-packages/traitlets/config/application.py", line 88, in inner
return method(app, *args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2421, in initialize
self.init_httpserver()
File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2251, in init_httpserver
max_buffer_size=self.max_buffer_size,
File "/usr/local/lib64/python3.7/site-packages/tornado/util.py", line 288, in __new__
instance.initialize(*args, **init_kwargs)
File "/usr/local/lib64/python3.7/site-packages/tornado/httpserver.py", line 191, in initialize
read_chunk_size=chunk_size,
File "/usr/local/lib64/python3.7/site-packages/tornado/tcpserver.py", line 134, in __init__
'certfile "%s" does not exist' % self.ssl_options["certfile"]
ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist
获取 valueerror:certfile“/home/glue_user/.certs/my_key_store.pem”尝试使用Docker在本地创建和运行AWS胶时,不存在。
I am new to Docker . Please help in resolving the issue.
I have created Docker compose file mentioned below :
version: "2"
services:
spark:
image: glue/spark:latest
container_name: spark
** build: ./spark**
hostname: spark
ports:
- "8888:8888"
- "4040:4040"
entrypoint : sh
command : -c "/home/glue_user/jupyter/jupyter_start.sh"
volumes:
- ../app/territoryhub-replication:/home/glue_user/workspace/jupyter_workspace
Docker file which is getting called in build section is as follows :
FROM amazon/aws-glue-libs:glue_libs_3.0.0_image_01
USER root
RUN mkdir -p /root/.aws
RUN echo "[default]\nregion=us-east-1" >> /root/.aws/config
logs from Docker is as follows :
Starting Jupyter with SSL
/home/glue_user/jupyter/jupyter_start.sh: line 4: livy-server: command not found
[I 2022-05-12 15:41:33.032 ServerApp] jupyterlab | extension was successfully linked.
[I 2022-05-12 15:41:33.044 ServerApp] nbclassic | extension was successfully linked.
[I 2022-05-12 15:41:33.046 ServerApp] Writing Jupyter server cookie secret to /root/.local/share/jupyter/runtime/jupyter_cookie_secret
[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was found and enabled by notebook_shim. Consider moving the extension to Jupyter Server's extension paths.
[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was successfully linked.
[I 2022-05-12 15:41:33.541 ServerApp] notebook_shim | extension was successfully linked.
[W 2022-05-12 15:41:33.556 ServerApp] All authentication is disabled. Anyone who can connect to this server will be able to run code.
[I 2022-05-12 15:41:33.558 ServerApp] notebook_shim | extension was successfully loaded.
[I 2022-05-12 15:41:33.560 LabApp] JupyterLab extension loaded from /usr/local/lib/python3.7/site-packages/jupyterlab
[I 2022-05-12 15:41:33.560 LabApp] JupyterLab application directory is /usr/local/share/jupyter/lab
[I 2022-05-12 15:41:33.565 ServerApp] jupyterlab | extension was successfully loaded.
[I 2022-05-12 15:41:33.569 ServerApp] nbclassic | extension was successfully loaded.
[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic extension enabled!
[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic | extension was successfully loaded.
Traceback (most recent call last):
File "/usr/local/bin/jupyter-lab", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 584, in launch_instance
serverapp = cls.initialize_server(argv=args)
File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 557, in initialize_server
find_extensions=find_extensions,
File "/usr/local/lib/python3.7/site-packages/traitlets/config/application.py", line 88, in inner
return method(app, *args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2421, in initialize
self.init_httpserver()
File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2251, in init_httpserver
max_buffer_size=self.max_buffer_size,
File "/usr/local/lib64/python3.7/site-packages/tornado/util.py", line 288, in __new__
instance.initialize(*args, **init_kwargs)
File "/usr/local/lib64/python3.7/site-packages/tornado/httpserver.py", line 191, in initialize
read_chunk_size=chunk_size,
File "/usr/local/lib64/python3.7/site-packages/tornado/tcpserver.py", line 134, in __init__
'certfile "%s" does not exist' % self.ssl_options["certfile"]
ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist
Getting
ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist while trying to create and run aws glue locally using docker .
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
目前,为了使它起作用,我添加了环境变量:
disable_ssl =“ true”,
我不确定它是否是正确解决它的正确方法。
For now in order to make it work I have added environment variable :
DISABLE_SSL="true"
I am not sure if it is correct way of resolving it.