AWS胶图像证书相关的问题

发布于 2025-01-28 11:53:23 字数 3685 浏览 3 评论 0原文

我是Docker的新手。请帮助解决问题。

我已经创建了下面提到的Docker组成文件:

version: "2"

services:
 spark:
  image: glue/spark:latest
  container_name: spark
**  build: ./spark**
  hostname: spark
  ports:
   - "8888:8888"
   - "4040:4040"
  entrypoint : sh 
  command : -c "/home/glue_user/jupyter/jupyter_start.sh"
  volumes:
  - ../app/territoryhub-replication:/home/glue_user/workspace/jupyter_workspace

在构建部分中被调用的Docker文件如下:

FROM amazon/aws-glue-libs:glue_libs_3.0.0_image_01

USER root
RUN mkdir -p /root/.aws
RUN echo "[default]\nregion=us-east-1" >> /root/.aws/config

Docker的日志如下:

Starting Jupyter with SSL

/home/glue_user/jupyter/jupyter_start.sh: line 4: livy-server: command not found

[I 2022-05-12 15:41:33.032 ServerApp] jupyterlab | extension was successfully linked.

[I 2022-05-12 15:41:33.044 ServerApp] nbclassic | extension was successfully linked.

[I 2022-05-12 15:41:33.046 ServerApp] Writing Jupyter server cookie secret to /root/.local/share/jupyter/runtime/jupyter_cookie_secret

[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was found and enabled by notebook_shim. Consider moving the extension to Jupyter Server's extension paths.

[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was successfully linked.

[I 2022-05-12 15:41:33.541 ServerApp] notebook_shim | extension was successfully linked.

[W 2022-05-12 15:41:33.556 ServerApp] All authentication is disabled.  Anyone who can connect to this server will be able to run code.

[I 2022-05-12 15:41:33.558 ServerApp] notebook_shim | extension was successfully loaded.

[I 2022-05-12 15:41:33.560 LabApp] JupyterLab extension loaded from /usr/local/lib/python3.7/site-packages/jupyterlab

[I 2022-05-12 15:41:33.560 LabApp] JupyterLab application directory is /usr/local/share/jupyter/lab

[I 2022-05-12 15:41:33.565 ServerApp] jupyterlab | extension was successfully loaded.

[I 2022-05-12 15:41:33.569 ServerApp] nbclassic | extension was successfully loaded.

[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic extension enabled!

[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic | extension was successfully loaded.

Traceback (most recent call last):

  File "/usr/local/bin/jupyter-lab", line 8, in <module>

    sys.exit(main())

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 584, in launch_instance

    serverapp = cls.initialize_server(argv=args)

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 557, in initialize_server

    find_extensions=find_extensions,

  File "/usr/local/lib/python3.7/site-packages/traitlets/config/application.py", line 88, in inner

    return method(app, *args, **kwargs)

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2421, in initialize

    self.init_httpserver()

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2251, in init_httpserver

    max_buffer_size=self.max_buffer_size,

  File "/usr/local/lib64/python3.7/site-packages/tornado/util.py", line 288, in __new__

    instance.initialize(*args, **init_kwargs)

  File "/usr/local/lib64/python3.7/site-packages/tornado/httpserver.py", line 191, in initialize

    read_chunk_size=chunk_size,

  File "/usr/local/lib64/python3.7/site-packages/tornado/tcpserver.py", line 134, in __init__

    'certfile "%s" does not exist' % self.ssl_options["certfile"]

ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist

获取 valueerror:certfile“/home/glue_user/.certs/my_key_store.pem”尝试使用Docker在本地创建和运行AWS胶时,不存在。

I am new to Docker . Please help in resolving the issue.

I have created Docker compose file mentioned below :

version: "2"

services:
 spark:
  image: glue/spark:latest
  container_name: spark
**  build: ./spark**
  hostname: spark
  ports:
   - "8888:8888"
   - "4040:4040"
  entrypoint : sh 
  command : -c "/home/glue_user/jupyter/jupyter_start.sh"
  volumes:
  - ../app/territoryhub-replication:/home/glue_user/workspace/jupyter_workspace

Docker file which is getting called in build section is as follows :

FROM amazon/aws-glue-libs:glue_libs_3.0.0_image_01

USER root
RUN mkdir -p /root/.aws
RUN echo "[default]\nregion=us-east-1" >> /root/.aws/config

logs from Docker is as follows :

Starting Jupyter with SSL

/home/glue_user/jupyter/jupyter_start.sh: line 4: livy-server: command not found

[I 2022-05-12 15:41:33.032 ServerApp] jupyterlab | extension was successfully linked.

[I 2022-05-12 15:41:33.044 ServerApp] nbclassic | extension was successfully linked.

[I 2022-05-12 15:41:33.046 ServerApp] Writing Jupyter server cookie secret to /root/.local/share/jupyter/runtime/jupyter_cookie_secret

[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was found and enabled by notebook_shim. Consider moving the extension to Jupyter Server's extension paths.

[I 2022-05-12 15:41:33.541 ServerApp] sparkmagic | extension was successfully linked.

[I 2022-05-12 15:41:33.541 ServerApp] notebook_shim | extension was successfully linked.

[W 2022-05-12 15:41:33.556 ServerApp] All authentication is disabled.  Anyone who can connect to this server will be able to run code.

[I 2022-05-12 15:41:33.558 ServerApp] notebook_shim | extension was successfully loaded.

[I 2022-05-12 15:41:33.560 LabApp] JupyterLab extension loaded from /usr/local/lib/python3.7/site-packages/jupyterlab

[I 2022-05-12 15:41:33.560 LabApp] JupyterLab application directory is /usr/local/share/jupyter/lab

[I 2022-05-12 15:41:33.565 ServerApp] jupyterlab | extension was successfully loaded.

[I 2022-05-12 15:41:33.569 ServerApp] nbclassic | extension was successfully loaded.

[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic extension enabled!

[I 2022-05-12 15:41:33.569 ServerApp] sparkmagic | extension was successfully loaded.

Traceback (most recent call last):

  File "/usr/local/bin/jupyter-lab", line 8, in <module>

    sys.exit(main())

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 584, in launch_instance

    serverapp = cls.initialize_server(argv=args)

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/extension/application.py", line 557, in initialize_server

    find_extensions=find_extensions,

  File "/usr/local/lib/python3.7/site-packages/traitlets/config/application.py", line 88, in inner

    return method(app, *args, **kwargs)

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2421, in initialize

    self.init_httpserver()

  File "/usr/local/lib/python3.7/site-packages/jupyter_server/serverapp.py", line 2251, in init_httpserver

    max_buffer_size=self.max_buffer_size,

  File "/usr/local/lib64/python3.7/site-packages/tornado/util.py", line 288, in __new__

    instance.initialize(*args, **init_kwargs)

  File "/usr/local/lib64/python3.7/site-packages/tornado/httpserver.py", line 191, in initialize

    read_chunk_size=chunk_size,

  File "/usr/local/lib64/python3.7/site-packages/tornado/tcpserver.py", line 134, in __init__

    'certfile "%s" does not exist' % self.ssl_options["certfile"]

ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist

Getting
ValueError: certfile "/home/glue_user/.certs/my_key_store.pem" does not exist while trying to create and run aws glue locally using docker .

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

明月夜 2025-02-04 11:53:23

目前,为了使它起作用,我添加了环境变量:
disable_ssl =“ true”,

我不确定它是否是正确解决它的正确方法。

For now in order to make it work I have added environment variable :
DISABLE_SSL="true"

I am not sure if it is correct way of resolving it.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文