Databricks Init脚本无法安装软件包,但报告“成功”不管?
我一直在尝试在Databricks上设置“初始化脚本”,因此我可以安装所有Python库并控制环境。
昨天使用下图所示的初始脚本尝试了:
dbutils.fs.put("/DA/Temp/ClusterTest/python_requirements_test2.sh","""
#!/bin/bash
pip install pyodbc==4.0.32
pip install zeep==4.1.0
""", True)
这是成功的!
在试用了其他一些Techinques并回到此方法之后,Init脚本不再安装任何图书馆。
但是,
I have been attempting to setup 'init scripts' on databricks, so I can install all of my python libraries and keep the environment controlled.
Tried yesterday using the init script pictured below:
dbutils.fs.put("/DA/Temp/ClusterTest/python_requirements_test2.sh","""
#!/bin/bash
pip install pyodbc==4.0.32
pip install zeep==4.1.0
""", True)
This was successful!
But after trialling some other techinques and coming back to this method, the init script is no longer installing any of the libraries..
Can anyone shed some light on this?
Below is the 'Event Log' note about the init script, showing "Status: SUCCEEDED" even though no libraries are actually installed:
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(2)
与Databricks支持团队进行了对话后,这是其簇UI的预期功能,即 显示通过UI中安装的软件包。但是,这些软件包已安装,但这并不表示安装了这些软件包。
我已要求支持团队对此进行更新他们的文档,因为目前尚不清楚这是一种预期的行为。
After a conversation with Databricks support team, it is an intended functionality of their Clusters UI to NOT show packages installed via init script in the UI. These packages are installed however and this does not indicate that the packages arent installed.
I have asked the support team to update their documentation on this, as it was not clear that this was an intended behaviour.
到查看集群上安装的库:
To View the libraries installed on a cluster: