我在将DBT云和DBT Core连接到数据映的问题上有问题,
我读了这4个链接,但仍然无法连接
https://docs.databricks.com/integrations/prep/dbt-cloud.html#connect-to-to-connect-to-dbt-dbt-cloud&dbt-cloud&amp.amp;language-cluster
https://docs.databricks.coms.coms.coms.com/integrations/integrations/intregrations/IntIntegrations/prep/prep/dbt。 html
https://docs.getdbt.com/reference/wareference/warehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehousehouse -profiles/databricks-profile
httpps://github.com/databrick.com/databricks/databricks/databricks/datbt-databricks
在dbt-cloud上:
当我在项目创建步骤中测试连接时,它通过了测试。但是,当我使用连接创建作业并运行时,它会返回此消息:“无法在Spark中设置数据库!”
编辑:问题曾经解决过,但又回来了。
原始修复:
DBT核连接问题已解决。该问题是由MacOS上的Python证书问题引起的。请参阅此链接的解决方案
在DBT核上:
这是我在文档上设置propiles.yaml文件库的方式:
databrick_dbt_lakehouse:
outputs:
dev:
host: adb-755xxxxxxx7.7.azuredatabricks.net
http_path: /sql/protocolv1/o/755xxxx7/0517-xxxxxx-xxxxxx
schema: default
threads: 1
token: dapi<my token>
type: databricks
target: dev
注意:
- 对于http_path,我在sql/...我之前尝试过有或没有backslash(/)的http_path ...
- 我假设该架构表示数据库名称。我已经尝试了2,但是它们都没有作品,
- 我将使用Pipenv与Python版本3.8.8一起
运行 dbt debug
我收到了此消息:
check failed:
dbt was unable to connect to the specified database.
The database returned the following error:
Runtime Error
Database Error
failed to connect
请提供帮助,谢谢,谢谢
I am having issue connecting my dbt cloud and dbt core to databricks
I have read these 4 links, but still can not connect
https://docs.databricks.com/integrations/prep/dbt-cloud.html#connect-to-dbt-cloud&language-Cluster
https://docs.databricks.com/integrations/prep/dbt.html
https://docs.getdbt.com/reference/warehouse-profiles/databricks-profile
https://github.com/databricks/dbt-databricks
on dbt-cloud:
When I test the connection during the project creation step, it passed the test. however when I use the connection to create a job and run, it returns this message:"Cannot set database in spark!"
Edit: the issue once has been fixed but it comes back again.
original fix:
The dbt-core connection issue has been fixed. The issue is caused by the python certificate issue on MacOS. please refer to this link for the solution
on dbt-core:
this how I set up my profiles.yaml file base on the documentations:
databrick_dbt_lakehouse:
outputs:
dev:
host: adb-755xxxxxxx7.7.azuredatabricks.net
http_path: /sql/protocolv1/o/755xxxx7/0517-xxxxxx-xxxxxx
schema: default
threads: 1
token: dapi<my token>
type: databricks
target: dev
Note:
- for http_path i have tried both with or without backslash (/) before sql/...
- I assume the schema means database name. I have tried 2, but none of them works
- I use pipenv with python version 3.8.8
when I run dbt debug
I got this message:
check failed:
dbt was unable to connect to the specified database.
The database returned the following error:
Runtime Error
Database Error
failed to connect
Please help, thanks
发布评论
评论(2)
您的
http_path
似乎是错误的。这是我的profiles.yml
的摘录,您是使用群集(例如通用目的群集)还是SQL端点?
Your
http_path
seems wrong. Here is an extract from myprofiles.yml
Are you using a cluster (e.g. All Purpose Cluster) or a SQL Endpoint?
编辑:这个问题又回来了。 后的第三天写了此评论。
当我运行
dbt Run
或dbt快照
返回此错误消息时,在原始修复
我 MacOS上的Python证书发行。请参阅此链接的解决方案。
DBT云问题是由YAML文件中错误的模式名称引起的
Edit: This issue is came back again. I am writing this comment on the 3rd day after the original fix
When I run
dbt run
ordbt snapshot
the returns this error message:original fix:
The issue is caused by the python certificate issue on MacOS. please refer to this link for the solution.
The dbt cloud issue is caused by the incorrect schema name in the yaml file