使用Pyspark读取Clickhouse

发布于 2025-01-29 20:07:59 字数 429 浏览 4 评论 0原文

我想使用pyspark.read.format（）阅读我的clickhouse表，但我无法做到但是，我可以使用Yandex驱动程序写作，但无法阅读，我还使用了Clickhouse-driver出于相同的目的而使用，但是由于大量数据崩溃，请指导我实现这一目标，并感谢您的帮助。

另外，我正在使用的ClickHouse设置没有任何密码，并且在默认用户上运行，这是一个问题吗？

spark.read.format('jdbc').option('driver','ru.yandex.clickhouse.ClickHouseDriver').option('url','jdbc:clickhouse://hosturl:port').option('user','').option('password','').option('dbtable','table').load()

原文

I want to read my clickhouse table using pyspark.read.format() but I am not able to do it,
However, I can write using Yandex driver but am unable to Read, I have also used clickhouse-driver for the same purpose but due to massive data it's crashing,
Please guide me in achieving the same, and thank you for your help.

Also, the clickhouse setup I am using doesn't have any password and is running on the default user so is that an issue?

spark.read.format('jdbc').option('driver','ru.yandex.clickhouse.ClickHouseDriver').option('url','jdbc:clickhouse://hosturl:port').option('user','').option('password','').option('dbtable','table').load()

分享到QQ

分享到微博