使用 Spark 驱动程序在 Databricks 中创建 Hive 表(数据文件格式 = AVRO)
TableQuery:
CREATE TABLE `zdp`.`asdasdEntity_1` (`ter` string COMMENT 'system generated')
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
输出:
- 表是在 databricks 中创建的,
- 无法使用(desc 扩展表名)描述表属性,给出以下输出:
error_error_error_error_error_error_error
string
from deserializer
cannot_determine_schema
string
from deserializer
check
string
from deserializer
schema
string
from deserializer
url
string
from deserializer
and
string
from deserializer
literal
string
from deserializer
TableQuery:
CREATE TABLE `zdp`.`asdasdEntity_1` (`ter` string COMMENT 'system generated')
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
output:
- table is created in databricks
- cannot describe table properties using (desc extended tablename) gives below output:
error_error_error_error_error_error_error
string
from deserializer
cannot_determine_schema
string
from deserializer
check
string
from deserializer
schema
string
from deserializer
url
string
from deserializer
and
string
from deserializer
literal
string
from deserializer
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)