如何让 Hive 与 bz2 一起工作？

发布于 2024-12-11 18:51:14 字数 429 浏览 0 评论 0原文

由于 bz2 是可拆分的并且节省空间，因此我计划以 bzip2 格式存储表数据。但它似乎无法识别压缩格式。 gzip 格式没问题。我使用的代码如下所示：

CREATE TABLE IF NOT EXISTS image_bzip (
    image_id STRING,
    image_feature STRING, 
    other_stuff STRING)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION '/hivestore/bzip';

LOAD DATA LOCAL INPATH '/nfs/directory/*.bz2' OVERWRITE INTO TABLE image_bzip;

有人能指出我缺少什么吗？

谢谢。

原文

Since bz2 is splittable and saves space, I'm planning to store the table data in bzip2 format.
However it seems it's not recognizing the compressed format. It was fine with gzip format.
The code I used looks like this:

CREATE TABLE IF NOT EXISTS image_bzip (
    image_id STRING,
    image_feature STRING, 
    other_stuff STRING)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION '/hivestore/bzip';

LOAD DATA LOCAL INPATH '/nfs/directory/*.bz2' OVERWRITE INTO TABLE image_bzip;

Can somebody point me what I'm missing ?

Thanks.

分享到QQ

分享到微博