此hive错误如何解决?

发布于 2022-09-30 23:11:09 字数 2758 浏览 59 评论 0

运行一般的hql都没有问题,
运行

select * from mall order by createtime desc;

会报错:

INFO  : Compiling command(queryId=root_20210928170420_7553da34-85e6-4b6a-a160-b2669fd22c9e): select * from mall order by createtime desc
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:mall.createtime, type:bigint, comment:null), FieldSchema(name:mall.goodsid, type:bigint, comment:null), FieldSchema(name:mall.userid, type:bigint, comment:null), FieldSchema(name:mall.rate, type:double, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=root_20210928170420_7553da34-85e6-4b6a-a160-b2669fd22c9e); Time taken: 0.14 seconds
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Executing command(queryId=root_20210928170420_7553da34-85e6-4b6a-a160-b2669fd22c9e): select * from mall order by createtime desc
WARN  : Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
INFO  : Query ID = root_20210928170420_7553da34-85e6-4b6a-a160-b2669fd22c9e
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Number of reduce tasks determined at compile time: 1
INFO  : In order to change the average load for a reducer (in bytes):
INFO  :   set hive.exec.reducers.bytes.per.reducer=<number>
INFO  : In order to limit the maximum number of reducers:
INFO  :   set hive.exec.reducers.max=<number>
INFO  : In order to set a constant number of reducers:
INFO  :   set mapreduce.job.reduces=<number>
INFO  : number of splits:1
INFO  : Submitting tokens for job: job_local1588729876_0012
INFO  : Executing with tokens: []
INFO  : The url to track the job: http://localhost:8080/
INFO  : Job running in-process (local Hadoop)
INFO  : 2021-09-28 17:04:21,627 Stage-1 map = 0%,  reduce = 0%
ERROR : Ended Job = job_local1588729876_0012 with errors
ERROR : FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
INFO  : MapReduce Jobs Launched: 
INFO  : Stage-Stage-1:  HDFS Read: 0 HDFS Write: 0 FAIL
INFO  : Total MapReduce CPU Time Spent: 0 msec
INFO  : Completed executing command(queryId=root_20210928170420_7553da34-85e6-4b6a-a160-b2669fd22c9e); Time taken: 1.266 seconds
INFO  : Concurrency mode is disabled, not creating a lock manager
Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=2)

查了很多资料 都没能解决

谢谢大牛

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(2

青柠芒果 2022-10-07 23:11:09

参考 https://blog.csdn.net/qq_4640...

调大内存了以后 解决了

新雨望断虹 2022-10-07 23:11:09

已经有 JobId 了就去 YARN 里查一下任务调度日志吧,里面会有更详细的错误信息。

"state=08S01, code=2" 一般是内存爆了,具体哪溢出了看日志吧。

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文