Hadoop 应用程序的包装器
是否存在 Hadoop 应用程序的包装器?我指的是一个将 Hadoop 设置转变为独立应用程序的包装器。我知道这会违背 Hadoop 的目的。然而,这将极大地帮助开发 Hadoop 应用程序。
我知道 Hadoop Netbeans 插件允许创建本地应用内 Hadoop 环境。然而,我正在寻找一个应用程序,您可以让它在单个应用程序环境中代理您的 Hadoop 应用程序。
Does there exist a wrapper for Hadoop applications? I'm referring to a wrapper that would turn a Hadoop setup into a standalone application. I understand that this would defeat the purpose of Hadoop. However, this would assist in developing Hadoop applications quite immensely.
I know that the Hadoop Netbeans plugin allows for the creation of a local in-app Hadoop environment. However, I am looking for an application where you can have it proxy your Hadoop application in a single application environment.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(3)
您所需要的只是 CLASSPATH 中的 Hadoop,默认情况下它将以本地模式运行。
All you need is Hadoop in the CLASSPATH and it will run in local mode by default.
apache hadoop wiki 上有一个用于调试 MapReduce 程序的条目。
这可能是您问题的答案
http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
还有一个 cloudera 的博客,介绍如何运行 hadoop 作为单元测试
http://www.cloudera.com/blog/2008/12/testing- hadoop/
因此,您也许可以配置环境来执行 MapReduce 程序作为单元测试,看看发生了什么
on the apache hadoop wiki is an entry for debugging map reduce programs.
That might be an answer to you question
http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
There is also a blog by cloudera on how to run hadoop as a unit test
http://www.cloudera.com/blog/2008/12/testing-hadoop/
So you might be able to configure your environment to execute your map reduce program as a unit test to see what's going on
从 tar.gz 文件在单个节点上安装 hadoop 默认情况下会在本地主机上运行所有内容。格式化 hdfs (hadoop namenode -format) 和 start-all.sh 应该可以做到。
Installing hadoop from the tar.gz file on a single node defaults to running everything on localhost. Format the hdfs (hadoop namenode -format) and start-all.sh should do it.