HBase最少的服务器组成是多少?

发布于 2025-01-08 06:36:25 字数 183 浏览 1 评论 0 原文

HBase最少的服务器组成是多少?

全分布式,使用分片,但不使用Hadoop。 这是用于生产环境的。

我期待着这样的解释。

  • 服务器 1:Zookeeper

  • 服务器 2:区域服务器

    ...以及更多

谢谢。

How many is the minimum server composition of HBase?

Full-distributed, use sharding, but not use Hadoop.
It's for production environment.

I'm looking forward to explain like this.

  • Server 1: Zookeeper

  • Server 2: Region server

    ... and more

Thank you.

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

空袭的梦i 2025-01-15 06:36:25

最小值为 1 - 请参阅伪分布式模式。涉及的移动部分是:

假设您正在 HDFS 上运行(您应该这样做):

  1. 1 个 HDFS NameNode
  2. 1 个或多个 HDFS 辅助 NameNode
  3. 1 个或多个 HDFS DataNode

对于 MapReduce(如果需要):

  1. 1 个 MapReduce JobTracker
  2. 1 个或多个 MapReduce TaskTracker(通常与数据节点相同的机器)

对于 HBase 本身

  1. 1 个或多个 HBase Master(热备份)是个好主意)
  2. 1 个或多个 HBase RegionServer(通常与数据节点相同的机器)
  3. 1 个或多个 Thrift 服务器(如果您需要从其所在的网络外部访问 HBase)

对于 ZooKeeper

  1. 3 - 5 个 ZooKeeper 节点)

您需要的机器数量实际上取决于您在面对硬件故障时需要多少可靠性以及哪种节点。上述节点中唯一(尚)不支持在硬件故障时进行热故障转移或其他恢复的节点是 HDFS NameNode,尽管该问题已在最新的 Hadoop 版本中得到修复。

您通常希望将 RegionServer 的 HDFS 复制因子设置为 3,以便可以利用 机架意识

因此,在漫长的谩骂之后,我建议至少(对于生产部署):

  • 1x HDFS NameNode
  • 1x JobTracker / secondary NameNode
  • 3x ZK 节点
  • 3x DataNode / RegionServer 节点(如果你想运行MapReduce、TaskTracker)
  • 1x Thrift 服务器(仅当从其运行的网络外部访问 HBase 时)

The minimum is one- see pseudo-distributed mode. The moving parts involved are:

Assuming that you are running on HDFS (which you should be doing):

  1. 1 HDFS NameNode
  2. 1 or more HDFS Secondary NameNode(s)
  3. 1 or more HDFS DataNode(s)

For MapReduce (if you want it):

  1. 1 MapReduce JobTracker
  2. 1 or more MapReduce TaskTracker(s) (Usually same machines as datanodes)

For HBase itself

  1. 1 or more HBase Master(s) (Hot backups are a good idea)
  2. 1 or more HBase RegionServer(s) (Usually same machines as datanodes)
  3. 1 or more Thrift Servers (if you need to access HBase from the outside the network it is on)

For ZooKeeper

  1. 3 - 5 ZooKeeper node(s)

The number of machines that you need is really dependent on how much reliability you need in the face of hardware failure and for what kind of nodes. The only node of the above that does not (yet) support hot failover or other recovery in the face of hardware failure is the HDFS NameNode, though that is being fixed in the more recent Hadoop releases.

You typically want to set the HDFS replication factor of your RegionServers to 3, so that you can take advantage of rack awareness.

So after that long diatribe, I'd suggest at a minimum (for a production deployment):

  • 1x HDFS NameNode
  • 1x JobTracker / Secondary NameNode
  • 3x ZK Nodes
  • 3x DataNode / RegionServer nodes (And if you want to run MapReduce, TaskTracker)
  • 1x Thrift Server (Only if accessing HBase from outside of the network it is running on)
~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文