使用 100 - 1000 GB 内存测试 Java 库

发布于 2024-11-28 20:48:00 字数 359 浏览 1 评论 0原文

我有一个开源库,旨在有效支持非常大的集合。我已经在 24 GB 的 PC 上测试了它,但想在更大的系统(最高 1 TB)上测试它。大多数托管解决方案不支持这种内存大小,我只需要短暂访问。

我测试的是一个包含 5 亿个对象、12 个字段的集合,完整的 GC 时间低于 0.11 秒。我还有另一个测试,它只用一位存储 1280 亿个元素。

库/测试很小,所以除了大量主内存之外我不需要太多。

您对我如何在不购买自己的 96 或 192 GB 服务器的情况下进行此测试有什么建议吗?

I have an open source library which is designed to support very large collections efficiently. I have tested it on my PC with 24 GB but would like to test it on much a larger system, up to 1 TB. Most hosting solutions don't support this sort of memory sizes and I only need access for brief periods of time.

What I have tested is a collection of 500 million objects with 12 fields the full GC time is below 0.11 seconds. I have another test were it stores 128 billion elements with just one bit.

The library/test is small, so I don't have require much other than a lot of main memory.

Do you have any suggestions on how I could do this testing without buying my own server with 96 or 192 GB?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(4

傾旎 2024-12-05 20:48:00

EC2 拥有每个高达 68.4 GB 的高内存实例,并按小时收费。当然,这不是 100GB 内存,但是,如果你将其中一些堆叠在一起......

EC2 has high-memory instances of up to 68.4 GB each, and they charge by the hour. Granted, that is not 100GB of memory, but, if you stack a few of them up together....

赤濁 2024-12-05 20:48:00

联系 Contegix - 他们也许能够免费帮助您,因为您有一个需要测试的开源库。我最近出于同样的需求联系了他们,他们在一天内通过电子邮件进行跟进,并在第二天打电话,并且对需要使用跨多个服务器的大量内存进行横向扩展测试的可能性非常开放。

他们的创新倡导者页面描述了他们已经帮助的对象。只需在 http://www.contegix.com/contact/ 填写我们的联系表格,他们就会尽快回复您。

Contact Contegix - they may be able to help you for free since you have an open source library you need to test. I reached out to them recently for the same need and they followed up within a day via email and called the day after and were very open to the possibility of the need to use large amounts of memory spanned across several servers for scale out testing.

Their Advocates for Innovation page describes who they help already. Just fill our their contact form at http://www.contegix.com/contact/ and they should get back to you soon.

尘世孤行 2024-12-05 20:48:00

也许您可以使用像 Zing 这样的“虚拟化”JVM - 它具有最大堆大小512 GB。也许如果你联系他们,他们会让你免费执行这个测试——这将是他们的垃圾收集器的一个很好的展示。

Perhaps you could use a "virtualized" JVM like Zing -- it has a maximum heap size of 512 GB. Maybe if you contact them they will let you perform this test for free -- it would be a great showcase for their garbage collector.

月依秋水 2024-12-05 20:48:00

您应该看一下 Amazon EC2 或 Google 应用程序引擎。

You should take a look at Amazon EC2 or Google app engine.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文