Membase Java 负载生成器问题

发布于 2024-11-09 13:19:40 字数 2761 浏览 0 评论 0原文

我正在尝试运行membase文档中提供的Java Load Generator(http://techzone.couchbase.com/wiki/display/membase/Load+Generator+Setup)

首先,我修改了workloadb文件并在其中提到了membase服务器地址。

工作负载数据库文件内容: db=com.yahoo.ycsb.db.SpymemcachedClient

memcached.address=10.72.45.165

memcached.port=11211

从属地址=10.112.83.64

histogram.buckets=20

导出文件=结果.txt

记录计数=200000

操作计数=500000

工作负载=com.yahoo.ycsb.workloads.MemcachedCoreWorkload

insertstart=200000

readallfields=true

insertproportion=0

readproportion=0.95

updateproportion=0

scanproportion=0

memaddproportion=0.05

memgetproportion=0.100

memsetproportion=0.25

memupdateproportion=0.0

memappendproportion=0.05

memprependproportion=0.05

memreplaceproportion=0.05

memcasproportion=0.05

valuelength=2048workingset

=100000

churndelta=100000

printstatsinterval=5

requestdistribution=zipfian

threadcount=4

然后,我使用命令构建整个负载生成器项目: ant decompile-memcached 并尝试使用命令加载数据: java-cp build/ycsb.jar:lib/memcached-2.5-14-g3b3b3c8.jar:lib/jackson-core-asl-1.5.2.jar:lib/jackson-mapper-asl-1.5.2.jar: lib/slf4j-api-1.6.1.jar:lib/slf4j-simple-1.6.1.jar:lib/memcached-2.5-27-gc7bc636-sources.jar:lib/memcached-2.6.jar com.yahoo.ycsb.LoadGenerator -load -P worloads/workloadb

发出此命令后,我得到终端输出:

0 sec: 0 actions; 0 次操作/秒

2011-05-24 17:05:54.022 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、 topRop=null, topWop=null, toWrite=0,interested=0} 连接队列

2011-05-24 17:05:54.026 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、topRop=null、 topWop=null, toWrite=0,interested=0} 连接队列

2011-05-24 17:05:54.027 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、topRop=null、 topWop=null, toWrite=0,interested=0} 连接队列

2011-05-24 17:05:54.036 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、topRop=null、 topWop=null, toWrite=0,interested=0} 连接队列

2011-05-24 17:05:54.046 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user76958204 的主节点。

2011-05-24 17:05:54.047 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user336694473 的主节点。

2011-05-24 17:05:54.048 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user1268118805 的主节点。

2011-05-24 17:05:54.058 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user1681771482 的主节点。

谁能指出错误吗?我有三个 membase 服务器在集群中运行。我无法理解这个错误是什么意思。

问候,

桑克特·丹吉

I am trying to run Java Load Generator provided in membase documentation (http://techzone.couchbase.com/wiki/display/membase/Load+Generator+Setup)

Firstly, I modified workloadb file and mentioned membase server address into it.

WORKLOADB FILE CONTENT :
db=com.yahoo.ycsb.db.SpymemcachedClient

memcached.address=10.72.45.165

memcached.port=11211

slaveaddress=10.112.83.64

histogram.buckets=20

exportfile=results.txt

recordcount=200000

operationcount=500000

workload=com.yahoo.ycsb.workloads.MemcachedCoreWorkload

insertstart=200000

readallfields=true

insertproportion=0

readproportion=0.95

updateproportion=0

scanproportion=0

memaddproportion=0.05

memgetproportion=0.100

memsetproportion=0.25

memupdateproportion=0.0

memappendproportion=0.05

memprependproportion=0.05

memreplaceproportion=0.05

memcasproportion=0.05

valuelength=2048

workingset=100000

churndelta=100000

printstatsinterval=5

requestdistribution=zipfian

threadcount=4

Then, I build whole load generator project by using command : ant decompile-memcached
And Tried to load data using command :
java -cp build/ycsb.jar:lib/memcached-2.5-14-g3b3b3c8.jar:lib/jackson-core-asl-1.5.2.jar:lib/jackson-mapper-asl-1.5.2.jar:lib/slf4j-api-1.6.1.jar:lib/slf4j-simple-1.6.1.jar:lib/memcached-2.5-27-gc7bc636-sources.jar:lib/memcached-2.6.jar com.yahoo.ycsb.LoadGenerator -load -P worloads/workloadb

After issuing this command, I got the terminal output :

0 sec: 0 operations; 0 ops/sec

2011-05-24 17:05:54.022 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue

2011-05-24 17:05:54.026 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue

2011-05-24 17:05:54.027 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue

2011-05-24 17:05:54.036 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue

2011-05-24 17:05:54.046 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user76958204.

2011-05-24 17:05:54.047 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user336694473.

2011-05-24 17:05:54.048 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user1268118805.

2011-05-24 17:05:54.058 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user1681771482.

Can anyone please point out the mistake ? I have three membase servers running in cluster. I am not able to understand what does this error mean.

Regards,

Sanket Dangi

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

一向肩并 2024-11-16 13:19:40

抱歉回复晚了。我不久前为此编写了代码,从那以后就没有再对其做出任何贡献。该项目的目的是为了我自己的个人基准测试,虽然它确实给我带来了良好的结果,但该项目存在很多问题,我无法找到时间来稳定它。这使得其他人目前很难使用。我确实想提一下,任何 memcached 负载生成器都可以与 Membase 一起使用,因为 Membase 在线上与 memcached 兼容。如果您仍在尝试从 Membase 获取一些基准测试结果,我建议您查看 https://github.com/ couchbaselabs/gamesim。这是一个工作负载模拟器,可以模拟玩家玩简单的游戏。

如果我能够找到时间来改进和稳定这个项目,我将更新这篇文章。

Sorry for the late response. I wrote the code for this a while back and haven't contributed to it at all since then. The purpose fo the project was for my own personal benchmarking and while it certainly got me good results there are many issues with the project and I was unable to find time to stabilize it. This makes it difficult for others to use at the moment. I do want to mention though that any memcached load generator will work with Membase since Membase is on the wire compatible with memcached. If your still trying to get some benchmarking results from Membase I want to suggest taking a look at https://github.com/couchbaselabs/gamesim. This a workload simulator that simulates players playing a simple game.

If I am able to find time to improve and stabilize this project I will update this post.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文