Membase Java 负载生成器问题
我正在尝试运行membase文档中提供的Java Load Generator(http://techzone.couchbase.com/wiki/display/membase/Load+Generator+Setup)
首先,我修改了workloadb文件并在其中提到了membase服务器地址。
工作负载数据库文件内容: db=com.yahoo.ycsb.db.SpymemcachedClient
memcached.address=10.72.45.165
memcached.port=11211
从属地址=10.112.83.64
histogram.buckets=20
导出文件=结果.txt
记录计数=200000
操作计数=500000
工作负载=com.yahoo.ycsb.workloads.MemcachedCoreWorkload
insertstart=200000
readallfields=true
insertproportion=0
readproportion=0.95
updateproportion=0
scanproportion=0
memaddproportion=0.05
memgetproportion=0.100
memsetproportion=0.25
memupdateproportion=0.0
memappendproportion=0.05
memprependproportion=0.05
memreplaceproportion=0.05
memcasproportion=0.05
valuelength=2048workingset
=100000
churndelta=100000
printstatsinterval=5
requestdistribution=zipfian
threadcount=4
然后,我使用命令构建整个负载生成器项目: ant decompile-memcached 并尝试使用命令加载数据: java-cp build/ycsb.jar:lib/memcached-2.5-14-g3b3b3c8.jar:lib/jackson-core-asl-1.5.2.jar:lib/jackson-mapper-asl-1.5.2.jar: lib/slf4j-api-1.6.1.jar:lib/slf4j-simple-1.6.1.jar:lib/memcached-2.5-27-gc7bc636-sources.jar:lib/memcached-2.6.jar com.yahoo.ycsb.LoadGenerator -load -P worloads/workloadb
发出此命令后,我得到终端输出:
0 sec: 0 actions; 0 次操作/秒
2011-05-24 17:05:54.022 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、 topRop=null, topWop=null, toWrite=0,interested=0} 连接队列
2011-05-24 17:05:54.026 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、topRop=null、 topWop=null, toWrite=0,interested=0} 连接队列
2011-05-24 17:05:54.027 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、topRop=null、 topWop=null, toWrite=0,interested=0} 连接队列
2011-05-24 17:05:54.036 信息 net.spy.memcached.MemcachedConnection:添加了 {QA sa=/10.72.45.165:11222、#Rops=0、#Wops=0、#iq=0、topRop=null、 topWop=null, toWrite=0,interested=0} 连接队列
2011-05-24 17:05:54.046 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user76958204 的主节点。
2011-05-24 17:05:54.047 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user336694473 的主节点。
2011-05-24 17:05:54.048 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user1268118805 的主节点。
2011-05-24 17:05:54.058 警告 net.spy.memcached.MemcachedConnection:无法重新分发到另一个节点,正在重试 user1681771482 的主节点。
谁能指出错误吗?我有三个 membase 服务器在集群中运行。我无法理解这个错误是什么意思。
问候,
桑克特·丹吉
I am trying to run Java Load Generator provided in membase documentation (http://techzone.couchbase.com/wiki/display/membase/Load+Generator+Setup)
Firstly, I modified workloadb file and mentioned membase server address into it.
WORKLOADB FILE CONTENT :
db=com.yahoo.ycsb.db.SpymemcachedClient
memcached.address=10.72.45.165
memcached.port=11211
slaveaddress=10.112.83.64
histogram.buckets=20
exportfile=results.txt
recordcount=200000
operationcount=500000
workload=com.yahoo.ycsb.workloads.MemcachedCoreWorkload
insertstart=200000
readallfields=true
insertproportion=0
readproportion=0.95
updateproportion=0
scanproportion=0
memaddproportion=0.05
memgetproportion=0.100
memsetproportion=0.25
memupdateproportion=0.0
memappendproportion=0.05
memprependproportion=0.05
memreplaceproportion=0.05
memcasproportion=0.05
valuelength=2048
workingset=100000
churndelta=100000
printstatsinterval=5
requestdistribution=zipfian
threadcount=4
Then, I build whole load generator project by using command : ant decompile-memcached
And Tried to load data using command :
java -cp build/ycsb.jar:lib/memcached-2.5-14-g3b3b3c8.jar:lib/jackson-core-asl-1.5.2.jar:lib/jackson-mapper-asl-1.5.2.jar:lib/slf4j-api-1.6.1.jar:lib/slf4j-simple-1.6.1.jar:lib/memcached-2.5-27-gc7bc636-sources.jar:lib/memcached-2.6.jar com.yahoo.ycsb.LoadGenerator -load -P worloads/workloadb
After issuing this command, I got the terminal output :
0 sec: 0 operations; 0 ops/sec
2011-05-24 17:05:54.022 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue
2011-05-24 17:05:54.026 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue
2011-05-24 17:05:54.027 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue
2011-05-24 17:05:54.036 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.72.45.165:11222, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue
2011-05-24 17:05:54.046 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user76958204.
2011-05-24 17:05:54.047 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user336694473.
2011-05-24 17:05:54.048 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user1268118805.
2011-05-24 17:05:54.058 WARN net.spy.memcached.MemcachedConnection: Could not redistribute to another node, retrying primary node for user1681771482.
Can anyone please point out the mistake ? I have three membase servers running in cluster. I am not able to understand what does this error mean.
Regards,
Sanket Dangi
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
抱歉回复晚了。我不久前为此编写了代码,从那以后就没有再对其做出任何贡献。该项目的目的是为了我自己的个人基准测试,虽然它确实给我带来了良好的结果,但该项目存在很多问题,我无法找到时间来稳定它。这使得其他人目前很难使用。我确实想提一下,任何 memcached 负载生成器都可以与 Membase 一起使用,因为 Membase 在线上与 memcached 兼容。如果您仍在尝试从 Membase 获取一些基准测试结果,我建议您查看 https://github.com/ couchbaselabs/gamesim。这是一个工作负载模拟器,可以模拟玩家玩简单的游戏。
如果我能够找到时间来改进和稳定这个项目,我将更新这篇文章。
Sorry for the late response. I wrote the code for this a while back and haven't contributed to it at all since then. The purpose fo the project was for my own personal benchmarking and while it certainly got me good results there are many issues with the project and I was unable to find time to stabilize it. This makes it difficult for others to use at the moment. I do want to mention though that any memcached load generator will work with Membase since Membase is on the wire compatible with memcached. If your still trying to get some benchmarking results from Membase I want to suggest taking a look at https://github.com/couchbaselabs/gamesim. This a workload simulator that simulates players playing a simple game.
If I am able to find time to improve and stabilize this project I will update this post.