A/B 测试和统计解决方案
几个月来我一直在寻找一个好的测试框架,但没有找到任何东西,所以我一直在构建自己的框架。
这就是我想做的:
- 跟踪任意行为(例如查看的照片数量、发布的评论数量)
- 跟踪任意变量和这些行为之间的相关性
(例如,这个提示的不同版本如何影响平均查看的照片数量?)
这种事情应该是敏捷开发的核心部分。 外面有什么? 我知道 Google 网站优化工具是答案之一,但您只能跟踪以单个“成功”页面结束的行为。
如果有一个插件可以在您的代码中工作(在我的例子中为 Rails)并提供带有漂亮图表的良好托管服务,那就太好了......
I've been looking for a good testing framework for months, not finding anything, so I've just been building my own.
This is what I want to do:
- track arbitrary behaviors (e.g. # of photos viewed, # of comments posted)
- track correlation between arbitrary variables and those behaviors
(e.g, how do different versions of this prompt affect average # of photos viewed?)
This kind of thing should be a core part of agile development. What's out there? I know Google Website Optimizer is one of the answers, but you can only track behaviors that end in a single "success" page.
It'd be great to have a plugin that can work within your code (Rails in my case) and feed into a nice hosted service with pretty graphs...
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(2)
您可能希望将问题划分为分析(印象、操作和可能的页内事件、测试报告)和用于提供变体的框架(如何在准备变体的实际方面管理变体,您是否需要存储变化以供将来参考、打开和关闭测试、优化测试的有效性等)。 显然存在重叠,例如,Google 网站优化器一旦有数据支持,就可以关闭不良变体,但通过将其视为不同的问题,您也许可以重用 Google Analytics 组件。
You may want to partition your problem into analytics (impressions, actions, and possible in-page events, reporting of your tests), and a framework for serving up your variations (how do you manage x variations both in practical terms of preparing them, do you need to store variations for future reference, turning on and off tests, optimize the effectiveness of your test etc). There is clearly an overlap, say, Google Website Optimizer can turn off a bad variation as soon as it has data to support it, but by thinking about this as different problems you may be able to reuse perhaps the Google Analytics component.
是的,在这里:
http://github.com/paulmars/seven_minute_abs/tree/master
Yep, here:
http://github.com/paulmars/seven_minute_abs/tree/master