A/B tests are an absolute must if you want to alleviate the potential risk of unveiling a new feature to such a large audience. It is supported by hundreds of thousands of players across many Worlds. Moreover, releasing a new feature to a smaller group of users allows us to monitor feedback more effectively and prevent the potential outpouring of frustration that could happen if we were to release features to the whole game population right away.įorge of Empires is, of course, a big game. With this data, we can refine our features and identify potential issues. They allow us to access more meaningful data based on a live testing environment. It is why A/B tests are essential for us. In the end, we can intervene and either adjust the feature or scratch it out completely. If the results don't show a positive trend, we can dig in deeper and check if there was an issue. That helps us establish whether this change was beneficial and attractive to our players as a new offering.
With both groups in mind, we can compare many aspects (including daily participation, user retention with the feature, ages of people participating, etc). Let's take the recent Daily Challenge update as an example. And we must consider both, but please try to keep in mind that forum feedback is only one part of many areas that we receive feedback from. We do this via both quantitative and qualitative feedback. Through this comparison, developers can directly monitor the change in player behavior and assess the impact of the tested feature. They consist of a test group (group 'A'), which will get access to a feature, and a control group (group 'B'), which does not.
With such tests, two or more groups are randomly selected. An A/B Test is an industry-standard test often used by developers to monitor player reaction to a feature. Let's begin with a definition of an A/B Test. Therefore, we thought it would be insightful for you to have more information on our approach to A/B tests and why these are integral to the development of Forge of Empires. In particular, comments about the A/B tests for Forge Plus and the Daily Challenges update. In recent times, we have received comments regarding A/B tests and how we conducted them.
0 kommentar(er)
