Kameleoon result page

To analyze the results of your A/B tests, you can use Kameleoon reporting tool. It is configured by default with all your websites. If it is not, you can read our article about reporting tools to set up a new tool.

Using Kameleoon reporting tool

How to access the results

First of all, you need to be logged in to your personal space. On the home page, click on the “All tests” button to display the list of your A/B tests.

Note: if you are looking for the results of your last A/B test, you can use the shortcut on your homepage. Click on the blue box to see the result page.

Once you have clicked on the “All tests” button, the list of your test appear. Use the search bar or scroll on the list to find the test you are interested in.

Then, place your mouse above the name of your test and click on the “See the results” button to see the results page.

Note: it can sometimes take some time to load the results. The more data there are, the longer will be the loading. Be patient!

Definitions

To understand your results, here are some definitions.

Conversion rate: this is the percentage of visits during which your goal has been converted at least once.

Improvement rate: Improvement of the conversion on your goal for the variation, compared to the original page (reference).

Trust rate: It is the reliability of your test. When this data is stable, you can trust your results.

Setting up your results

The results are displayed by goal and date range. By default, the main goal is selected and the date range goes from the launching of your test to the current day. You can, of course, set up these criteria.

Be careful! These changes are applied to the whole page.

Goal selection

You can change goal from the drop-down menu on the top of your age. Put your cursor above the selected goal to see the goals configured with this test. The results of this goal will be loaded on the page.

The goals available are the one you set up when you launched your test. If you need help to set up your reporting tool, you can read our article about reporting tools.

Date range selection

By default, the plage range goes from the launching of your test to the current day.

You can, if you want to, see the result for another date range. The new date range will be applied to all the results displayed on the page.

To do so, click on the date range on the top of your results.

A calendar appears: click on the days of your choice to select your new date range, then click on the “Validate” button.

Main information

On the left of your results, two blocks sum up the principal information of your test.

Winning variation

The first block let you know straight away which is the winning variation for the selected goal. In our case, it is the variation “C”.

Click on the name of a variation to see more details.

You can see in the blink of an eye the variations names, improvement rates and trust rates.

Information about the test

The second block shows the main information about your test, for the selected date range.

These information concerns the whole test and will stay the same for any goal.

 

A graph shows the amount of visitors and which variation they saw.

You can also find here the launching date of your test and the reporting tools selected, here Kameleoon and Heat maps.

Detailed results

Conversion rate

The conversion rate is represented with this icon:

If you only have one or two goals set up, this page will be displayed by default on the results page.

This curve shows you the evolution of the conversion rate for each variation, on the goal and date range selected.

In our example, we can see that the conversion rate of the reference (grey curve) is always higher than the conversion rate of the variations.

Display data

You can choose to show one dot per day, week or month in order to calibrate the precision of your results.

The more data you will display, the more precise the results will be. Choose according to your test: displaying the data per month on a two months test would only give 2 data. On the contrary, displaying the data per day on a six month test would give a very high amount of data.

Detailed information

Place your cursor above a dot to see more details.

Choice of variation

By default, all variations are displayed. You can choose to hide or show the curve of any variation. It can be very useful to compare two variations or simply to read more easily your results if you have too many variations.

To select or unselect a variation, click on “All selected” to open the drop-down menu and check or uncheck the variations of your choice.

Comparative view

The comparative view is represented with this icon:

If you have three or more goals set up, this page will be displayed by default on the results page.

This “Cobweb” will allow you to compare the performances of your variations.

For each goal, you will see the improvement rate of your variations.

By default, all of your goals and variations are displayed in this chart, but you can customize the data displayed.

In our example, we can see that:

  • On the “Engagement” goal, the results of the variations are similar to the original (not improved but not worse either)
  • On the “Click CTA” goal, both variations have better results than the original. The orange variation is the winning one.
  • On the “Click on link” goal, both variations have lower results than the original.

Goal selection

To select which goals to display, click on “All selected” to open the drop-down menu. You can then check or uncheck any goal.

To create the graph, you must select at least three goals.

Variation choice

By default, all of your variations appear on the graph. You can choose to show or hide any variation. It can be very useful to compare two variations or to read your results more easily when you have too many variations.

To select or unselect a variation, simply check or uncheck the corresponding boxes, located on the right of your graph.

Detailed information

Place your cursor above a dot to see more details.

Trust rate

The trust rate is is represented with this icon:

This curve allows you to display the evolution of the trust rate for each of your variations, on the goal and the date range selected.

Once you have launched your test, your results might vary. This way, your trust rate – which is the probability for a variation to beat the original – will vary a lot at the beginning of your test. This means that the data cannot be used yet and that the test should continue running to gather more data.

When the curve is flat, it means the results of your test are stable and you can use them safely.

In our example, both curves are stabilized at almost 100%. It means that, for the selected foal, both variations are likely to beat the original.

The blue curve was stable before the orange one, which means that the data collected for this variation were reliable sooner.

Displaying data

You can choose to show one data per day, week or month in order to calibrate the precision of your results.

The more data you will display, the more precise the results will be. Choose according to your test: displaying the data per month on a two months test would only give 2 data. On the contrary, displaying the data per day on a six month test would give a very high amount of data.

Detailed information

Place your cursor above a dot to see more details.

Choix des variantes

By default, all variations are displayed. You can choose to hide or show the curve of any variation. It can be very useful to compare two variation or simply to read more easily your results if you have too many variations.

To select or unselect a variation, click on “All selected” to open the drop-down menu and check or uncheck the variations of your choice.

Recap chart

Your results

On the bottom of the page, a table sums up all the results of your test. It concerns the goal and the date range selected on the top of the page. You can also display the results of your other goals by clicking on “Show all goals”.

The original page, named A, will always be in the first column, in grey. The winning variation will appear in the second colun, with the “Deviate traffic” button, allowing you to deviate all your traffic to this variation.

You will find in this table the improvement rate, the trust rate and the conversion rate.

For the original page, the improvement rate will always be 0, and there will never be any trust rate.

You will also find in this table the amount of conversions, visits and converted visits.

Filters/Ventilation

You can also see more precise results thanks to the “Filters/Ventilation” option.

When you click on the “Filters/Ventilation” button, two drop-down menu open, allowing you to ventilate and/or filter your results. You can use both at the same time or only one of them.

Ventilation

Ventilation allows you to display more precise results: this way, you can see the detail of your results by browser, operating system, day of the week, etc.

Choose your ventilation, then click on the “Validate” button.

In our example, we chose to ventilate the results by day of the week. This way, we can access the detailed results. Click on the section of your choice to see more details according to the ventilation you chose.

Filter

You can also filter the results: ventilation shows the details of your results and the filter only shows you what you want to see.

This way, you can decide to display only results for visitors using a specific device or browser.

To do so, choose the filter of your choice and click on the “Validate” button.

A pop-in opens, allowing you to choose your filter. For example, if you choose the filter “Day of week”, you can choose to display only results of the week-end or a particular day.

Click again on the “Validate” button to activate the filter. 

Have more questions? Submit a request
Powered by Zendesk