Once you’ve created your accound and installed Kameleoon script, you are ready to create and launch your tests! This article will guide you step by step to launch your first test.
You are already an expert? Learn how to perfect your mastery of A/B testing with our documentation.
As an example, we will create an A/B test on Mozilla.org.
We wish to change the wording and the background color of the “Download Firefox” button in order to measure the impact of these changes on our visitors.
Kameleoon edition mode allows you to create variations of your webpages and to launch and manage your A/B tests.
From your website
To launch Kameleoon, go on one of the webpages for which you have installed Kameleoon script and press Maj + F2 or, il you are a Mac user Fn + Maj + F2.
If nothing happens, you can try another method to launch Kameleoon: simply add this code at the end of your URL:
For example, our URL will become:
Once Kameleoon is loaded, a connection pop-in opens. Fill in your user name and password to access the editor. When the editor is open you will see a header above your webpage.
From your personal space
You can also launch the editor from the back-office. First of all, you need to login to your personal space.
To do so, click on the "New test" button on the homepage or on the A/B testing dashboard page.
Creating a test
When Kameleoon is loaded, a pop-in opens allowing you to choose between the creation of a new test and the edition of an existing one. For our example, we choose to open a new test.
Name your test in the new popin. You can also add a small description and tags to your test. Then click on « create the test ».
Kameleoon header appears above your website: you are now able to create your variation!
When you are creating a new test, two variations are automatically created:
- Original: it is your original page without any changes. You cannot change nor delete this variation as it is the one used as a reference for you’re A/B test.
For further information about variations, please read our article Managing tests and variations.
Changing an element
To change an element on your page, use your cursor to select the element of your choice. A selection frame will help you to select it easily.
Once the element selected, an edition panel appear on the left of your screen.
We want to test the impact of the title “Download now” instead of “Download Firefox”. We will use the test editor to change the content of the button, and see immediately the result on our page.
To change the text, we simply clock on “Edit content” in the left panel once the text is selected. A pop-in opens, allowing us to edit the content of the selected text.
Then, we would like to change the background color of the button.
To do so, we select the button and, in the edition panel, the “Background” part will allow us to change the color.
To change the color, display the option and click on the “Color” icon.
Select the color of your chance among the samples or click on “Display color selector” to have a larger range of colors.
Validate your choice to apply it to the element you have selected.
We now have our new variation ready to be used in an A/B test.
Launching the test
Once our new variation is created, we are ready to launch our test. This step will only be possible if you have properly installed Kameleoon script on your website.
To launch your test, click on the “Test finalizer” button on the right of the header.
The following window appears, allowing you to configure and launch your test:
To launch the test, simply follow the 3 steps on your screen:
- 1st step: Select the variation to include in the test, by checking the corresponding box. If you have created several variations, you can select as many as you want to. To launch a test, you must select at least one variation.
- 2nd step: Choose the visitors targeted by your A/B test. By default, the test will launch on the current page without any specific targeting, and the traffic will be equally split between your variation(s) and the original page.
- 3rd step: Choose your reporting tool. By default, only Kameleoon reporting tool is configured with your account, but you can add other reporting tools in your personal space.
Choice of variations
This step, very simple, consist on selecting the variation(s) to include in the test. Then, you can indicate if the test is a Multivariate test or not. For further information about multivariate tests, please read our article about MVT creation.
In our case, we will test only one variation so it is a simple A/B test, but in some cases, you can have to launch a more complex test with more variations. The original page does not appear here but it will be automatically included in the test.
In the second step, we choose to launch our test only on the page displayed on screen. You can also choose to target visitors according to different criteria (traffic source, geolocalisation, returning or new visitors, etc.). For further information about targeting, you can read our article Reporting tools and goals.
By default, Kameleoon will split uniformly the trafic toward your variations but you can, if you want to, choose otherwise. For further information about traffic allocation, you can read our article about Advance configuration of deviation.
For our A/B test, we choose a 50% deviation so that the variation and the original page receive the same amount of traffic.
Note: if you have 3 variation or more to test, a deviation at 75% will indicate Kameleoon to deviate 75% of your traffic to your variations and 25% to your original page. Traffic will then be allocated equally between your variations.
Choosing a reporting tool
To analyse your A/B tests, several reporting tools are available. Kameleoon works with the main web analytics solutions on the market (Google Analytics, AT Internet, Webtrends, Adobe analytics (Omniture), Eulerian, etc.)?
Kameleoon has also its own reporting tool, configured by default with your account. To use Kameleoon reporting tool, select it on the list, then choose your main goal. To create a goal, click on the “Create a new goal” button or follow the steps as it is described in the next chapter.
If your reporting tool is not on the list, please read our article Reporting tools and goals to add a new web analytics solution.
Once all of these steps properly filled in, click on the “Next step” button on the bottom right of the window to launch your test. This button will not be available until all steps are completed.
A recap, last step before the launching of your test, will display, allowing you to check a last time is everything is fine.
Click on the OK button to confirm and launch your test.
A pop-in will confirm the launching of your test.
Setting up goals
Creating a new goal
By default, a first goal “Engagement” is automatically configured, and allows you to know if the visitor visited other pages after the landing page. The engagement can be defined as the opposite of the bounce rate.
You can configure new goals in order to analyze the access rate to a page, the number of pages view, the amount of time spent or any other custom goal. To do so, go to the "Goals" page on your personal space.
Then, click on the "New goal" button on the top right of the page and fill in the different fields of the pop-in.
For further information about the creation of goals, please read our article Reporting tools and goals.
You can also set up a click tracking directly in the editor. To learn how to use this functionality, read the article about Clicks tracking.
From the “Test finalizer” window, you can simulate your test in your browser. To do so, select one or several variation and click on the “Simulate” button on the top right of the window.
The page on which you created your test opens in a new tab. The lower half of the page shows the simulation pannel.
For further information about the simulation, you can read our article Test simulation.
Access to results
To read and analyze the results of your A/B test, login to your personal space.
Then, click on the “All tests” button on the homepage.
You can also use the left menu to open the A/B test dashboard.
Place your cursor above the A/B test of your choice and click on “See results”.
Understanding the results
The results of your A/B test will display. The left panel displays the winning variation, with the improvement rate and the trust rate.
In the example below, the variation C is the winning one, with an improvement rate of 1.07%.
For further information, a table like the one below will display and indicates the improvement rate, the trust rate, the conversion rate and the amount of conversions for each variation.
If a variation is winning, a Deviate traffic button allow to deviate 100% of your visitor on the most efficient version of your page.
For further information about the results of your tests with Kameleoon, you can read our article about the results page.