What is an A/A Experiment?
A/A Experiments are experiments in which you test the Original page against an identical copy of itself, with the purpose of finding any issues with the setup or the platform that is being used for testing.
If the setup of the experiment is correct you should receive inconclusive results, and there should not be a winner declared.
After this experience is created and your setup verified, you can use it as a base for your A/B or Split URL Experiments.
It is good to also enable Google Analytics tracking on A/A experiment. This will foresee any differences between Convert and Google Analytics data.
What do I do if I get a winner?
If a winner is declared in your A/A test, you should check the setup of your experiment, to detect any inconsistencies on the measurement of your conversions.
*However, there may be a small portion of these type of tests in which a false declaration may occur by pure chance.
How do I create one?
- Click on the Experiences menu item on the left side.
- Click on the "+ New Experience" on the upper right side.
- Fill out the details of the "Experience Creation Wizard", and select the "A/A Experiment" experience type.
After, this your A/A Experiment should be created. This will be identical to other types of experiments in the platform besides the difference that there are no options to "Edit Variations".
- Then you should Activate the experience by clicking Activate Experience button on the bottom left "Experience Summary" screen:
Get the Standard Conversion Rate of my Page
You can also use an A/A test to get the standard conversion rate of your page while using Convert. To do this, you should pause the Original of your experiment, and run the experience with only the variation. This will get you your standard conversion rate that you can use for planning future A/B tests.
- Access your report by clicking on "Experiment Report" at the bottom left of your "Experience Summary" screen.
- To pause the Original, you should hover on the Original row on the first table of the report near the "Conversion Rate" column. As you hover, you will see various icons appear. Select the one with the pause icon "II".