A/B Test on Ecommerce
When you want to test buttons within you ecommerce site and use Convert Experiments, here is a little trick to test buttons on all product pages at once. To test on all product pages at the same time we need to find a part of the URL that is always there in a shop.
Use a Convert Multivariate experiment and follow the guide below.
For Shopify this is for example /products/ by looking at examples http://shop.oneandonlyheadboards.com/products/island-sun and http://www.clothmoth.com/products/love-will-find-a-way-t-shirt
On osCommerce you have the following URL structure http://store.mandriva.com/product_info.php?cPath=149&products_id=495 it seems to contain product_info.php so with that we have a unique identifier for product pages.
For Magento it is a bit complicated since there is a very free URL structure that is very SEO oriented and has no reference to a product. For example http://www.magento-mall.com/sony-vaio-vgn-txn27n-b-11-1-notebook-pc.html has no unique identifiers in the URL to tell this is a product page. But I am positive we will will be able to target these product pages. I suggest we look the HTML of the button you can target:
By seeing this, I doubt if we find any more of these kinds of buttons on the site and if we do, we target them all. In step 1 of the Test Wizard we select the button and the jQuery selector is
FORM#product_addtocart_form DIV.product-shop DIV.add-to-holder FIELDSET.add-to-cart-box BUTTON.form-button
so that seems pretty unique but after looking at more pages it seems that the unique part is
Step 1: Where to test
We select in all cases the URL mentioned above and select the button. As a variation we change the text to Buy Now (in the editor you need to select HTML to change the text of the button).
<button class="form-button">Add to Cart </button>
<button class="form-button">Buy Now </button>
Save the variation and the original and go to next step where you can preview.
Step 2: Who will see it
Select automatically the URL's here that you used on the browser of step 1. But if you want the button to change everywhere you have to change the part where it says: Page URL -> Starts with to Page URL -> Contains. Then in the field behind it for osCommerce users, you fill product_info.php, that way it will apply the button change to any URL that contains product_info.php.
Shopify users fill out /product/ in that field and Magento users nothing, they can just remove everything. But if you have the shop installed in a subdomain or special folder, for example shop.mydomain.com or www.mydomain.com/shop/ it is worth filling out that in URL, we have to see the word shop that makes it easier to find the right button and give less risk to replace the wrong button.
From there you continue and finish the wizard, add a goal (usually a thank you page after payment) but you can create different or multiple goals if you like. Save the test and it will start on the given date and you will see the results shortly.