Experiment Result / Reporting Discrepancies between Convert and other Systems

Discrepancies are Common

There is no need to be alarmed if you see discrepancies between Convert reporting and other systems. It is a common scenario - a customer starts to gather data from their first Convert experiment and compares it with other data gathered in other systems such as analytic or e- commerce engines. 

At the beginning the discrepancies may seem huge and completely out of sync, but getting to know what the common pitfalls are will help you understand why.  Discrepancies are usually not caused by your system configuration, but may be understood by knowing the differences likely to be encountered when comparing metrics in other systems.

Please read the following to learn what these common pitfalls are.

Tip

Comparing Apples to Apples

It is very common when trying to understand these discrepancies to find that you may not be comparing the same metrics and that the discrepancies are a result of comparing completely different metrics.

Visitors in Convert vs. Other Systems

Visitors in Convert are unique visitors that go through an experiment. They are only counted once while the convert cookie exists in the visitor browser (the cookie duration is for 6 months from the last visit). So in practical terms, we will count each visitor only once per Experiment.

Other systems often count a visitor again each time they visit a site in a new session. This is common in Google Analytics and may be the same in other engines. 

Conversions

By default, Convert will only record the first conversion of a unique visitor. Other engines usually count conversions each time the same visitor triggers it. This is a common source of confusion when comparing purchases in Convert vs purchases on other platforms.

Latency in Data Reporting 

Other systems might have up to a 48-hour latency before visitor activity appears in their reports. Visitors and conversions are incremented in near real-time on Convert reports.

Different Time Zones

In addition to being careful to select the same custom date range when comparing, mis-matched time zones can also show a huge difference in the data that you see in other platforms versus Convert Experiences. While your other platform might use a time zone that was configured by you, Convert Experiences currently displays report data using UTC.

Split Tests  

Sometimes you may see reporting discrepancies because of Split Test redirects.  Please see this article for more information: https://convert.zendesk.com/hc/en-us/articles/205160405-How-Do-I-Prevent-My-Analytics-Tool-Recording-a-Hit-on-Original-When-a-Split-URL-Variation-is-shown

 

Have more questions? Submit a request

Comments