Reporting Discrepancies
      Back to home
      1. Help Center
      2. Analyze Results
      3. Reporting Discrepancies

      Experiment Result / Reporting Discrepancies between Convert and other Systems

      THIS ARTICLE WILL HELP YOU:


      Discrepancies are Common

      There is no need to be alarmed if you see discrepancies between Convert reporting and other systems. It is a common scenario. A customer gathers data from their first Convert experiment and compares it with other data gathered in other systems such as analytic or e-commerce engines. 

      In the beginning, the discrepancies may seem huge and completely out of sync, but getting to know what the common pitfalls are will help you understand why. Discrepancies are usually not caused by your system configuration. These differences can be understood by getting to know its causes.

      Please read the following to learn what these common pitfalls are.

      Google Analytics

      There is a Google Analytics document related to this same subject in the following article.

       

      Comparing Apples to Apples

      It is very common when trying to understand these discrepancies to find that you may not be comparing the same metrics and that the discrepancies are a result of comparing completely different metrics.

      Visitors in Convert vs. Other Systems

      Visitors in Convert are unique visitors that go through an experiment. They are only counted once while the convert cookie exists in the visitor browser (the cookie duration is for 6 months from the last visit). So in practical terms, we will count each visitor only once per Experiment.

      Other systems often count a visitor again each time they visit a site in a new session. This is common in Google Analytics and maybe the same in other engines. 

      Conversions

      By default, Convert will only record the first conversion of a unique visitor. Other engines usually count conversions each time the same visitor triggers it. This is a common source of confusion when comparing purchases in Convert vs purchases on other platforms.

      Latency in Data Reporting 

      Other systems might have up to a 48-hour latency before visitor activity appears in their reports. Visitors and conversions are incremented in near real-time on Convert reports.

      Different Time Zones

      In addition to being careful to select the same custom date range when comparing, mismatched time zones can also show a huge difference in the data that you see in other platforms versus Convert Experiences. While your other platform might use a time zone that was configured by you, Convert Experiences currently displays report data using UTC.

      GA event time record

      GA does not record the time of the event when it happened, but at the time it was processed by their server. This might lead to differences on the day a visitor conversion is attributed. So it is recommended to compare for groups of days, rather than data of one day. This averages out these differences.

      Classification of Devices

      No standard exists for classifying devices.. This might lead to differences in tests that are targeted to specific devices, or when segmenting the data per device. Some platforms will classify some devices as tablet instead of mobile and this can lead on differences when comparing data between them.


      Split Tests  

      Sometimes you may see reporting discrepancies because of Split Test redirects.  Please see this article for more information: https://convert.zendesk.com/hc/en-us/articles/205160405-How-Do-I-Prevent-My-Analytics-Tool-Recording-a-Hit-on-Original-When-a-Split-URL-Variation-is-shown