Live Duration Insight (Time Till Done) Feature Guide

Track Experiment Progress in Real-Time with Live Duration Insight (Time Till Done)

In This Article You Will:

• Understand Live Duration Insight (Time Till Done)
• Explore Key Features of Live Duration Insight
• Use the Live Duration Insight Feature
• Navigate Plan-Based Access Control & Upgrade Lock

Overview

The Live Duration Insight feature (also referred as "Time Till Done") provides users with a real-time estimate of how long an experiment will take to reach statistical significance. This feature allows users to track test progress and project completion dates and gain deeper insights into their experiments.

This feature is available only for specific plans. Users on lower-tier plans will see the feature locked and an upgrade prompt.

Key Features

Progress Bar (Blurred for Restricted Users)

• A visual representation of the experiment's progress.

• For users with access, this shows the actual percentage progress.

• For users without access, the progress bar is blurred, with an upgrade lock message.

  
  

Projected Completion Date

• Estimates the end date based on the current visitor trends and test progress.

• Uses Frequentist and Bayesian statistical models for accurate predictions.

Primary Goal vs. All Goals Progress

• Users can toggle between seeing progress for the primary goal or all goals.

• The primary goal’s progress is used as the key metric in summary reports.

Upgrade Lock for Restricted Users

• Users without access will see the feature but won’t be able to use it.

• Instead of a numerical progress value, a lock icon and message prompt users to upgrade their plan.

• Hovering over the blurred progress bar will show a tooltip explaining the feature and providing a CTA to upgrade.
  

How the Completion Estimate Works

The estimated test completion date is calculated based on:

• Start Date of the experiment.
• Current Progress Percentage based on visitor traffic.
• Remaining Visitors Needed to reach statistical significance.

Formula Used

1. Determine Elapsed Time

   • Elapsed Time = Current Date - Start Date

2. Calculate Sample Rate

   • Sample Rate = (Total Sample Size * Estimated Progress) / Elapsed Time

3. Estimate Remaining Time

   • Remaining Time = Remaining Visitors / Sample Rate

4. Project Completion Date

   • Completion Date = Current Date + Remaining Time

JavaScript Implementation:

 function estimateCompletionDate(startDate, estimatedProgress, remainingSamples) {
  const MS_PER_DAY = 1000 * 60 * 60 * 24;
  const start = new Date(startDate);
  const now = new Date();

  // Days elapsed since start
  const elapsedDays = Math.floor((now - start) / MS_PER_DAY);

  // Convert percentage progress to decimal
  const progress = estimatedProgress > 1 ? estimatedProgress / 100 : estimatedProgress;

  // Calculate total sample size and sample rate
  const totalSamples = remainingSamples / (1 - progress);
  const sampleRate = (totalSamples * progress) / elapsedDays;

  // Estimate remaining days
  const daysTillDone = Math.ceil(remainingSamples / sampleRate);

  // Compute completion date
  const completionDate = new Date(now.getTime() + daysTillDone * MS_PER_DAY);
  return completionDate.toISOString().split('T')[0];
}

Plan-Based Access Control

How Feature Locking Works

• Users on eligible plans: Full access to Live Duration Insight.
• Users on restricted plans:

  • Blurred progress bar (instead of real-time progress).

  • Lock icon replaces the percentage.

  • CTA to upgrade displayed near the feature.

  • Tooltip on hover explaining the feature and upgrade benefits.

Why This Approach?

• Ensures users are aware of the feature even if they don’t have access.
• Encourages plan upgrades by showcasing what they’re missing.
• Provides consistency with other locked features in the Convert.com app.