Experimentation

Optimize Goals in Real Time With Dynamic Testing Software

Maximize ROI and minimize CX risk with automated tests.

Dynamic Testing ab testing monetate
multi-armed bandit testing monetate

Dynamic Testing Lets You Learn at the Speed of Business

Unlike with A/B testing, you don’t have to wait to reach significance with Dynamic Tests. Optimize toward your given goal automatically with Monetate Personalization, whether that’s increasing conversion, reducing bounce, or any other custom metric.

With dynamic testing, you eliminate resource-intensive manual monitoring from your team and let Monetate do the work.

Why Dynamic Testing v. A/B Testing?

Dynamic testing for eCommerce is best deployed when your goal is to find a clear winner. Based on your results, the Monetate Personalization platform then shows all of your traffic the winning variant to maximize performance.

Based on your results, Monetate Personalization then shows all of your traffic the winning variant to maximize performance. This is the ideal scenario if you want to drive maximum ROI and test content within a small window of time.

Performance

  • Dynamic Testing is good for one-to-many personalization over a short time period
  • Can be used for optimization and personalization
  • Drives maximum ROI
  • Ideal when you aren’t sure what your audience wants to see (e.g. homepage masthead creative, or a change in the checkout)

Learning

  • Dynamic Tests can run instead of an A/B test when there is a smaller volume of traffic to a page
  • Small volumes will take a long time to or may never reach significance in an A/B test
  • All performance metrics are available to view but are not as robust statistically as in an A/B test
  • Model updates every 5 minutes for real-time dynamic adjustment

Should I Run a Dynamic Test or an A/B Test?

Not sure which type of test is best? This chart will help you decide between running a standard A/B test vs. a dynamic test.

 

 
Standard A/B Test Dynamic Test
  • Makes one decision
  • One-to-Many Decisions
  • Static: Assumes Nothing Changes
  • Adaptive: Reacts to Changes in Behavior
  • Thoughtful Experiment Design & Tactics: Sample Size Calculator, Goals, & Conditions
  • Just Tactics: Goals & Conditions
  • Significance: “Measure of Surprise.”
  • Probability: “Chance the leader is actually the best and driving ROI, given everything we know.”
  • Reach Significance, Stop, Promote
  • Continuous Testing and Learning Drives More ROI
  • Manual Monitoring
  • Fully-Automated
  • High Resolution of Performance on all Variations
  • Focused on Exploiting the Leader
  • Measured Understanding of all Metrics
  • Observation of Metrics Beyond Goal of the Leader

Adaptive Learning. Hone Your CX With Dynamic Testing

Our technology is at the cutting edge of personalization. It delivers quick and painless results. See how dynamic testing software is part of the total Monetate platform.

Man with tattoo crossing arms