How to run Multivariate tests?

Overview

Instead of testing just one change (like in A/B testing), a multivariate test evaluates multiple variables (e.g., banner text, layout, CTA, discount) across multiple variants.

With our Experiments feature, you can run multivariate tests to gain valuable insights into which setups perform best together.

This allows you to optimize your offers, improve conversions, and ultimately maximize overall revenue.

For example, you can test:

• Different banner texts
• Multiple layout configurations
• Various CTA button styles
• Different product selections or discounts

By analyzing how these elements interact, you can gain valuable insights into what drives higher user engagement and conversions.

How to set up a Multivariate Test?

1. Identify the elements you want to test

• Select which elements you want to test within your upsell offers, such as Banner Text, CTA, Layout, CTA Styles, Discount, and Products
• Ensure you have multiple variations for the element you want to test. (For example, if you are testing CTA, you might have three different texts like 'Buy Now', 'Add to Cart', and 'Upgrade Now')

2. Create Variants

• Create multiple variants (up to 5 including the control)
• Each variant can modify one or multiple variables, enabling you to test combinations.
• Choose which fields (variables) to modify for each variant

Example Setup

• Control (Original): Default banner, layout, CTA, no changes

• Variant B: Change Banner Text + CTA

• Variant C: Change Discount

• Variant D: Change Layout + CTA Style

3. Once everything is configured:

• Review your setup
• Launch the test

• Monitor performance metrics

Related Articles

• How to run an A/B test?
• What can I A/B test?

Updated on: 10/04/2026