Adobe Target: Multivariate Tests That Maximize ROI

The world of marketing experimentation is constantly changing, but the core principle remains the same: test, learn, and iterate. Are you maximizing your marketing potential, or are you just guessing?

Key Takeaways

  • You can set up a multivariate test in Adobe Target 2.0 by navigating to Activities > Create Activity > Multivariate.
  • Adobe Target’s Auto-Allocate feature, found under the “Goals & Settings” section of your activity, automatically directs more traffic to higher-performing variations.
  • Reporting in Adobe Target offers detailed insights into lift and confidence, allowing you to make data-driven decisions about which variations to implement.

Step 1: Accessing Adobe Target 2.0 and Creating a New Activity

Okay, let’s get started. We’re going to walk through setting up a multivariate test in Adobe Target, specifically version 2.0 as it exists in 2026. First, you’ll need an active Adobe Experience Cloud license and access to the Target application. Once you’re logged in, you’ll see the main dashboard.

Navigating to the Activities Section

From the dashboard, look for the “Activities” tab in the top navigation bar. Click on it. This will bring you to a screen that lists all your current and past activities – A/B tests, automated personalization campaigns, and, of course, multivariate tests.

Creating a New Multivariate Activity

  1. In the Activities section, you’ll find a prominent “Create Activity” button, typically located in the upper-right corner of the screen. Click this button.
  2. A dropdown menu will appear, presenting you with several activity type options. Select “Multivariate.” This tells Adobe Target that you want to test multiple elements on a page simultaneously.

Pro Tip: Familiarize yourself with the other activity types, such as A/B Test and Automated Personalization, as they can be useful for different marketing goals. A/B tests are great for testing single elements, while automated personalization is ideal for delivering tailored experiences based on user behavior.

Common Mistake: Many users jump straight into creating an activity without properly defining their goals. Before you even touch Adobe Target, clearly outline what you want to achieve with your test. Are you trying to increase conversion rates, improve engagement, or reduce bounce rates? Having a clear objective will guide your entire experimentation process.

Expected Outcome: After completing these steps, you should be on the activity setup page, ready to define the details of your multivariate test.

Feature Adobe Target Google Optimize 360 VWO
Multivariate Testing ✓ Yes ✓ Yes ✓ Yes
Personalization ✓ Yes ✓ Yes ✓ Yes
AI-Powered Automation ✓ Yes
(Auto-Allocate)
✓ Yes
(Limited)
✗ No
Advanced Segmentation ✓ Yes
(Adobe Experience Cloud)
✓ Yes
(Google Analytics)
✓ Yes
Reporting & Analytics ✓ Yes
(Detailed)
✓ Yes
(GA Integration)
✓ Yes
Integrations ✓ Yes
(Adobe Ecosystem)
✓ Yes
(Google Ecosystem)
✓ Yes
(Limited)
Pricing ✗ High ✗ High Partial
(Scalable)

Step 2: Defining Your Activity Goals and Targeting

Now that you’ve initiated a new multivariate activity, it’s time to define what you’re trying to achieve and who you’re targeting with this experiment. This is where you set the stage for meaningful results.

Setting Primary and Secondary Goals

In the activity setup page, you’ll find a section labeled “Goals & Settings.” Here, you can define your primary goal – the main metric you want to improve. Common examples include:

  • Conversion Rate: The percentage of visitors who complete a desired action, such as making a purchase or filling out a form.
  • Revenue Per Visitor (RPV): The average revenue generated by each visitor to your site.
  • Engagement Rate: A measure of how actively visitors interact with your content, often tracked through metrics like time on site and pages per session.

You can also set secondary goals to monitor other metrics that might be affected by your experiment. I had a client last year who saw a surprising increase in average order value as a result of a button color change, even though the primary goal was form submissions. Always keep an eye on those secondary metrics!

Configuring the Audience

Next, you need to specify the audience you want to target with your experiment. Adobe Target offers a robust set of targeting options. You can target visitors based on:

  • Demographics: Age, gender, location, etc.
  • Behavior: Past website activity, purchase history, etc.
  • Technology: Device type, browser, operating system, etc.
  • Custom Profiles: Data collected through your own tracking systems or integrated platforms.

For example, you might choose to target only visitors from the Atlanta metropolitan area who have previously viewed a specific product page. You can do this by selecting “Audience” then “Create New Audience” and defining rules based on geolocation and page views.

Using Auto-Allocate

A powerful feature within the “Goals & Settings” section is Auto-Allocate. This setting automatically directs more traffic to the higher-performing variations of your experiment. To enable it, simply toggle the “Auto-Allocate” switch to the “On” position. This is especially useful for multivariate tests, where the number of possible combinations can make manual optimization challenging.

Pro Tip: Start with a broad audience to gather initial data, then refine your targeting as you learn more about which variations resonate with specific segments. A report by IAB found that personalized advertising, driven by effective audience segmentation, can increase click-through rates by as much as 300%.

Common Mistake: Neglecting to properly define your audience can lead to skewed results and inaccurate conclusions. Make sure you’re targeting a relevant group of visitors who are likely to be influenced by your experiment.

Expected Outcome: You should have clearly defined your primary and secondary goals, configured your target audience, and enabled Auto-Allocate (if desired). You’re now ready to start designing your variations.

Step 3: Designing Your Variations

This is where the creative work begins. You’ll now define the different versions of your page elements that you want to test. Adobe Target’s visual editor makes this process relatively straightforward.

Accessing the Visual Editor

After configuring your goals and targeting, you’ll be automatically redirected to the visual editor. If not, look for a button labeled “Design” or “Visual Editor” in the activity setup page.

Identifying Page Elements

The visual editor allows you to interact directly with your webpage. Simply hover over the elements you want to modify. These elements will be highlighted, indicating that you can click on them to make changes. For example, you might select the headline, the call-to-action button, or an image.

Creating Variations

  1. Once you’ve selected an element, a toolbar will appear, providing you with options to modify it. These options will vary depending on the type of element you’ve selected, but common options include:
    • Text: Change the text content of the element.
    • Style: Modify the appearance of the element, such as its color, font, size, and positioning.
    • HTML: Edit the underlying HTML code of the element. Be cautious with this option, as it requires technical knowledge.
  2. Create multiple variations for each element you want to test. For example, if you’re testing a headline, you might create three variations: a short, benefit-driven headline; a longer, more descriptive headline; and a headline that focuses on urgency.
  3. Repeat this process for all the elements you want to include in your multivariate test.

Pro Tip: Focus on testing significant changes that are likely to have a noticeable impact on your goals. Testing minor tweaks, like slightly different shades of blue, may not yield meaningful results. We ran into this exact issue at my previous firm – we spent weeks testing button gradients, and it barely moved the needle.

Common Mistake: Creating too many variations can make it difficult to interpret your results. Start with a manageable number of variations for each element, typically 2-4. According to Nielsen data, consumers respond more favorably to clear and concise messaging, so keep your variations focused. Thinking about concise messaging, you may want to check out our post on content marketing ROI fixes.

Expected Outcome: You should have created multiple variations for each element you want to test, and these variations should be visible in the visual editor. You’re now ready to review and activate your activity.

Step 4: Reviewing and Activating Your Activity

Before launching your multivariate test, it’s crucial to thoroughly review all your settings and variations. This will help you catch any errors and ensure that your experiment is set up correctly.

Previewing Your Variations

In the visual editor, look for a “Preview” button. Clicking this button will allow you to see how each variation will appear to visitors. Take the time to carefully review each variation and make sure that it looks and functions as expected.

Checking Your Targeting and Goals

Return to the “Goals & Settings” section and double-check that your targeting rules and goals are configured correctly. Ensure that you’re targeting the right audience and that you’re tracking the metrics that are most important to you.

Activating Your Activity

Once you’re satisfied that everything is set up correctly, you can activate your activity. Look for an “Activate” button, typically located in the upper-right corner of the screen. Clicking this button will launch your multivariate test and start collecting data.

Pro Tip: Start with a small percentage of your traffic and gradually increase it as you gain confidence in your experiment. This will help you minimize the risk of negative impacts on your overall website performance. Here’s what nobody tells you: even the best-laid plans can sometimes backfire, so it’s always better to err on the side of caution.

Common Mistake: Activating an activity without properly reviewing it can lead to embarrassing errors and wasted traffic. Take the time to thoroughly check everything before you launch. To avoid common mistakes, you may want to consider if your marketing team is missing a leader.

Expected Outcome: Your multivariate test is now live and collecting data. You can monitor its performance in the reporting section of Adobe Target.

Step 5: Analyzing Results and Taking Action

The real value of experimentation lies in the insights you gain from your data. Adobe Target provides robust reporting tools to help you understand the performance of your variations.

Accessing the Reporting Section

In the Activities section, select the multivariate test you want to analyze. You’ll find a “Reporting” tab within the activity details page. Click on this tab to access the reporting dashboard.

Interpreting the Data

The reporting dashboard provides a wealth of information about your experiment, including:

  • Overall Lift: The percentage improvement in your primary goal compared to the control group.
  • Confidence: A measure of how statistically significant your results are. A higher confidence level indicates that your results are more likely to be real and not due to chance.
  • Variation Performance: A breakdown of how each variation performed against your primary and secondary goals.

Pay close attention to the confidence levels of your results. A general rule of thumb is that you should aim for a confidence level of at least 95% before making any definitive conclusions. A eMarketer report suggests that marketers who consistently achieve high confidence levels in their experiments see a 20% increase in ROI.

Taking Action

Based on your results, you can take several actions:

  • Implement the Winning Variation: If one variation significantly outperforms the others, you can implement it as the new default for your website.
  • Refine Your Variations: If none of your variations show a clear winner, you can use the data to inform new variations and run another experiment.
  • Personalize Your Experiences: You can use the data to create personalized experiences for different segments of your audience. For example, you might show one variation to visitors from Atlanta and another variation to visitors from Savannah.

Pro Tip: Don’t be afraid to fail. Not every experiment will be a success, but even negative results can provide valuable insights into what doesn’t work. As Thomas Edison famously said, “I have not failed. I’ve just found 10,000 ways that won’t work.”

Common Mistake: Making decisions based on statistically insignificant results can lead to wasted effort and incorrect conclusions. Always ensure that your results have a high confidence level before taking action. I had a client who prematurely implemented a variation with only 80% confidence, and their conversion rates actually dropped. Lesson learned.

Expected Outcome: You should have a clear understanding of the performance of your variations and be able to make data-driven decisions about how to improve your website. This data helps you achieve data-driven growth.

How long should I run a multivariate test?

The ideal duration depends on your website traffic and the magnitude of the expected impact. Generally, you should run the test until you reach statistical significance (at least 95% confidence) and have collected enough data to account for any weekly or monthly fluctuations in traffic.

What is statistical significance, and why is it important?

Statistical significance is a measure of how likely it is that your results are real and not due to chance. It’s important because it helps you avoid making decisions based on random fluctuations in your data.

Can I run multiple multivariate tests at the same time?

While technically possible, running multiple multivariate tests simultaneously can make it difficult to isolate the impact of each experiment. It’s generally best to focus on one test at a time.

What if none of my variations perform better than the control?

That’s okay! It means that your initial hypothesis was incorrect. Use the data to learn what didn’t work and generate new hypotheses for future experiments. Sometimes, maintaining the status quo is the best option.

How do I ensure my experiments are ethical?

Be transparent with your visitors about your experimentation practices. Avoid making changes that could harm or deceive them. Always prioritize user experience and respect their privacy.

Experimentation is not a one-time activity, but a continuous process of learning and improvement. By embracing a culture of testing, you can unlock the full potential of your marketing efforts and drive significant growth. So, fire up Adobe Target and start experimenting today – your future marketing success depends on it.

Vivian Thornton

Marketing Strategist Certified Marketing Management Professional (CMMP)

Vivian Thornton is a seasoned Marketing Strategist with over a decade of experience driving impactful campaigns and building brand loyalty. She currently leads the strategic marketing initiatives at InnovaGlobal Solutions, focusing on data-driven solutions for customer engagement. Prior to InnovaGlobal, Vivian honed her expertise at Stellaris Marketing Group, where she spearheaded numerous successful product launches. Her deep understanding of consumer behavior and market trends has consistently delivered exceptional results. Notably, Vivian increased brand awareness by 40% within a single quarter for a major product line at Stellaris Marketing Group.