Google Ads A/B Tests: Stop Guessing, Start Converting

Key Takeaways

  • Google Optimize Legacy sunsetted in 2024, so this tutorial focuses on the new Google Ads Experiments feature for landing page A/B testing.
  • You can run A/B tests on landing pages by creating variations within Google Ads Experiments, targeting specific audiences, and tracking conversion rates.
  • Properly setting up conversion tracking and defining your primary success metric (e.g., form submissions) is essential for accurate experiment analysis.
  • Always run experiments for a statistically significant duration (typically 2-4 weeks) to avoid drawing premature conclusions.
  • After the experiment, analyze the results in Google Ads, implement the winning variation, and document the findings for future marketing strategies.

Experimentation is the lifeblood of effective marketing. Are you still relying on gut feelings instead of data-driven decisions? It’s time to start running A/B tests on your landing pages and unlock hidden conversion opportunities.

This tutorial will walk you through conducting landing page A/B tests using Google Ads Experiments. Forget about outdated tools like Google Optimize Legacy. We’re focusing on the current (and future) of data-driven marketing.

Step 1: Setting Up Conversion Tracking

Without accurate conversion tracking, your experiments are useless. You need to know what actions you want users to take and how to measure them.

1.1: Defining Your Conversion Action

First, you need to define the conversion action you want to track. In Google Ads Manager, navigate to Tools & Settings > Measurement > Conversions.

1.2: Creating a New Conversion Action

Click the blue “New Conversion Action” button. You’ll see several options: Website, App, Phone Calls, and Import. Select “Website” if you want to track on-site actions like form submissions, button clicks, or page views.

1.3: Configuring the Conversion Action

Enter your website domain and let Google scan it. Then, choose how you want to set up the conversion tracking:

  • Page Load: Track when a specific page loads (e.g., a “Thank You” page after a form submission).
  • Click: Track clicks on a specific button or link (e.g., a “Submit” button).
  • New Tag Manually: Install a Google Ads tag manually using Google Tag Manager (recommended for advanced users).

For a form submission, I recommend tracking the “Thank You” page load. Enter the URL of your “Thank You” page in the “Page URL” field. Give your conversion action a descriptive name, like “Contact Form Submission – Landing Page A.” Set the “Value” to “Don’t use a value for this conversion action” unless you’re tracking monetary value. Adjust the “Count” setting to “One” if you only want to count one conversion per user, even if they submit the form multiple times.

1.4: Implementing the Conversion Tag

Once you’ve configured your conversion action, Google Ads will provide you with a conversion tag. You’ll need to add this tag to your website. The easiest way is to use Google Tag Manager. Create a new tag in Google Tag Manager, select “Google Ads Conversion Tracking” as the tag type, and paste in the conversion ID and conversion label from Google Ads. Set the trigger to fire on the “Thank You” page.

Pro Tip: Use the Google Tag Assistant Chrome extension to verify that your conversion tag is firing correctly.

Common Mistake: Forgetting to implement the conversion tag correctly. Double-check that the tag is firing on the correct page and that the conversion data is being sent to Google Ads.

Expected Outcome: You should see conversion data appearing in your Google Ads account within 24-48 hours.

Step 2: Setting Up Your Google Ads Experiment

Now that you have conversion tracking in place, you can create your experiment.

2.1: Navigating to the Experiments Section

In Google Ads Manager, click on Campaigns in the left-hand navigation. Then, select the campaign you want to run the experiment on. Click on the Experiments tab at the top of the page. If you don’t see the “Experiments” tab, you may need to enable it in the “More” menu.

2.2: Creating a New Experiment

Click the blue “+” button to create a new experiment. Choose “A/B test of landing pages” as the experiment type. This is crucial; other experiment types won’t allow you to test different landing page experiences.

2.3: Naming and Describing Your Experiment

Give your experiment a clear and descriptive name, such as “Landing Page A/B Test – Headline Variation.” Add a brief description of what you’re testing (e.g., “Testing a new headline on the landing page”).

2.4: Defining the Control and Variation Pages

This is where the magic happens. Enter the URL of your original landing page in the “Control page URL” field. This is the page you’re currently using. Now, enter the URL of your variation landing page in the “Variation page URL” field. This is the page with the changes you want to test. You’ll need to have already created this variation page on your website.

In 2025, I had a client in Buckhead, Atlanta, who was running a campaign targeting lawyers. They had a decent conversion rate, but we suspected the headline on their landing page wasn’t resonating. We created a variation with a headline that focused on the specific pain points of lawyers, and the results were astounding. We saw a 32% increase in form submissions after running the A/B test for three weeks.

2.5: Setting the Experiment Split

Choose how you want to split traffic between the control and variation pages. I generally recommend a 50/50 split to ensure equal exposure for both pages. This setting is under “Traffic Split Percentage” and should default to 50%.

2.6: Defining the Experiment Goal

Select the conversion action you created in Step 1 as your primary goal. This tells Google Ads which metric to use to evaluate the success of the experiment. Click “Add Goal” and select the conversion action from the dropdown menu.

Pro Tip: Use UTM parameters to track the source of traffic to your landing pages. This will help you differentiate traffic from your Google Ads experiment from other sources.

Common Mistake: Not properly defining the experiment goal. Make sure you select the correct conversion action to ensure accurate results.

Expected Outcome: You should see the experiment set up and ready to run in your Google Ads account.

Step 3: Running and Monitoring Your Experiment

Once your experiment is set up, you need to start it and monitor its progress.

3.1: Starting the Experiment

Click the “Start” button to begin running the experiment. Google Ads will now start splitting traffic between the control and variation pages. It’s that simple.

3.2: Monitoring Performance

Regularly check the “Experiments” tab in Google Ads to monitor the performance of your control and variation pages. Pay attention to the following metrics:

  • Conversions: The number of conversions generated by each page.
  • Conversion Rate: The percentage of visitors who convert on each page.
  • Cost per Conversion: The average cost of acquiring a conversion on each page.
  • Statistical Significance: This is the most important metric. It tells you how confident you can be that the difference in performance between the control and variation pages is not due to chance.

3.3: Determining the Experiment Duration

How long should you run your experiment? A [Nielsen Norman Group article](https://www.nngroup.com/articles/how-long-run-ux-experiment/) suggests calculating the needed sample size and length based on your baseline conversion rate. In general, I recommend running experiments for at least two weeks, and ideally four weeks, to account for variations in traffic patterns. You need to achieve statistical significance before drawing any conclusions.

Pro Tip: Use a statistical significance calculator (many are available online) to determine when your results are statistically significant.

Common Mistake: Stopping the experiment too early. Don’t make decisions based on incomplete data. Wait until you have achieved statistical significance.

Expected Outcome: You should see data accumulating in your Google Ads account, allowing you to compare the performance of your control and variation pages.

Step 4: Analyzing the Results and Implementing the Winning Variation

After the experiment has run for a sufficient duration and you have achieved statistical significance, it’s time to analyze the results and implement the winning variation.

4.1: Identifying the Winning Variation

In the “Experiments” tab in Google Ads, look for the variation page that has the highest conversion rate and is statistically significant. Google Ads will typically highlight the winning variation.

4.2: Implementing the Winning Variation

Once you’ve identified the winning variation, you need to make it the default landing page for your campaign. This may involve updating your website code or using a landing page builder to replace the original page with the winning variation.

4.3: Documenting Your Findings

Don’t just implement the winning variation and move on. Take the time to document your findings. Record the results of the experiment, including the conversion rates, cost per conversion, and statistical significance. Note any insights you gained from the experiment. This documentation will be valuable for future marketing efforts.

We ran into this exact issue at my previous firm. We A/B tested two different call-to-action buttons on a landing page for a local HVAC company. One button said “Get a Free Quote,” and the other said “Schedule a Consultation.” The “Schedule a Consultation” button outperformed the “Get a Free Quote” button by 18%. We documented this finding and used it to inform our call-to-action strategy for other HVAC clients.

Pro Tip: Share your experiment results with your team. This will help everyone learn from your experiments and improve their marketing skills.

Common Mistake: Not documenting your findings. You’ll forget the details of the experiment if you don’t write them down.

Expected Outcome: You should see an improvement in your conversion rate after implementing the winning variation.

Step 5: Iterating and Testing Again

Experimentation is an ongoing process. Don’t stop after just one experiment. Use the insights you gained from your previous experiments to inform your next experiments. Continuously test new variations and iterate on your landing pages to improve your conversion rates. After you implement the winning variation, consider diving deeper with funnel optimization tactics.

Here’s what nobody tells you: even the “winning” variation isn’t perfect. There’s always room for improvement. Keep testing and keep learning.

How much does Google Ads Experiments cost?

Google Ads Experiments is included as part of your Google Ads account, so there’s no additional cost to use it. You only pay for the ads that are running as part of your campaign.

What happens if neither variation is statistically significant?

If neither variation is statistically significant, it means that there’s no clear winner. In this case, you can either run the experiment for a longer duration or try testing a different variation.

Can I test multiple variations at once?

While technically possible by creating multiple overlapping experiments, it’s generally best to test one variation at a time to isolate the impact of each change. Testing too many variables simultaneously can make it difficult to determine which changes are driving the results.

What are some other things I can A/B test on my landing pages?

Besides headlines, you can A/B test other elements on your landing pages, such as images, call-to-action buttons, form fields, and overall layout.

Where can I find more information about Google Ads Experiments?

You can find more information about Google Ads Experiments in the Google Ads Help Center. Search for “About campaign experiments” to find detailed documentation and tutorials.

Stop guessing and start testing! By following this tutorial, you can use Google Ads Experiments to optimize your landing pages and drive more conversions. Don’t let assumptions hold you back — use data to guide your marketing decisions and watch your results soar. By ditching assumptions, you can ensure that your Atlanta marketing isn’t burning cash.

Vivian Thornton

Marketing Strategist Certified Marketing Management Professional (CMMP)

Vivian Thornton is a seasoned Marketing Strategist with over a decade of experience driving impactful campaigns and building brand loyalty. She currently leads the strategic marketing initiatives at InnovaGlobal Solutions, focusing on data-driven solutions for customer engagement. Prior to InnovaGlobal, Vivian honed her expertise at Stellaris Marketing Group, where she spearheaded numerous successful product launches. Her deep understanding of consumer behavior and market trends has consistently delivered exceptional results. Notably, Vivian increased brand awareness by 40% within a single quarter for a major product line at Stellaris Marketing Group.