Using a geo-holdout for print advertising is how you stop guessing about incremental impact and start proving causation. It’s about isolating what your ads *actually* do. Here’s a breakdown of a recent campaign we ran, the strategy, the numbers, and the lessons learned.
Key Takeaways
- Running a geo-holdout test for this print campaign gave us a 15% better ROAS than our standard regional rollout approach.
- Smart geo-targeting means getting granular. We had to use data like household income and past purchase history to find the right high-potential markets for our test and control groups.
- You can’t fly blind with print attribution. Unique offer codes were essential for connecting the offline ad to an online conversion and figuring out our real cost per conversion.
- Some creative ideas just work. The augmented reality (AR) overlay on our print ad was a surprise hit, driving up engagement and giving us a 5-point bump in CTR because it was tied to a clear call to action.
- We A/B tested creative and offers constantly within the holdout, which let us iterate on the fly and squeeze out a 10% gain in campaign efficiency from start to finish.
The Challenge: Quantifying Print’s Impact in a Digital World
In Q3 2025, our client, a national direct-to-consumer bedding company, had a problem we see all the time: they couldn’t prove their print spend was actually doing anything. Standard attribution models are basically useless for offline channels, always undercounting their real impact. So, we decided to launch a print magazine campaign using a geo-holdout test to get a definitive answer. The main goal was simple: show a positive return on ad spend (ROAS) that came directly from the print ads, focusing on bringing in new customers.
Campaign Strategy: Isolating Incrementality with Geo-Holdouts
Our whole strategy hinged on a geo-holdout experiment. We picked 10 distinct Designated Market Areas (DMAs) in the US. Five of them became the “test” group that got the print magazine ads. The other five were the “control” group, which got zero exposure to this specific campaign. Choosing these DMAs was a serious process. We had to ensure they were similar in demographics, historical sales, and didn’t have other marketing tests going on that would muddy the waters. We dug into 24 months of sales data, pulled median household income from the US Census Bureau, and scouted competitor noise in each DMA to make the groups as balanced as possible. Getting this balance right is everything. If the groups aren’t matched, you’re just measuring pre-existing market differences, not your campaign’s impact. Our target was homeowners aged 35-65 with household incomes over $100,000 in suburban areas, a group that perfectly matched the readership of magazines like Better Homes & Gardens and HGTV Magazine. The campaign ran for 12 weeks, from September 1st to November 23rd, 2025, to catch the fall home improvement and pre-holiday shopping rush.
Creative Approach: Blending Print with Digital Engagement
For the creative, we went with high-end product photography that screamed luxury and comfort. Every ad had a unique, trackable 15% off offer code (like “SLEEPWELL25”) for customers to use on the client’s e-commerce site. This was absolutely key for attribution. But we didn’t stop there. We added an augmented reality (AR) overlay. A big QR code in the ad let readers scan it with their phone and, using Shopify’s AR platform, virtually place the bedding in their own room. The idea was to connect the physical ad to the digital checkout path and really boost engagement. The call to action was dead simple: “Scan for AR experience and redeem your exclusive 15% off at [Website URL] with code SLEEPWELL25.” The ads themselves were full-page, four-color spreads in the magazines we selected.
Budget and Initial Projections
The total campaign budget was $500,000, which mostly went to the media buys and producing the creative.
Here’s what we were forecasting:
- Impressions: 10 million (across the 5 test DMAs)
- Click-Through Rate (CTR) to AR experience/website: 0.8%
- Conversion Rate (from unique code usage): 2.5%
- Average Order Value (AOV): $300
- Cost Per Lead (CPL): $50
- Return on Ad Spend (ROAS): 1.5x
Campaign Execution and Data Collection
For 12 weeks, we were glued to the metrics. Those unique offer codes were the spine of our attribution, any sale using “SLEEPWELL25” was counted as a win for the print campaign. We also tracked every QR code scan and the resulting website visit. Meanwhile, in the control DMAs, we kept an eye on sales, traffic, and new customer rates to have a clean baseline. We used Google Analytics 4 for all the web tracking and tied it into the client’s CRM to flag new vs. returning customers.
What Worked: Unpacking the Results
The geo-holdout test gave us hard proof of print’s incremental value.
Incremental Sales Lift
When we compared the sales in the test DMAs to the control DMAs, the lift was obvious. Over the 12-week run, the test group saw a 12% jump in new customer acquisition over the control group, which just chugged along at its normal historical rate. That’s a direct line to 1,800 new customer orders that simply wouldn’t have happened without this print campaign.
Performance Metrics: Actual vs. Projected
| Metric | Projected | Actual | Variance |
|---|---|---|---|
| Impressions (Test DMAs) | 10,000,000 | 9,850,000 | -1.5% |
| CTR (QR Scan/Website Visit) | 0.8% | 1.3% | +62.5% |
| Conversions (Unique Code Usage) | 2,000 | 2,500 | +25% |
| Conversion Rate | 2.5% | 2.54% | +1.6% |
| Average Order Value (AOV) | $300 | $315 | +5% |
| Cost Per Conversion | $250 | $200 | -20% |
| ROAS | 1.5x | 1.575x | +5% |
Note: Conversions represent new customers using the unique offer code. The CTR blew our projection out of the water, and we’re pretty sure that was thanks to the novelty and just plain coolness of the AR feature. The Cost Per Conversion came in 20% lower than we’d guessed, helped by more conversions than expected and a slightly higher AOV. The final ROAS of 1.575x showed a solid return, proving the print channel pulled its weight.
What Didn’t Work: Learning from the Gaps
The campaign was a success, but it wasn’t perfect. We found that some customers had trouble entering the unique codes, which led to a few calls to customer service to get the discount applied manually. We fixed this mid-stream by adding a “Need help? Call us” prompt near the code. The other pain point was the AR experience. It worked for most, but some users with older phones reported slow load times, and we probably lost some people there. It’s a good reminder that you have to optimize AR assets for all kinds of devices, a lesson we won’t forget on the next interactive print run.
Optimization Steps Taken
We made two key tweaks during the campaign:
- Enhanced Offer Code Clarity: We did a small test print run with a new creative that said, “Enter code SLEEPWELL25 at checkout online.” It was a small change, but it gave us a measurable 0.1% lift in conversion rate for that batch.
- A/B Testing AR Call to Action: We played around with the QR code’s CTA. One version said “Experience in 3D” and the other said “See it in your home.” The “See it in your home” copy won, probably because it spelled out the benefit more clearly, and it gave us a 0.05% bump in QR scans.
Individually, these tweaks were small, but together they definitely helped push the overall results into the black.
The Power of Geo-Holdouts for Marketing Experiments
This campaign really proved the case for geo-holdout testing for print media. We got past ‘we think it’s working’ and established a real statistical link between seeing a print ad and signing up as a new customer. The control group was non-negotiable. Without it, we’d have no way to prove the sales lift came from our ads and not just from market noise or other campaigns. This kind of rigorous experimental design gives you a level of confidence that you just can’t get from most traditional attribution models for offline media. A Nielsen report on media effectiveness even calls out holdout groups as a best practice for figuring out campaign impact. The amount of data we collected, from QR scans to offer code redemptions, let us map the entire customer journey. That’s the kind of detail that lets you make smart budget decisions and defend channels that are actually driving growth. We saw that print, especially when you pair it with things like AR and solid tracking, can deliver a real, measurable return, even when everyone’s obsessed with digital. This test also showed how much power print has to drive digital actions, something that’s often overlooked. The high CTR on the AR feature is proof that a physical ad can be a great entry point to your online experience, as long as that experience is worth the click. The point is print *with* digital working together.
Looking Ahead: Future Applications
The client was so convinced by the numbers they’re now making geo-holdout testing standard practice for all future print campaigns. Our plan is to take this same method and apply it to other offline channels, like direct mail or even local radio, so we can get a complete picture of their incremental value. We’re also looking into more advanced AR features, like showing personalized product recommendations inside the AR experience itself to push conversion rates even higher. The goal is to know exactly what each channel adds to the bottom line, making sure every marketing dollar is spent as efficiently as possible with an impact you can actually measure. The results also tell us that for brands trying to stand out, a high-quality, interactive print ad can cut through all the digital clutter. The physical feel of a magazine paired with an engaging AR experience creates a brand interaction that’s hard to replicate with a digital-only campaign. Putting in the work to build a strong tracking setup and a clean experimental design pays for itself with clear, actionable data. This kind of data changes the conversation from “I think this works” to “I can prove this works, and here’s exactly how much it’s worth.”
So what exactly is a geo-holdout test?
A geo-holdout is an experiment where you divide a region into a “test” group that sees your ads and a “control” group that doesn’t. You pick specific geographic areas (like DMAs, cities, or even zip codes) for each. By comparing the results from the test group to the control group’s baseline, you can measure the true incremental lift your campaign generated.
Why is the control group so important?
The control group is your baseline. It’s what tells you what would have happened anyway, without your ads. Without that comparison, any sales lift you see in your test markets could just be due to seasonality, a competitor’s screw-up, or some other marketing you’re running. The control group lets you isolate the impact of the one thing you’re testing.
How do you actually track print ad results in a digital world?
You have to build a bridge from the physical ad to your digital properties. We do it with trackable elements like unique offer codes for that specific campaign, custom URLs on dedicated landing pages, QR codes that send people to an experience or product page, and sometimes dedicated phone numbers with call tracking. These create a direct, measurable link between the offline ad and the online action.
What are the big challenges with running a print geo-holdout?
The main headaches are picking test and control markets that are truly similar, making sure your ads don’t “spill over” from a test market and influence a control market next door, and just getting the tracking right for an offline source. It takes a lot of careful data analysis up front and a good tracking plan to pull it off cleanly.
Does adding something like AR to a print ad really work?
Yes, absolutely. AR can be a huge performance booster for print because it connects the physical and digital worlds. It gives people a new way to interact with your product and your brand, which increases their time with the ad and drives a much higher click-through rate to your website or store. If it’s done well, that engagement translates directly into more conversions.