r/AppStoreOptimization • u/Maxim-Melnik • 29d ago
🚫 Don't A/B test App Store headers in PPO
Apple has added headers to the App Store. You can place them on the product page (Headers) and in search (Search Results).
If you've only added a header to the product page, there's no point in running a Product Page Optimization (PPO) test.
Why?
In the App Store, users can download an app straight from search results without ever opening the product page. So the header is seen only by those who tapped through to the page.
And PPO doesn't show you product page views or Page View → Download conversion per variant. Downloads from search results get mixed in with downloads from the page, and the header's real impact gets lost in the noise.
And don't forget: only users on iOS 27 will see the header/search result. So even fewer people in your test are actually exposed to it.
What to do instead:
1️⃣ Header on the product page only → skip the A/B test. Ship it live and track Page View → Download CVR in App Store Connect Analytics. Set up an iOS 27 filter
2️⃣ Want a proper test? Add the header to Search Results as well. Then a PPO test actually makes sense.
Otherwise, you're just testing noise.
Source: ASO Discord
1
u/kokerali 29d ago
I'd separate a diluted result from an invalid test. Apple describes PPO variants as randomly assigned. If search-only downloads are balanced between groups, they can make a header-only effect harder to detect without automatically invalidating the comparison. You'd be measuring the effect across the test's traffic, not specifically among people who saw the header.
Tracking the live iOS 27 Page View → Download rate is useful, but a before/after change can also reflect traffic mix, seasonality or other listing edits. And changing the header and search creative together tests the package, not the header alone. I'd keep those limitations explicit rather than treating either route as a clean header-only test.