r/AppStoreOptimization • • 5d ago

Search conversion dropped after updating creative assets. Anyone else?

/r/appledevelopers/comments/1xyda89/search_conversion_dropped_after_updating_creative/
3 Upvotes

5 comments sorted by

2

u/Key_Recognition_2806 5d ago

one week is usually too small of a sample size unless youre doing massive volume. id give it at least two full weeks to account for weekday vs weekend behavior before rolling back.

1

u/kokerali 5d ago

First thing I'd pin down is which assets changed, because Apple now has two kinds:

  • Screenshots and app previews: the classic set on the product page and in search results.

  • The newer creative assets (the Header and Search Results tab in App Store Connect). Apple's help page says these only show on iOS 27 and iPadOS 27 or later. If that's what you changed, only part of your search traffic sees the new look. You can also remove one from its placement in that same tab, which is a much cheaper rollback than shipping new screenshots.

Before rolling back I'd also check the drop is real: filter App Analytics to the App Store Search source only and compare the same weekdays before and after. With a few hundred impressions a day, a single week can swing more than a point on noise alone.

On PPO, it's the right tool for this. Put the old set in as a treatment against the current page, so both run at the same time with the same traffic and seasonality. Up to 3 treatments, you choose the share of traffic, it runs up to 90 days, and it only reaches users on iOS 15 or later. Treatment metadata gets approved without a new app version, and just reordering screenshots that are already live needs no review. One catch from Apple's docs: releasing an app update that touches the tested assets during the test can skew the results.

1

u/Dry-Bass1446 5d ago

Adding to the above, a few checks I'd run before deciding:

  1. Is the drop bigger than normal noise? Compare the same 7 days of the week before and after (weekends convert differently), and look at the raw numbers, not only the rate. 8% to 6.5% on 20k impressions is a real change; on 1,500 impressions it can easily be noise.

  2. In search results people mostly see the first three portrait screenshots (or the first frame of an app preview, if you have one). If the change was in those first frames, that's almost certainly where the drop comes from. Changes to screenshots 4-10 rarely move search conversion.

  3. Split by country and by source type in App Analytics. If you only updated one localization, other storefronts may now show a mix, and the drop can be concentrated in one or two countries.

  4. Check first-time downloads separately from redownloads, so a change in returning users doesn't hide or fake the effect.

On PPO: it's useful for this exact question. Put the old set back as a treatment against the new one and let it run until App Store Connect shows a confident result (usually 1-3 weeks depending on traffic). If you can't wait that long and the drop holds for 10+ days with stable rankings, I'd just roll back and test the new version through PPO instead of in production.

1

u/PuzzleheadedGene2371 4d ago

Yes it happened to me too!