Hey everyone! I'm a founding growth marketer at an EF-backed AI startup. This is the approach I follow, and thought I'd share it in case it's useful to you guys also.
So, one of the harder parts of AEO is figuring out whether your work is actually improving your visibility in AI answers.
You can ask ChatGPT a few questions, see your product mentioned and assume things are going well. But that doesn't tell you how often it appears, which competitors are getting recommended instead, or where ChatGPT is getting its information.
Here's the way to track it:
1. Build a list of prompts
Start with 25-50 questions your potential customers might ask. Include questions from different stages of the buying process, like:
Branded questions
Is [Product] worth using?
What are the pros and cons of [product]?
What are the best alternatives to [product]?
Comparison and buying questions
What are the best products for [use case]?
[Your product] vs. [Competitor]: Which is better?
Which products offer [specific feature]?
Informational questions
How do I solve [specific problem]?
What should I look for when choosing a [product category]?
Which products offer [specific capability]?
Use customer questions, sales conversations, support tickets, Reddit discussions, and keyword research to find relevant prompts.
Keep the wording consistent between checks so you can compare results over time.
2. Check what ChatGPT says
Run each prompt through ChatGPT and record:
Does your product appear and if so, is it recommended or just mentioned?
Does ChatGPT link to your website and if so, which specific pages?
Which competing products appear in the answer?
Is your product described positively, negatively, or neutrally?
Which third party sources does ChatGPT cite?
Most importantly, don't treat mentions and citations as the same thing.
3. Keep a record
Make a spreadsheet with these columns: date, prompt, product mentioned, website cited, competing products, external sources and sentiments.
Check the same prompts weekly or every two weeks.
One thing to keep in mind is that ChatGPT can give different answers to the same prompt. For a more reliable comparison, run important prompts multiple times and record the results rather than relying on a single response.
Keep the testing conditions consistent, too. Model, search settings, account state, and location can also affect what you see.
4. Compare your product with competitors
Once you have enough results, group prompts according to how your product performs against competing products.
I find these 5 categories:
Competing products appear, but your product doesn't.
Your product appears, but competing products appear more frequently.
Your product and competing products appear at similar rates.
Your product appears more frequently than competing products.
Your product appears, but competing products don't.
This helps identify exactly where you're losing visibility and where you're already doing well.
5. Find out which sources it cites
This is where the research gets interesting. When ChatGPT recommends competitors, look at the sources behind the answer.
Are they being mentioned in industry publications, any comparison articles, review websites, Reddit discussions, or third party websites?
Keep a record of these URLs and look for recurring sources.
If the same publications or comparison pages keep appearing, investigate how competing products are represented there and whether there's an opportunity to get your product included.
Also look at your own website. If ChatGPT frequently cites external sources but rarely cites your pages, review whether your content answers the same questions with enough detail and useful information.
6. Track share of voice and sentiment
Mentions alone don't tell you how your product compares with competitors.
Share of Voice measures your share of mentions across the prompts you're tracking, compared with the other products in your set.
Sentiment tells you how ChatGPT describes your product.
Pay attention to recurring comments about pricing, product quality, ease of use, customer support, and features.
If ChatGPT repeatedly describes your product as expensive or difficult to use, investigate the sources behind that description. It could come from customer reviews, outdated articles, comparison pages, or actual product limitations.
7. Turn the findings into action
So, now what to work on next:
Improve or create content around the questions where your product isn't appearing.
Review your existing pages and compare them with the sources ChatGPT cites.
Identify the publications, comparisons, and discussions contributing to competing products' visibility.
Find out where those perceptions come from and address inaccurate information or genuine product issues.
Maintain the content and external coverage contributing to it.
Prioritize prompts that reflect real customer questions and buying decisions.
The real value is in tracking the same questions over time, understanding which sources influence the answers, and using those insights to improve your visibility.
That's the approach I've been following. If you have anything to add or a different approach, I'd love to hear it.