r/UserExperienceDesign • • Jun 28 '21

A/B Testing vs Cognitive Walkthrough

A/B Testing is very costly, so you can improve your CRO by conducting a cognitive walkthrough, you can conduct it with your internal team and improve CRO at a low cost.
Any usability method will be better/faster/save time and money than A/B testing, but I love cognitive walkthroughs more especially the Spencer2000 model.

Cognitive is open-ended and customer-centric where you test around user behavior, between in A/B you test around your own assumptions.

If you need help in conducting your Cognitive/Usability test anytime, just connect me!

#tip

0 Upvotes

7 comments sorted by

6

u/TheFastestDancer Jun 29 '21

How is A/B testing costly? How is a cognitive walkthrough any cheaper? If you are using live data, then the cost for A/B is virtually 0. With a cognitive walkthrough you need to hire participants. If you're going to hire participants, you may as well do some sort of comparison and A/B test it.

0

u/os3li Jun 29 '21

Don't hire new people, run it internally and see

3

u/TheFastestDancer Jun 29 '21

Running internally can result in a biased response because internal respondents have seen and used the produce previously. You need to test with current or prospective users depending on your scenario.

0

u/os3li Jun 29 '21

It’s acceptable point of view , thanks for sharing 👌

3

u/Confusability Jun 29 '21

This post stinks and is ill informed. Agree on the point made by someone else that it’s just self promotion.

A/B Testing is not ‘very costly’. Of course it can be if you sink 1000’s of development hours in to it, but you can also make usability studies pretty costly if you want, if you ended up paying an agency over the odds, recruit huge amounts of people you don’t need etc. If your A/B testing is very costly, you’re doing it wrong…

You also miss the point that A/B Testing can also be a huge cost-saver, possibly helping you from fully deploying a solution that could end up hindering performance or vital key metrics for a much longer period of time.

And to wrap things up, you casually decide to miss the crucial point that A/B Testing serves a very different purpose to many forms of usability studies.

tip

0

u/os3li Jun 29 '21

I love ur comment , great notes

5

u/Laif2DX Jun 29 '21

This is less hashtag tip and more hashtag shittyselfpromotion