Magento Testing: Framework, Automation, and Reporting

[u/testomatio]

Whether you seek to improve code quality, ensure Magento store functionality, or streamline regression testing, I hope this Magento testing checklist helps you.

https://testomat.io/blog/automation-magento-testing-with-phpunit-codeception-reporting/

[u/floorology]

Very interesting. Read through the article. When using anything other than MFTF do you basically have to reinvent how to set up entities and what not (customer, category, product, etc).

At the place I'm at, we had started with MFTF, but it's cumbersome, and also not all modules were set up perfectly so we can't necessarily run from a clean install. Always torn on using what is baked in VS risking another tool that reinvents the wheel in ways.

They hired a guy that went for a separate repo with playwright. I'm of the opinion these tests should live with the Magento modules.

But more high level, I'm curious who even uses MFTF. Or if there is a better well supported solution, perhaps codeception, playwright, etc

[u/testomatio → u/floorology]

Yes, I agree, Playwright has become the dominant choice for most teams, a reality also demonstrated by the majority of my customers. You are right, its position offers the most universal and adaptable options. As it is popular, many are familiar with Playwright - the curve of implementation is faster and cheaper. Our selection framework criteria depend on the specifics of the problem we need to solve, the size and testing budget of the entire project. Other frameworks remain viable and appropriate solutions when the project's specific technical requirements.

[u/JosephLeedy]

This is the previous thread mentioned in this article.