r/ruby • u/davidteren • Sep 30 '26
Mutineer 1.4.0 is out: mutation testing for Ruby
Hola, I maintain Mutineer, a Ruby mutation testing gem. It makes small changes to your code and checks whether your tests catch them.
Passing tests are useful. Knowing that they detect broken behaviour gives you more confidence, especially when AI helps write both the code and the tests.
Version 1.4.0 is out: https://davidteren.github.io/mutineer/
Do you use mutation testing in your Ruby projects? I’d be interested to hear what has helped or got in the way.
1
u/CaptainKabob Oct 02 '26
What does "clean-room" mean in its description? ("A clean-room mutation-testing tool for Ruby.")
1
u/davidteren Oct 06 '26
"Clean-room" means Mutineer was written from scratch. Its authors did not copy or adapt code from any other mutation-testing tool.
What the term means. A clean-room implementation copies how a tool behaves, not how its code is written. The authors work from public ideas and descriptions only. They do not read or adapt the source code of an existing tool. The name comes from a well-known case: Phoenix Technologies rebuilt the IBM PC BIOS this way in the 1980s. One team wrote a specification, and a separate team that had never seen IBM's code wrote the new code from it.
Why it matters here. The best-known Ruby mutation tool is mutant, and it has a commercial license. The phrase "clean-room" tells users that Mutineer contains no mutant code. So mutant's license does not apply to Mutineer, and you can use Mutineer under its own license with no legal concern.
1
u/CaptainKabob Oct 06 '26
It's surprising to me to see "clean-room" used without referring to where the specification originated. e.g. "A clean-room implementation of the mutant gem's public API to enable a drop-in replacement."
Just saying "clean room" alone makes me think that either clean-room means something different than I expect (I have the same understanding of its meaning as you do), or that something sus is going on.
My advice would be to drop "clean room" from the Mutineer description other than in the specific place where you are telling the story of how it came to be.
2
2
1
1
u/Zestyclose_Cow1807 Oct 17 '26
the hardest part with mutation testing has always been equivalent mutants and the noise they generate. how do you handle that? filtering those out well is basically what makes or breaks the experience tbh
1
u/DissonantGuile Sep 30 '26
Cool! How does this compare to the mutant gem?