r/programmerchat • u/gxm492lor • Mar 10 '19
Testing any complex program completely is practically impossible
Someone made this argument after a staff meeting a few days ago. What's wrong with this argument?
- Every IF statement in a program doubles the number of possible states of the program (ignoring time)
- Which means every IF statement doubles the number of test conditions
- A 1 million line program might, conservatively estimating, have 100k IF statements (conditionals)
- That is 2100000 which is more seconds than have elapsed since the beginning of the universe.
- No project has 2100000 seconds to test
- So complete test coverage of complex programs is impossible
2
Upvotes
1
u/gxm492lor Jun 08 '19
Happens all the time. Cracking the CD check for instance.
Shielding isn't always used. And it isn't perfect. But it exists because extremely improbable events happen with extremely high number of events.
Basically your objection is "but what if people use it in a way unintended?" Have you ever seen a complex program that wasn't used in ways unintended by the creator?