2021 LLVM Dev Mtg “Rotten Green Unit Tests”

preview_player
Показать описание
2021 LLVM Developers' Meeting

Rotten Green Unit Tests - Paul Robinson


A "test" verifies the behavior of some software; if it passes, we call it "green." But an incorrectly constructed test might appear to pass, when in fact it simply doesn't execute; that is, it is "Rotten." Rotten Green Tests are particularly pernicious because they LOOK reasonable to a human reading the test; but they fail to provide the verification they are meant to, and consume testing resources to no benefit. I've prototyped support for detecting Rotten Green Tests in LLVM's copy of googletest, the test framework for unittests in Clang and LLVM. I'll describe how the prototype works, brag about the successes, and admit there's more work to do.


Рекомендации по теме