filmov
tv
2021 LLVM Dev Mtg “Rotten Green Unit Tests”
Показать описание
2021 LLVM Developers' Meeting
—
Rotten Green Unit Tests - Paul Robinson
—
A "test" verifies the behavior of some software; if it passes, we call it "green." But an incorrectly constructed test might appear to pass, when in fact it simply doesn't execute; that is, it is "Rotten." Rotten Green Tests are particularly pernicious because they LOOK reasonable to a human reading the test; but they fail to provide the verification they are meant to, and consume testing resources to no benefit. I've prototyped support for detecting Rotten Green Tests in LLVM's copy of googletest, the test framework for unittests in Clang and LLVM. I'll describe how the prototype works, brag about the successes, and admit there's more work to do.
—
—
Rotten Green Unit Tests - Paul Robinson
—
A "test" verifies the behavior of some software; if it passes, we call it "green." But an incorrectly constructed test might appear to pass, when in fact it simply doesn't execute; that is, it is "Rotten." Rotten Green Tests are particularly pernicious because they LOOK reasonable to a human reading the test; but they fail to provide the verification they are meant to, and consume testing resources to no benefit. I've prototyped support for detecting Rotten Green Tests in LLVM's copy of googletest, the test framework for unittests in Clang and LLVM. I'll describe how the prototype works, brag about the successes, and admit there's more work to do.
—