Technical solutions are described for identifying false positive tests. An example method includes receiving an input identifying a defect in a portion of a product code. The method also includes identifying a first automated test that is associated with the portion of the product code. The method also includes lowering a first test confidence value that is associated with the first automated test by a predetermined amount in response to the first automated test being a passing test. The method also includes marking the first automated test as a false positive test.