title: Define threshold of failures in parameterized test
body: <p>We have a parameterized test which generates one test for each file in a specified folder and checks whether we can process it or not.</p>
  
  <p>We expect this parameterized test to fail for a lot of files and that's why we have excluded it from our build process (we're using Maven and Jenkins for CI).</p>
  
  <p>The problem is that because this test is not part of our build, sometimes we accidentally cause more failures than what we expect with code changes.</p>
  
  <p>Does anyone know a way to specify, either in the test itself or in the POM, a threshold and say that if we have more failures than the threshold, this parameterized test should cause the build to fail?</p>
  
  <p>Thank you for all your help.</p>
  
  <p>Alex</p>