Unit Testing: How to treat errors as failures

Whenever one of my functions throws an error that was not intended in that test-case the whole test suite stops. Is there any possibility to treat those error-occurrences as failures for those specific testcases and then continue with the next ones?

[Andy Campbell]

Hi Christian,

What test framework are you using? The framework that is officially included in MATLAB actually has the behavior you desire, unless something else is going on. Are you using the framework in the matlab.unittest package?

Andy

Answer 1

[KSSV]

Read about try and catch

[Christian Heigele]

Since those functions are executed by the test runner, I could only surround the testRunner call with a try / catch statement, which doesn't help me to continue with the rest of test-cases within the loaded test suite.

Hence I don't think this is a valid solution.

     % This suite consists out of a few hundred test-cases, of which a few might throw an error. 
    suite= TestSuite.fromFolder('../..', 'IncludingSubfolders', true);
    runner = TestRunner.withNoPlugins();
    results = runner.run(suite); % This call should continue executing all testcases within the suite, even if one of them has thrown an error. 
    display(results);

[Christian Heigele]

And of course I don't want to try/catch and omit the error inside of those functions, because the errors themselves are completely valid and helpful.

Answer 2

[Adam]

doc matlab.unittest.qualifications.Assumable

rather than using assert in a unit test will cause the test to be filtered rather than produce a failure. In this case the test suite should continue rather than terminate.

Be careful not to squash expected errors with this though.