Fail Reasons exportable in the UnitTest-Framework?

1 visualizzazione (ultimi 30 giorni)
Hi,
when I run unit tests with the unittest framework.
The result of a test run is a vector of matlab.unittest.TestResult objects.
The objects include an information, if a test fails, but do not contain the information about the failure.
If there is a failure, I want to give this failure information to another application.
Therefore my question: Are the fail reasons exportable in the UnitTest-Framework?
thanks
  2 Commenti
Andy Campbell
Andy Campbell il 4 Dic 2013
When you say the fail reasons, do you mean the "Framework Diagnostics" and "Test Diagnostics"? Alternatively, do you mean the "Reason(s)" that are shown in the failure summary at the end of the run?
Till Rahlf
Till Rahlf il 17 Dic 2013
Hi,
when the tests are finished, I get a vector of matlab.unittest.TestResult objects.
Like:
myTestResults =
1x4 TestResult array with properties:
Name
Passed
Failed
Incomplete
Duration
Totals: 2 Passed, 2 Failed, 1 Incomplete. 2.5783 seconds testing time.
Where can I see the "Reason(s)" that are shown in the failure summary at the end of the run?
I just see reasons during the test process, do I?
During the test process of the whole test suite, all problems are displayed, like: ================================================================================ Uncaught error occurred in myFirstTest/Test1.
--------------
Error Details:
--------------
Undefined function or variable 'undefExample'.
I can see the error text in the command window, but the resulting vector of matlab.unittest.TestResult objects does not contain this information. It shows only that a test fails, but not why.
I want to collect all warning and errors during a test suite run. After that I want to export it together with the test results to another software.
Thanks

Accedi per commentare.

Risposta accettata

Sean de Wolski
Sean de Wolski il 11 Mar 2014
Now with R2014a, you can use custom test runner plugins such as the Failure Diagnostics Plugin and the Output Stream or To File plugin to gather the failure reasons and export them.

Più risposte (3)

Swati Tiwari
Swati Tiwari il 4 Mar 2016
Now with R2016a, you can use DiagnosticsRecordingPlugin to add diagnostics on test results.
If you run tests with the runtests function or the run method of TestSuite or TestCase, the test framework uses a DiagnosticsRecordingPlugin plugin that records diagnostics on test results.
After you run tests, you can access recorded diagnostics via the DiagnosticRecord field in the Details property on TestResult. For example, if your test results are stored in the variable results, find the recorded diagnostics for the second test in the suite by invoking records = result(2).Details.DiagnosticRecord.

Andy Campbell
Andy Campbell il 18 Dic 2013
Modificato: Andy Campbell il 18 Dic 2013
This is related to your other question here. Basically, the core test result does not have any access or remember the reasons for the failure. Once you can extend the runner by implementing a custom plugin, that plugin can access such information. As mentioned in the linked answer though, this is not yet ready for prime time and is currently not a documented interface. It is very likely to change in a future release.

per isakson
per isakson il 10 Mar 2014
This line picks up most of the output from the test
msg_str = evalc('results = run( test_runner, test_suite );');

Categorie

Scopri di più su Extend Testing Frameworks in Help Center e File Exchange

Tag

Prodotti

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by