2013/10/10 Jasper van de Gronde <th.v.d.gronde@...528...>:
It's not completely clear to me what you need exactly (just a change/no change answer, a number of failed/succeeded tests, ...?), but there is currently no separation between good and bad tests. In particular, a test could have (and some do have) both known good and bad references related to it.
Makefile.am contains two variables, TESTS and XFAIL_TESTS. In order for a "make check" to succeed, the programs in the TESTS variable must exit normally (exit status zero), while the programs in XFAIL_TESTS must exit with an error (exit status nonzero). http://www.gnu.org/software/automake/manual/html_node/Scripts_002dbased-Test...
Therefore, we need to know which tests fail at present and which don't, as well as a way to automatically tell whether a test fails or passes. "make check" will then alert us when Inkscape's output changes.
Regards, Krzysztof