On Fri, Mar 21, 2008 at 9:19 AM, Jasper van de Gronde <th.v.d.gronde@...528...> wrote:
Unfortunately I don't have a Linux system set up at the moment, so I can't actually execute 'make check'. So far I've come up with the following draft plan:
Great plan, and long overdue! :)
I think the important thing is to test both from bottom up (unit tests of classes and functions) and from top down (scripted tests and performance measurements of the entire program doing various tasks on various files). For the latter, Ted's command line access to verbs is priceless, but you'll also need to find some kind of bitmap diff program to compare PNG renditions of various files to the reference versions and find differences. This will be especially critical when we switch main rendering to cairo.
I have a couple thousand misc SVG files from various sources, and before a release I ran a very simple script that would load each file and export it to PNG. Even without any bitmap diffing, this found at least a couple bugs.