Rendering test results on-line
If you go to: http://home.hccnet.nl/th.v.d.gronde/inkscape/ResultViewer.html you will now see an up-to-date list of test results for Inkscape's rendering tests. It now contains one column, each time I run the tests a column will be added (to the left). It's still pretty bare-bones, but I hope I (or someone else) will find some time to improve it in the near future.
I plan to run the tests regularly for at least the next two months or so. I have to run the tests more or less manually though (I created a batch file to automate most steps, but I still have to run the batch file manually, on my notebook...), so I'm interested in any suggestions people might have for hosting (more) fully automated tests.
You don't see any test for your favorite rendering bug? No problem, if the bug is already in the bug tracker with the required test files (read on), just mail me and I'll add it. If not, create an SVG demonstrating the problem (small and simple please) and one or more of the following: - A PNG of the wrong output. - A PNG of the right output (preferably exact). - An SVG that should look exactly the same, but is rendered correctly by Inkscape. Then attach the files to the corresponding bug in the bug tracker (or create a new bug and attach the files if it isn't the tracker yet) and mail me (or anyone else who has SVN access).
Of course, if you have SVN access you can add tests yourself.
The bugtracker: http://bugs.launchpad.net/inkscape
For more information about Inkscape's (rendering) tests: http://www.inkscape.org/wiki/index.php/TestingInkscape
The test suite in SVN: https://inkscape.svn.sourceforge.net/svnroot/inkscape/gsoc-testsuite The directory 'tester' contains the actual rendering tests, the directory ResultViewer contains my clumsy attempt at a GWT project.
On Wed, 2008-10-29 at 11:28 +0100, Jasper van de Gronde wrote:
If you go to: http://home.hccnet.nl/th.v.d.gronde/inkscape/ResultViewer.html you will now see an up-to-date list of test results for Inkscape's rendering tests. It now contains one column, each time I run the tests a column will be added (to the left). It's still pretty bare-bones, but I hope I (or someone else) will find some time to improve it in the near future.
This is cool.
I plan to run the tests regularly for at least the next two months or so. I have to run the tests more or less manually though (I created a batch file to automate most steps, but I still have to run the batch file manually, on my notebook...), so I'm interested in any suggestions people might have for hosting (more) fully automated tests.
What would be required to do that? Hardware? Bandwidth?
You don't see any test for your favorite rendering bug? No problem, if the bug is already in the bug tracker with the required test files (read on), just mail me and I'll add it. If not, create an SVG demonstrating the problem (small and simple please) and one or more of the following:
- A PNG of the wrong output.
- A PNG of the right output (preferably exact).
- An SVG that should look exactly the same, but is rendered correctly by Inkscape.
Then attach the files to the corresponding bug in the bug tracker (or create a new bug and attach the files if it isn't the tracker yet) and mail me (or anyone else who has SVN access).
Could we tag these bugs with a tag in Launchpad? Or perhaps a tag for potentials if people wanted to bring them up to a point where they could be integrated? It'd be awesome to come up with a set of bugs that we don't want to have again :)
--Ted
Op Vr, oktober 31, 2008 04:57 schreef Ted Gould:
On Wed, 2008-10-29 at 11:28 +0100, Jasper van de Gronde wrote:
I plan to run the tests regularly for at least the next two months or so. I have to run the tests more or less manually though (I created a batch file to automate most steps, but I still have to run the batch file manually, on my notebook...), so I'm interested in any suggestions people might have for hosting (more) fully automated tests.
What would be required to do that? Hardware? Bandwidth?
Mostly hardware. I don't expect bandwidth to be a big problem any time soon, but I take my notebook pretty much everywhere and use it pretty intensively, so having something run automatically on it at specified times is not a very good option for me.
... Then attach the files to the corresponding bug in the bug tracker (or create a new bug and attach the files if it isn't the tracker yet) and mail me (or anyone else who has SVN access).
Could we tag these bugs with a tag in Launchpad? Or perhaps a tag for potentials if people wanted to bring them up to a point where they could be integrated?
I'm not sure, you can probably define tags for those things, but the right people should ideally also be notified if such a tag is assigned to a bug. I've only had a quick look at Launchpad and perhaps the API they're planning to release will help, but for the moment I don't think that's possible (and then there probably would be less of a point in having those tags).
It'd be awesome to come up with a set of bugs that we don't want to have again :)
That's a given :)
th.v.d.gronde@...528... wrote:
Op Vr, oktober 31, 2008 04:57 schreef Ted Gould:
On Wed, 2008-10-29 at 11:28 +0100, Jasper van de Gronde wrote:
I plan to run the tests regularly for at least the next two months or so. I have to run the tests more or less manually though (I created a batch file to automate most steps, but I still have to run the batch file manually, on my notebook...), so I'm interested in any suggestions people might have for hosting (more) fully automated tests.
What would be required to do that? Hardware? Bandwidth?
Mostly hardware. I don't expect bandwidth to be a big problem any time soon, but I take my notebook pretty much everywhere and use it pretty intensively, so having something run automatically on it at specified times is not a very good option for me.
Maybe I could talk to Inc about the potential of us having this stuff run on our webserver. After all, it would make sense to host the test cases ourselves.
Cheers, Josh
Josh Andler wrote:
th.v.d.gronde@...528... wrote:
Mostly hardware. I don't expect bandwidth to be a big problem any time soon, but I take my notebook pretty much everywhere and use it pretty intensively, so having something run automatically on it at specified times is not a very good option for me.
Maybe I could talk to Inc about the potential of us having this stuff run on our webserver. After all, it would make sense to host the test cases ourselves.
Something like that would be great. It would need to update SVN, compile Inkscape, run the test suite (most importantly a Python script) and upload the results (or in this case probably just copy them to the right dir). And it would need to do this on a regular basis. Once a day might already be overkill, but would perhaps be a good goal to prevent "undersampling" to some extent.
participants (4)
-
unknown＠example.com -
Jasper van de Gronde -
Josh Andler -
Ted Gould