Re: [Inkscape-devel] gnome or X test framework
William Swanson wrote:
On Thu, Jun 10, 2010 at 12:27 AM, Vangelis Katsikaros <vkatsikaros@...1244...> wrote:
For example I could write a script: when program opens click this menu, click this button, drag that object, press these keyboard keys, roll the mouse wheel etc.
This tool seems similar to what you are describing:
yep it is exactly that :)
A friend suggested this too some hours ago, and I 've playing with it all this time.
It does work as advertised and it's excellent for testing. I've been able to make inkscape run and do several GUI driven things.
Drawbacks: - not so portable (a theme change can render it unusable not to mention switching OS). - when putting inkscape under pressure, careful timing must be used to make sure the simulation performs what you want and when you want.
__________________________________________________ ×ñçóéìïðïéåßôå Yahoo!; ÂáñåèÞêáôå ôá åíï÷ëçôéêÜ ìçíýìáôá (spam); Ôï Yahoo! Mail äéáèÝôåé ôçí êáëýôåñç äõíáôÞ ðñïóôáóßá êáôÜ ôùí åíï÷ëçôéêþí ìçíõìÜôùí http://mail.yahoo.gr
On Thu, Jun 10, 2010 at 2:26 PM, Vangelis Katsikaros <vkatsikaros@...1244...> wrote:
A friend suggested this too some hours ago, and I 've playing with it all this time.
It does work as advertised and it's excellent for testing. I've been able to make inkscape run and do several GUI driven things.
I think it is an excellent and long overdue idea. Inkscape badly needs more automated testing if it doesn't want to die a slow death of bit rot and bug infestation.
If you can set up such a testing framework and commit it as part of the Inkscape codebase, and more importantly make it at least a part of "make check" (and ideally, it should be run automatically on every commit!) it would be a great step forward. Working on that does not require much familiarity with Inkscape code.
By the way, many things (though certainly not all) should be testable without any external framework at all. Inkscape has the --verb command line option that can run a sequence of verbs. All we need to do is design a number of good test cases and write the scripts that run verbs on given input files, save them, and compare the output with reference SVGs.
bulia byak wrote:
On Thu, Jun 10, 2010 at 2:26 PM, Vangelis Katsikaros <vkatsikaros@...1244...> wrote:
A friend suggested this too some hours ago, and I 've playing with it all this time.
It does work as advertised and it's excellent for testing. I've been able to make inkscape run and do several GUI driven things.
I think it is an excellent and long overdue idea. Inkscape badly needs more automated testing if it doesn't want to die a slow death of bit rot and bug infestation.
+1
If you can set up such a testing framework and commit it as part of the Inkscape codebase, and more importantly make it at least a part of "make check" (and ideally, it should be run automatically on every commit!) it would be a great step forward. Working on that does not require much familiarity with Inkscape code.
I'll do part of it since I have to setup some test cases. I'll now try to setup an environment for sikuli testing.
In general, after Jon's and bulia's replies we have 3 options: 1) inkscape's verbs 2) dogtail: a11y bindings 3) screenshot/GUI driven (sikuli or other if they exist)
Some first thoughts (with no hands on experience with 1 and 2): Depending where a bug is (for example it could be in the verb code) each choice could mask different kinds of bugs. So I don't think that only one should be used. However, this increases administration/coordination.
Vangelis __________________________________________________ ×ñçóéìïðïéåßôå Yahoo!; ÂáñåèÞêáôå ôá åíï÷ëçôéêÜ ìçíýìáôá (spam); Ôï Yahoo! Mail äéáèÝôåé ôçí êáëýôåñç äõíáôÞ ðñïóôáóßá êáôÜ ôùí åíï÷ëçôéêþí ìçíõìÜôùí http://mail.yahoo.gr
participants (2)
-
bulia byak -
Vangelis Katsikaros