general feedback

[Sebastien AUROUX]

Hello

I tried the QA product and have the following feedback
First, the product is nice, it is the first functional test application that I test so I am quite new on this field. Here is my main constraints :
 
1.    Impossible to make assertions on a GIS module (we use google map like gis module)
There is no wrapper to test each element of the gis component
2.    Impossible to make assertions on a pdf report even if it is generated with telerik reporting
3.    It is impossible to record drawing a polygon in google maps (or i dont how to do it)
a.    Another example would be to record a polygon drawing on the map using open layers : http://openlayers.org/dev/examples/draw-feature.html
4.    The data bind test is quite interresting, it would be better if we could bind it to a complex xml and use xpath to get the good parameter. For complex test with plenty of structured data it would be very handy.
5.    Internet explorer crashes sometimes
6.    Cannot act on a map like maps.google.com (can not click to zoom or draw a polygon)
 
The recorder is not easy to manipulate at the beginning.

My application manipulates a lot of GIS feature to create maps, from those maps we generate exports (like shapes) or reports. The limitation regarding pdf assertion and gis manipulation is too strong in our used case. Your product would fit when we test applications where a lot of GUI manipulation are required in forms with a lot of data to insert.

[Cody]

Hi Sebastien,

Thank you for taking the time to evaluate Test Studio. We always appreciate honest customer feedback.

Impossible to make assertions on a GIS...

I'm not sure it's "impossible" but I will go along with difficut. I think it could be done using a little bit of code, thought I will add the disclaimer I haven't actually investigated this to see the feasibility of it.

I admit Test Studio was designed and is targeted towards more run of the mill business application where the output is all text along with a few images. GIS applications have unique requirements for which we haven't considered and haven't added special features to make testing of them easier.

Impossible to make assertions on a pdf report...

I''m afraid this will always be true. The technical problem with a PDF loaded into the browser is that there's no DOM for us to tap into. It's a black box object in which the browser does not let you peek into. Test Studio can only work with the DOM of HTML applications and the Visual Tree of Silverlight/WPF applications. Since PDF documents offer neither of these, we cannot automate them.

It is impossible to record drawing a polygon in google maps

This may be true. Since we don't have access to such an application we have no idea what it takes to draw a polygon in this GIS application. Can you record a vidoe demonstrating how this is done? I like using Jing for screen recording.

Another example would be to record a polygon drawing on the map using open layers

Actually this is doable, though I admit is a bit tricky and you must record things in a certain order for it to work as demonstrated in this video: http://screencast.com/t/14bzsFQInT

Sounds like what you need is what we call a data driven find expression: http://www.telerik.com/automated-testing-tools/support/documentation/user-guide/code-samples/general/data-driven-find-expressions.aspx

Internet explorer crashes sometimes

I would like to get to the bottom of this. Of course that's never supposed to happen. We need a way to reproduce such crashes so we can get to the root cause and fix it. Is there anyway you can point us to a publicly accessible website along with instructions how to reproduce these crashes?

Cannot act on a map like maps.google.com (can not click to zoom...

While I don't know how to draw a polygon, clicking to zoom is possible.

Again yes this is tricky, but is doable: http://screencast.com/t/3qtzvcRKmNwU

The recorder is not easy to manipulate at the beginning

Can you elaborate what exactly you mean by this statement? In what way is it not easy?

Regards,
Cody
the Telerik team

[Sebastien AUROUX]

hello Thanks for your constructive answer. - I didnt know i can simulate the click as you record on the video, it is not straight forward but it is possible, thanks to point that out. - when i said impossible to make assertion on pdf i meant is it possible to make assertion on telerik reporting, for example if i use the telerik web viewer can i make assertion on the reports ? What i want to test is the content of my reports not the pdf rendering. - i will try to reproduce the problem with ie, but my tests is on a secured application where the first step is to login. I dont know how to give you more details. - at the beginning i had some difficulties to manipulate the recorder because all the actions are recorded so the test must be neat and controled. I dont think it is due to the recorder just need to get used to. Thanks again for your help Sebastien

[Cody]

Hi,

if i use the telerik web viewer can i make assertion on the reports ?

Yes! You can see how this would work using our online Reporting demos. As long as you don't specify PDF as the output, you'll be fine.

i will try to reproduce the problem with ie, but my tests is on a secured application where the first step is to login. I dont know how to give you more details

This is a common problem we run into frequently. If you can recreate the problem and record a video if it happening, it would be a start. I like using Jing for screen recording.

All the best,
Cody
the Telerik team