Fully qualified tests
The problem
Test developpers are often led to make specific tests part of one "category". For instance, one common practice is to have tests organized in the following categories:- unit
- smoke
- functionnal
- stress/load
- negative
- positive
- back box
- white box
- integration
- and more...
The fix
XStudio provides a far more flexible way of "qualifying" tests by using "properties" so that you don't need to make difficult choices; you just need to associated your tests with a set of properties. These properties are not only String typed but can be Integer or Boolean.
Then, when building a test campaign, you can filter your tests on these properties before scheduling/running them.
This mechanism is extremey powerful if your tests are appropriately "qualified". For instance, if you set an integer property to your test indicating the estimated time to execute it completely, then, you are able to create a test suite composed only from tests taking less than x seconds to execute. This is a simple example. Filters can be extermly complex and powerful.