Thursday, January 08, 2009

take total errors number as a Key indicator in your result

In LR, there are two indicators to describe how many errors or failures your scripts or application generate. Errors numbers and transaction failed numbers. Personally I would like to take total errors as a Key indicators to show how successfully this, instead of failed transactions number.

Take errors rate into consideration not transactions failed only:

1. Every error has its own reason
2. If many errors occurred, then the tests result are question, response time may misleading…
3. Errors and failed transactions should be correlated, so errors can be the complete set of failed transactions.
4. Try to solve the errors or make sure what happened behind each errors, may scripts issue itself, may application issue(raise a bug), or testing data has problems….

No comments:

Post a Comment