Notifications

From STRIDE Wiki
Jump to: navigation, search

Testspace supports automatic user notification of noteworthy test results events, namely:

  • when a result set has regressions (setbacks) relative to a defined baseline. The baseline for comparison can be a fixed set of results (fixed baseline) or simply the previous result set (sequential baseline).
  • when a result set has one or more errors. These errors are generated in the STRIDE Framework when an error log message is created or when a test point expectation is not met.
  • when a result set has one or more test cases that exceed the expected duration set in a baseline. It is possible to define an upper bound for the duration of a particular test case in a baseline. If this upper bound has been set (it is not set by default), then any time that test case exceeds the duration limit, a notification will be generated.

Notification is currently done via email messages. Each user has a notification option for each test space to which they have access. If the user has been selected to receive notifications and one or more of the notification options (setback, errors, or timing) is activated for the testspace, then a message will be sent to that user when any new result set is uploaded that triggers one of these notification events. This screencast demonstrates these concepts:

<html5media width="640" height="480">http://www.s2technologies.com/video/wiki/TS_Notifications.mp4</html5media>