This post will briefly explore the topic of regression from a standpoint of data center testing. There are many different approaches and methodologies when it comes to regression testing. At its core the CIA fundamentals are achieved, Confidentiality, Integrity and Availability. The original use cases stem from the Software development spaces, however in this article we are exploring the application of regression testing in the data center. So, what is it, what value does it add and why should you care. At its core regression testing can be looked at as a series of test that are completed after any change has taken place. This change can be small as changing an IP address all the way to a full-fledged data center migration.
Sample use case scenarios are show below
- Patching (OS & Software)
- Upgrades (platforms, software, etc.)
- Configuration Changes
- Configuration Roll backs (Disaster Recovery operations)
Regression Testing includes four Fundamental Test. These tests quantify the functionality of a given system or network.
Test to Conduct
- Boundary Test (Are only authorized users allowed access to the application) – Confidentiality
- Graphical user interface (GUI) Test – Availability
- Dependency Test (Are all services that are dependent still functioning) – Availability
- Functionality Runtime Test (Does the internal functions work as expected) – Integrity
Regression testing, should be an automated task just as most other aspects of Information technology
Conceptual Scripted Automation Example:
DHCP Server regression script file:
Given the correct Power Shell modules are installed
- Verify network connectivity via a ping command
- Verify that the given services are all started (get-service)
- Verify that the dependent services are started (get-service)
- Verify that the required ports are in a listening state (netstat)
- Verify Authentication is working as designed (application specific)
- Verify that there are incoming connections (application specific)
- Verify the DHCP scopes are active (get-dhcpserverv4ScopeStatistics)
- Verify that Scopes have available IP’s (getdhcpserverv4ScopeStatistics)
Example Regression Testing Form (with examples)
Boundary Test
Server Name | Services Tested | Test to be completed | Pass | Fail |
Web01.com | Authentication | Login | ||
Graphic User Interface (Web Service) Test
Server Name | Services Tested | Test to be completed | Pass | Fail |
Web01.com | GUI | Does the web page render properly | ||
Dependency Test
Server Name | Services Tested | Test to be completed | Pass | Fail |
Web01.com | Web Services | Are all the required services started | ||
Functionality Runtime Test
Server Name | Services Tested | Test to be completed | Pass | Fail |
Web01.com | Application | Does the standard queries return results per design | ||