Category: Development and implementation

Subcategory: Systems development

Non-functional testing - NFTS

Assessing systems and services to evaluate performance, security, scalability and other non-functional qualities against requirements or expected standards.

Levels:

Level 1:
Description: Executes given non-functional test scripts under supervision, focusing on system qualities and characteristics such as performance. Sets up basic test environments and uses standard tools to execute prescribed tests. Records results and reports issues.

Level 2:
Description: Assists in designing non-functional test cases and creating test scripts. Supports the preparation of test data for non-functional testing under supervision. Configures test environments. Executes both manual and automated non-functional testing. Implements appropriate test tools based on given non-functional requirements or specifications. Defines test conditions for given non-functional requirements. Analyses and reports on test activities, results, issues and risks.

Level 3:
Description: Designs non-functional test cases and scripts, mapping to pre-set criteria for system qualities and characteristics. Prepares and manages test data to reflect real-world scenarios. Configures test environments, collaborates with stakeholders to clarify requirements and automates repeatable tests. Participates in requirement reviews to refine comprehensive test plans. Undertakes exploratory tests to investigate unusual behaviours. Executes tests, troubleshooting issues as they arise. Analyses and reports on test activities, providing thorough coverage of non-functional attributes.

Level 4:
Description: Selects suitable non-functional testing approaches, considering system criticality and complexity. Develops, automates and executes test plans for end-to-end system attributes. Configures and manages complex, test environments, ensuring alignment with production conditions. Applies risk-based strategies to prioritise test efforts and collaborates across teams to ensure comprehensive automated test coverage. Troubleshoots issues in real-time, ensuring prompt resolution. Analyses and reports on test activities, results and risks, including the work of others.

Level 5:
Description: Plans and drives non-functional testing across all stages, ensuring alignment with requirements and prioritising risk-based strategies. Provides expert advice on non-functional methods, tools and frameworks. Leads the setup and maintenance of advanced test environments. Monitors the application of testing standards, ensuring they reflect real-world conditions. Troubleshoots and resolves complex issues, working closely with stakeholders. Leads efforts to improve the efficiency and reliability of non-functional testing. Identifies improvements and contributes to organisational policies, standards and guidelines for non-functional testing.

Level 6:
Description: Develops organisational policies, standards and guidelines for process testing, ensuring they align with business strategy and incorporate a risk-based approach. Plans and leads strategic, complex testing activities, ensuring they align with overall system quality goals. Manages risks and opportunities, coordinating with other types of testing. Develops organisational capabilities to address complex quality validation challenges. Drives continuous automation and improvements in test environments. Promotes a culture of quality in non-functional testing, driving adherence to organisational standards and proactive risk mitigation.