.png)
Functional-Test Strategy & Deliverables
Requirement & Understanding
Testing Scope Finalization
Test
Planning
Test Design
Test Execution
Defect Management
Reporting
Application Walkthrough
Planning of Browser & Device scope
High Level Test Plan
Analysis of SRS/User Manual/ Existing Test cases
Out of Scope
Detailed Test Plan
Analysis of Screenshot/wireframes
Assumptions & Pre-requisites
Basic Test Design
Test Design Enrichment
Design review and Sign off
Test Execution
Retest
Raise Defects
Defects Reporting
Defect Categorization
Issues and Remediation Tracking
Daily/Weekly Reports
Usage of Tools
Defect & Execution Dashboards
RTM Preparation
Entry – Exit Criteria
Identify Performance Issues & fixes tracking
Test Closure reports
Query Log
Signed off Test Plan and Test Strategy
Enriched Functional Test Design
Test Execution Results & Screenshots
Defect Logs
Daily Dashboard & MIS
Requirements Traceability Matrix
Testing types
Test Environment Readiness
Automated Scripts
Defect screenshots
Closure reports at the end of each Release
Publish Technical & Environment Feasibility
Automation Strategy& Solution
Compatibility Designs
Automation Framework Design
Defect analysis report
Timesheets
Block/Fail Report
Enablers
Templates
Frameworks
Dashboards
Test Repository
Lesson Learned & Best Practices
Functional Testing Approach
Business Requirements Walkthrough
TC’s /TS’s/TD creation
FT coverage Sign off’s UAT
Auto /Man Test Executions
Regression
Go Live
Production Data Validation
-
Requirement GAP analysis
-
RTM Preparation
-
CR Impact Analysis
-
Requirement clarification
-
CR Impact Review
-
Test scenario preparation
-
Test case preparation
-
Test data preparation
-
Test data support
-
Test Case review
-
Signoff on RTM, Coverage, Test scenario, Test cases
-
Sanity , BVT, Migration validation
-
Test Executions
-
Defect logging , retest
-
Signoff on UAT execution results
-
Test Execution.
-
Defect logging , retest , Migrated data validation
-
Signoff on regression results
-
Production Deployment
-
Production Monitoring
Automation Test Strategy
Ownership
New Product Testing Breakdown Details
Dev team
QK Team
QK Team
QK Team
Dev QA
QA User Experience Test
QA Regression
30%
40%
20%
5%
-
Units & Components
SIT & Integration
UAT
Pre Prod
Continuous Audit
Early SIT (Left Shift)
Reduced TAT by early SIT
End User TAT
Regression
Test OPS
Exit Criteria (TBD with PO / SM)
Automation Strategy
100% Pass Rate
90% Pass Rate
100% Pass Rate
100% Pass Rate
100%
Automation Strategy
1. API Tests Automation 100%
2. Test Data Automation (up to 40%)
3. Unit Test Automation 100%
4. Integration Touch Point Automation (up to 40% )
5. SCM, Code Merging Practices
100%
6. Code Quality KPIS 100%
7. Contract Tests 100%
8. Static Code Review (up to 100%)
9. Early PT (up to 100%)
1. 100% API Tests Automation
2. GUI Automation (up to 50%)
3. Test Data Automation (up to 70%)
4. Integration Touch Point Automation (up to 20%)
5. Report verification Automation (70% Generation, 50% Verification)
6. Regression Automation (Up to 60%)
1 . Cust Journey Automation (up to 60%)
1. 100% API Tests Automation
2. GUI Automation (up to 50%)
3. Test Data Automation (up to 60%)
4. Integration Touch Point Automation (up to 20%)
5. Report verification Automation (70% Generation, 50% Verification)
1. Persona Based Regression of 50 end to end All Combine TC’s.
1. Synthetic Monitoring Tests 100% Automated
2. Production Data Analysis (up to 80%)
3. Performance Hotspots
4. User Experience Tests
5. Production Audit & RCA
6. Play Store Feedback &
7. Fix + Revalidation
Automation Approach
IDEATION
IDEATION
CONSTRUCTION
TRANSITION
Scope Defination
Design
Build
Test
UAT
Deploy
• Scope Prioritization
• Identify Critical Repetitive Functionalities
• Prepare Automation Strategy & Plan
• Test Environment Set up
• Automation Framework Set-up
• Identify Test Data needs
• Creation of Application Flows
• Identification of Common Flows
• Identification of Verification Points
• Referring designed test cases
• Involvement of Automation Team to understand the Application Flow
• Test Data Creation
• Creation of Object Repository
• Follow Standard Coding Practices
• Develop Automation Scripts
• Dry run for developed scripts to identify script level issues
• Make changes in the scripts in case of changes or bug fixes for the application flows
•One time delivery of Automation Scripts
•Training To Bank Team For Script Execution
•Daily Execution Reports
Sign-off from customer on Requirements
Internal Review to ensure quality coverage
•Code Review
•Sign-off from Testing Team
Customer Sign-Off on the Scope Delivered
API Automation Strategy
Environment
DEV
INTEGRATION
QA/UAT
Perf
Contract Development
In Sprint Testing
Integration Testing
End To End Testing
Low Volume Testing
Change Management
& Re-Usability of API Scripts for other Projects
Activity
• API Contract Generation
• Schema Validation
• Testing of API’s Components
• Testing of Front-end Portal / Mobile Apps
• Testing for Early Performance
• Root Cause Analysis for Functional & Performance Issues
•Testing of integrated functionality (Vertical Testing for Scenarios)
•API Contract Testing
•Testing for Module Level Performance (Low volume Testing)
• E2E User Journey Testing cutting across APIs, Call Chain
• Real Device testing for Usability / Combability
• Real Device testing for Client-Side performance
•Testing for performance under Low volume
•Identify & modify API Automated scripts as per Functional workflow changes
•Impact Analysis
•Reusability
•Defect RCA
Coverage
• Contract agreements between a consumer endpoint and an API provider endpoint
• Business Logic Validation via API with multiple permutations
• GUI Level Validation at front end (BAU Team)
• Single User / transaction performance (e.g. response time, failures, app method / DB query performance)
•Business logic validation for vertical functionality
•Limited Set Validation of front-end portal with API to ensure data is correctly passed for expected output
•Measure application performance under limited workload
•Service Virtualization
• End-to-end testing involves testing a user workflow from beginning to end
• E2E Test at Front End Web portals, Mobile Applications and COTs (BAU Team)
• Benchmarking application under varying load
• Software logic validation / system configurations
• Performance metrics (e.g. response time, failures, app method / DB query performance)
• Reuse of Global Variable, Assertions, Pre-request Script, Call Chain Workflow change, Data Record Sets, Header Source, Request Body Tags, End point URL
• Refactoring as per RCA
Test Module
• Automated
• Automation of API’s
• Manual for front-end portal
• Manual for Functional & Performance RCA
•Automated / Manual
•Manual for Usability / Compatibility / Client-Side Performance
•Automation / Manual
• Automated
• Manual / Automated
QK Responsibility
Dev Responsibility
Regression Strategy
Regression Strategy
BVT Pack
Lean Pack
Optimal Pack
Full Regression
Major releases or Enhancement going live
Addition of New Product - going live
Hot Fix - Emergency production fixes
Configuration and environment changes
Addition of New feature or Business Process to products (Process Enablement)
Changes of any features in the Business Processes
(Process Enhancement)
​Technology or platform update
Minor change
Defect fixing (low, medium, High, Showstopper)
Critical Path
Critical Functionality
All Major positive scenarios best fit combinations and unique flows
Critical Path
Scenarios that exercise all application integrations
Scenarios that exercise all application integrations
Impacted features on adjacent modules
End to end happy path
Critical Path
End to end happy path
All Major positive scenarios best fit combinations and unique flows
Critical Path
Impacted features as per impact matrix
Complex conditions that can force errors in journey
Scenarios that exercise all application integrations
Scenarios frequently encountered by users
Critical functionality
End to end happy path
Impacted features as per failed scenarios