.png)
Performance Testing Strategy
Discovery
Development
Execution
Analysis
• Understanding application architecture
• Requirement analysis
• Design & Develop JMeter based scripts & Scenarios
• Test environment & Test data readiness
• Isolated and Integrated Load and scalability Test
• Endurance Test
•Conduct RCA and share recommendation of identified issues
Objectives
• Prepare detailed Test Strategy
• Identify support required from DB stakeholders
• Create automated scripts for identified scenarios
• Utility creation for bypassing encryption
• Multiple cycles of Load Test to achieve defined concurrency
• Highlight performance issues with DB Stakeholders
• Log Analysis
• AWR Analysis
• Recommendation on capacity sizing
Key Activities
• Performance Test Strategy document for CBS Application
• JMeter scripts
• Dynatrace configuration for API services under PT scope
• Share Load test report for the number of cycle performed
• Analysis of test results
• Initial Run Report, Issue Tracker, Closure report
• Final Closure report
Deliverables
Execution Approach
Six Stage Performance Testing approach to be followed for Finacle CBS
Stage 1: Scale branch module in Isolation
Branch
Stage 2: Scale individual surround channels in isolation
Channels & ISOs
Stage 3: : Scale Payment Services module
Payment Services
Stage 4: Scale Critical Batch Jobs
Batch Jobs
Stage 5: Integrated test combining all workloads
Stage 6: Re-Test after fixes and Final benchmarking
Core Banking
Optimisation
Continuous Performance Assurance Framework
DTaaS (Digital Testing as a Service)
• Device level “performance experience” service integrated to a globally available digital platform.
• Adapt seamlessly to legacy & disruptive methodologies
• Real time devices, SIM card, carrier network, Bluetooth & Wi-fi impact on mobile app
• Easy and fit for purpose engagement & pricing models.
•“Pocket-sized" negative sentiments on social media hampering business
•Testing across lacs of devices, browsers, OS versions, speed combinations
•Simulate real time scenarios like n/w fluctuations and interrupts
•Launch new offerings within shortest time intervals
•Lower time to value / market to open new revenue streams
•Significantly cut down on cost of quality and operations
• Device level “performance experience” service integrated to a globally available digital platform.
• Adapt seamlessly to legacy & disruptive methodologies
• Real time devices, SIM card, carrier network, Bluetooth & Wi-fi impact on mobile app
• Easy and fit for purpose engagement & pricing models.
•10X coverage within available scenarios
•First & last mile quality gates – 99% reliability on release / hot fix testing
•Reduce GTM timeline for scheduled upgrades up to 70%
•Regression cycle times reduced up to 80%
•Overall savings on cost of service by minimum 50% against traditional models
“Digital performance experience is key to achieve competitive advantage”
“Increase revenue by driving customer engagement & achieving customer delight”
Shift Left Performance Testing
• Save Infrastructure Cost:
• No need for a dedicated environment
• Sufficient time to tune defects identified
• Less effort needed to fix performance defects
• Has no impact on the critical path
Early PT
Workload analysis
• Workshops with key stakeholders (business and architecture teams)
• Review of production logs for understanding the usage patterns
Configuration Review
• Review of application and database configuration parameters
• Analyse optimal parameter settings for the anticipated workload
• Provide recommendations as per industry standards / best practices
Defect Detection
• Setup monitoring mechanisms (application logs analyser/profilers) in UAT environment
• Run single user tests
•Identify performance hotspots (methods / database queries)
• Record and assign defects to the appropriate teams
Server-Side Performance Testing
Scalability Test
• Scaling application to desired concurrent users
• Improve Application Performance by reduction / rectifying application errors, response times and hardware resources
Endurance/ Soak Test
• Benchmarking application for prolonged duration (business hours)
• Identify Optimal usage of resources for longer duration
• Understand system behavior in different combinations of concurrency
Breakpoint Test
• Identify Application Breakpoint or Threshold
• Understanding application response while withstanding scenarios in various load profiles
• Helps in Capacity Planning
WAN Test
• Improve end user response time when the application is accessed over different bandwidth speed
• Improved Customer Experience
Performance Test
•Save Infrastructure Cost:
Seamlessly scale to higher users on the same infrastructure
•Verify Application Availability
•Build and Sustain Performance