Scaling your performance tests and when to start

By Bharadwaj Aryasomayajula

Elevator Pitch

At FINRA as the plan processor of Consolidated Audit Trail we handle in excess of 100 billion records amounting to over 1TB of data per day to be the world’s largest data repository on securities.How and when do you start load test of complex systems? Join us to discuss load testing complex systems.

Description

To ensure that the CAT System is able ingest and transform such volume along with abnormal trading spikes, FINRA’s assurance engineering team has built a stress testing framework on AWS in order to certify the ability for the CAT System to operate at 4X of the predicted workload.

Load Testing is often performed at the end of the SDLC lifecycle once all the functionality and integration has been verified. On projects with tight deadlines, this leaves very little time for performing load testing.

Following are some of the approaches and lessons learnt during our load testing:
  • What does load testing mean in present scenario?
  • Volume Testing
  • Stress Testing
  • Testing failover of the system
  • Testing fault tolerance of the application
  • Load Testing scripts vs Common Automation Frameworks
  • Simulating large amount of load (quality of load test data)
  • Running load tests across cloud based components
  • When to start load testing
  • Statistics for load testing. Why is it important?
  • How do I analyze load test on server less system?
  • hands-on with Jmeter on how to integrate with Load testing system

We learned lots of lessons from such a large scale stress test, which include capacity planning on the account and region level, and how to engineer big data applications to be resilient and fault tolerant along with the ability handle large data volumes.

Notes

what is load testing? We will be explaining how load testing has helped us and when should one start load testing. We will show what are different approaches to load testing and what we use? We will explain to users how to use Apache Jmeter and how to combine it with your functional automation to gain maximum advantages. How can load testing used for testing fault tolerance of the system