![]() One way Twinformatics is able to get the highest possible risk coverage with minimal effort is via the native Tosca-NeoLoad integration that enables you to convert functional tests into performance tests with one click. And now we’re doing this too for load and performance tests,” explains Bonner. Now, with Tosca and our risk-based regression testing, we have a target of 70-80% coverage, with 70-80% of this coverage automated. “Before Tosca, we had - depending on who you asked - something like 10-20% coverage, without really having any real idea. Tosca’s combined smart test case design and requirements prioritization helps Twinformatics align testing activities with business priorities, focus software testing resources on the tasks that matter most to the business, and stop creating, maintaining, and running tests that don’t add value. Twinformatics has been way ahead of the curve on tackling this challenge, having adopted Tosca and its risk-based test optimization approach some 16 years ago. In other words, it doesn’t matter how many tests are run if teams are not testing what’s most important. A common problem with traditional testing approaches is that they focus on counting the number of test cases run, rather than on measuring business risk. What’s particularly noteworthy about this 90X boost in testing is not the overall number of tests, but the increased risk coverage. And we now cover 7X more systems,” adds Gaida. We’ve gone from executing four test cases a year to about 365 - a 90X increase. We have reduced the maintenance for each test set from 20 man-days to four to five hours. So the effort is not as great as with JMeter. “With NeoLoad frameworks, the ‘rules’ change the parameters automatically and correctly for each test iteration. But NeoLoad technology updates only the part of the test that has changed and re-uses the rest, keeping variable extractors, think times, SLAs, loops, JavaScript, validations, and more from the original design. Whenever an application changes or somebody modifies something in the flow of the test scenario, the test script breaks and it takes forever to fix. Legacy script-based testing tools like JMeter or LoadRunner are susceptible to notoriously fragile tests. The biggest game-changer is NeoLoad’s automatic test update. With its frameworks approach, NeoLoad also automates the time-consuming, painful task of correlating dynamic parameters and variables. Users can create even large, complex tests without the hassle of coding by hand. NeoLoad is different because everything about test design is drag-and-drop. Specifically, while JMeter has a GUI with record/playback capabilities, testers still need some specialized coding expertise to further customize scripts. And it’s easier to record new test scenarios. “I had experience load testing with NeoLoad for a few years, so I knew it would meet our requirements for iterative load testing for different applications and platforms with low maintenance effort. Gaida knew they needed a better solution. Wolfgang Gaida, Test Manager at Twinformatics, also saw issues with JMeter and explained that once Twinformatics opened up its software to its customers, “We started seeing performance and stability issues in production when there were, say, 100 or 200 concurrent users. “Then it was an easy business case to go with Tricentis NeoLoad.” This was costing us something like €80,000, so it was obvious that we needed a solution that takes less maintenance effort,” says Bonner. So we had to dedicate ~80 man-days per year just for maintenance. “The original plan was to run performance tests with every major release, four times a year. Twinformatics started load testing with JMeter but found it required a lot of effort to create and maintain its test cases. ![]() ![]() Quality and performance is a big business issue now,” says Bonner. “Performance testing is important to ensure that whatever we show our customers is really working and performing. For example, they could sign up for an insurance policy. Twinformatics then decided to open up its applications to customers and allow them to directly interact with the core systems through a web frontend. There was limited risk since any performance issues were kept within the insurance company and not visible to customers. The company started with testing software mainly with its internal users. Markus Bonner oversees Release/Test Services at Twinformatics. After all, the competition is only a click away. If they don’t get it, they’ll look elsewhere. They expect a fast, frictionless Amazon-like end-to-end digital experience - on any device, anytime, anywhere. In today’s ultra-competitive insurance industry, potential customers and policyholders have zero tolerance for slow or buggy applications.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |