logo_migros-eng

Migros plans load tests before launching new retail advertising campaigns

Since 2021 we support our Migros partners with automated load and performance tests.

Headerbild_Referenz_migros

 

Mock-up_Migros (1)

 

About Migros 

Migros is one of the 50 largest retail companies in the world. The cooperative offers supermarkets, specialized stores and various services. The company is committed to improving standards in the food industry. Therefore, Migros pays attention to the highest quality standards: not least for their digital products.

_Zielscheibe-Icon

 

IN A NUTSHELL

QA goals  

  • Regular load tests before increased system access (e.g. through campaigns)
  • Insights into the system and user behavior

_Laptop-Haken-Icon

 

IN A NUTSHELL

Results 

  • Optimized loading times 
  • Certainty of a functioning system, especially before the start of the campaign

The project 

_Liste-Zahnrad-Icon Kopie 3Project type
Web testing 

_Weltkugel-Icon Kopie 3Industry
Retail 

_Hand-Zahnrad-Icon Kopie 3Service type
Test automation

_Liste-Zahnrad-Icon Kopie 3Projekttyp
Consulting

_Hand-Zahnrad-Icon Kopie 3Servicetyp
QA-Beratung

_Laptop-Haken-Icon Kopie 3QA-Services
QA-Analyse, Maturity Assessment, Strategie & Maßnahmen-planung

_Cloud-Wolke-Icon Kopie 3Genutzte Plattformen
Jira, Confluence

_Weltkugel-Icon Kopie 3Branche
Einzelhandel

Challenge 

As one of the leading operators of supermarkets and specialty stores in Switzerland, Migros runs large-scale advertising campaigns for customers, especially during seasonal events. On average, the Migros website system has to be checked once a month to avoid system outages. 


Goals and 
test frequency

The common goal is to use load tests to work out where adjustments need to be made: i.e. load needs to be distributed differently.

Load tests provide a good indication of the user experience for the regular placement of advertising campaigns. To this end, we are in regular dialogue with our partners and carry out a monthly load test on average. The tests for server load are particularly important for campaigns in order to test the most realistic expectations of user behavior.

Load tests offer stakeholders the opportunity to follow the test live with our experts. This distinguishes this variant from many other test methods. The discussion and evaluation of the results in a joint exchange efficiently promote the subsequent development measures.

Zitat_Anführungszeichen_Icon-1

"The professional support from Appmatics in testing, ensures the optimum performance and success of our digital campaigns and promotions."

logo_migros-eng
Belinda Belger,
Head of Digital Campaigning & Promotions
 

Test procedure

The case study: the Migros online counter. A seasonal campaign by Migros of products for the barbecue season.

1) Coding & Timing: The load tests for the Migros online counter were written approx. 2 weeks before the campaign went live. This corresponds to the average time of our load tests, which are usually carried out 2 to 3 weeks before a go-live.

Based on the internal Migros campaign analyses, a guideline value of 10,000 to 20,000 users per hour was defined for peak times. We write the tests based on this value. This involves converting how many users are expected per second. This value is initially used for testing in the ramp-up phase. A target value is set for the load, which is to be maintained over the duration.

2) Test start & test environment: Once coding is complete, the load test begins. Our Migros partners are present during the test and follow the test procedure. 

3) Tracking & load limits: During the test, our Appmatics experts take over the monitoring from the user's perspective. At the same time, Migros developers join in and track the fluctuations in the system. Various load limits are run through in the process. 

4) Analysis & troubleshooting: If fluctuations occur outside the previously defined limits, these are discussed and analyzed. Frequent errors are due, for example, to the logic of the system or the placement of elements. During the analysis, we develop an action plan to improve the page performance. The dev team makes the adjustments. We remain in close dialogue during this period. Transferred configurations in the code are retested by us. This allows our partners to ensure that the corrected errors rule out further undesirable consequences.

5) Load test again: Approximately one week later, another large-scale load test is carried out to ensure that the desired result has been achieved. In the case of the Migros online counter, all necessary adjustments could already be initiated after the first load test.

 

 


Result

The aim of the load test was to ensure that the expected traffic would be supported by the system when the online counter advertising campaign went live. The desired result: an unrestricted shopping experience for customers, regardless of the server load. 

A load limit of 400% of the nominal value was set for the Migros online counter. This had to be tested to see how the system behaved.

A key component of the load test cases are scenarios that realistically reflect the behavior of the users. The most frequent user actions are incorporated, weighted and assigned grace periods. This approach maximizes the system's infrastructure.

Load tests are among the automated test procedures. However, this example makes it clear that there is always a demand for the highest possible degree of realism. 

Four scenarios were defined for the Migros online counter. Each user in the load test is assigned to a scenario and weighted. The scenarios therefore flow directly into the load test and are tracked in their evaluation.

In the case of the Migros online counter, the result of the page performance was very responsive and only minor configuration problems occurred. Among other things, several activities of individual users were tested. Latency deviations occurred at these configuration points, which could be rectified based on the test results. After adjusting the load test results, the online counter campaign was launched as planned. 

Further case studies

zdf-heute-case-banner

AGILE TESTING

QA consulting for international trade and beyond

To the case study 

bvg-muva-case-banner

ACCESSIBILITY TESTING

BVG relies on usability tests to check accessibility

To the case study 

eurowings-digital-case-banner

MANUAL TESTING

Eurowings ensures the quality of travel & bookings through constant testing

To the case study 

Contact our team

Do you have questions about the project or your own QA challenge? Our team looks forward to hearing from you.