Test automation in the SAP environment

E3: Testing is not a new topic in the SAP community?

Markus Helfen, Solutive: From a testing perspective, the S/4 transformation entails newly developed processes and a new user interface on a new technical platform, depending on the transformation method. Users must also ensure here that the mapping of their business processes has been mapped correctly by the implemented software. For this purpose, data-driven tests are still executed in different integration stages via the user interface.

E3: Some test support is also available in SolMan?

Help: However, with the announced end of maintenance for SAP Solution Manager, no further development will take place here. Manual tests can generally be organized well with the Test Suite. Also due to its free use, the test suite has achieved good acceptance among SAP customers over the years - especially since integration into the solution documentation, defect management and other convenient functionalities can be used here.

E3: And SAP Cloud ALM?

Help: The development of the test functionality in the non-successor SAP Cloud ALM must be measured against this. There is still sufficient time for users to observe, identify a suitable new target environment and switch to a new test suite. With the CBTA, SAP provides a test automation tool focused on SAP GUI and Fiori that can integrate a selection of other tools for automation beyond SAP solutions.

E3: Can test automation work across the full range of an ERP architecture in an end-to-end sense?

Help: There are internal and, in particular, organizational challenges that must be successfully addressed for the creation and long-term maintenance of test automation. At the beginning, topics such as test automation strategy, prioritization, scope management such as "automating the chaos runs the chaos faster", test case quality and test data management must be clarified with the tool question.

E3: So what is to be done?

Help: There are internal and, in particular, organizational challenges that must be successfully addressed for the creation and long-term maintenance of test automation. At the beginning, topics such as test automation strategy, prioritization, scope management such as "automating the chaos runs the chaos faster", test case quality and test data management must be clarified with the tool question.

E3: Where do you see the biggest advantages of test automation?

Help: After the initial investment, the greatest advantage is the relief of the specialist department from (routine) test tasks. No less valuable are the high execution speed, unambiguous results through stored tests and the exact and arbitrarily frequent repeatability. Test automation demonstrably increases application stability and allows significant, quantifiable effects such as increasing the test scope, shortening test cycles, and reducing the involvement of the business departments.

E3: Anyone approaching the topic of automated testing, what should they look out for?

Help: If you want to build high towers, you should deal with the foundation. Successful test automation is a combination of framework conditions, including commitment to the investment, test case quality, structured build, change and release processes, methodology such as automation strategy and implementation principles, and last but not least, tool expertise. 

E3: Based on what you know, will SAP offer full automated testing with Cloud ALM?

Help: SAP communicated early on that it would integrate Tricentis test automation into CALM. In this context, five test automation licenses and 500 test executions per month can be used free of charge as part of higher support forms. The retention period of the test results is limited to twelve months. This agreement is currently valid until July 31, 2026. Any requirements beyond that are subject to a fee. I myself am a fan of SAP test automation specialist Suxxesso, which currently integrates its Testpilot with SAP Cloud ALM and, of course, with Solutive's ESM suite.

E3: What is currently already available in the context of a test suite?

Help: Here I have the same level of information as all SAP users. The fact is that SAP Cloud ALM will not reach the level of SAP Solution Manager in the near future in the manual test environment despite bi-weekly feature packs - an IT organization must first be able to process this. The question is and remains for now to what extent SAP Cloud ALM as a cloud application with the target group of SAP cloud-centric customers with a Fit2Standard mentality will generally support a hybrid SAP solution landscape effectively. And how beyond that, if applicable. I have the feeling that alternative technologies are also coming more into focus.

E3: Thank you very much for the interview.

solutive.ag