The global and independent platform for the SAP community.

All processes in harmony

Orchestrate with open source. Everything is going digital. Everything is being automated. But who keeps track? Which software do we trust to control the flow of all digital processes?
Markus Suhr, NextLytics
May 8, 2023
Open Source
avatar
This text has been automatically translated from German to English.

When it comes to orchestration services, it's worth taking a look at the open source world

The digital transformation is bringing companies more and more digital processes. These are more efficient than their analog predecessors and, in the best case, can be automated; their sequence is always traceable and the quality of the results can be checked at any time.

Many systems come with their own mechanisms for the automated control of processes, for example the SAP Business Warehouse with programmable process chains. These are generally limited to their own system context, and at the latest when processes extend across several systems, reliability and traceability are sacrificed and parachutes begin to be knitted.

Most systems provide advanced users with programming interfaces via which certain functions can be controlled by external programs. This circumstance prepares the field for orchestration services. Such a service is the framework for users to define complex process flows, have them executed based on configurable conditions, react to errors and deviations, and finally keep an overview of all processes and states.

What sounds so simple is a complex challenge. The very term orchestration contains the metaphor of a symphony orchestra, in which a multitude of instrument groups and individual musicians are guided to work together to create a harmony. A central orchestration service is as crucial to the quality of digital processes as the conductor is to the performance of a symphony.

So there is no way around the orchestration service. We inevitably come to the famous question: Make or Buy? Or more precisely, since a complete in-house development is not advisable in view of the given complexity: Which software fits my requirements best?

For every company, the answer may be different due to the specific framework conditions. Our experience with our customers is that the adaptability and extensibility of modern open source orchestration services are a decisive competitive advantage over proprietary products. The base of freely available extensions and connection modules to common business applications is enormous in the open source ecosystem and is constantly growing. If a specific connection is missing, it can be added without jeopardizing compatibility with the core system.

Apache Airflow is a lighthouse project among the open source orchestration services. Airflow is based on the Python programming language and goes so far as to define all process flows in source code. The entire operation can be based on fully versioned configuration files according to DevOps principles.

The possibilities for automating business processes with this framework are practically unlimited. Many companies use precisely these strengths to control cross-system processes between SAP and third-party systems. For example, data from SAP BW can be retrieved for automated machine learning model training in a non-SAP context and forecast data calculated on the basis of the models can be written back.

Integrating and operating such an open source orchestration service in the system landscape requires technical know-how and provides independence from the product lifecycle of proprietary software products. Last but not least, this path is an investment in the capabilities of your own team. Durable, open technologies as the basis for business process orchestration are a significant factor for the sustainability of deployed components.

avatar
Markus Suhr, NextLytics

Markus Suhr is team leader and consultant for Data Science and Data Engineering at NextLytics


Write a comment

Working on the SAP basis is crucial for successful S/4 conversion. 

This gives the Competence Center strategic importance for existing SAP customers. Regardless of the S/4 Hana operating model, topics such as Automation, Monitoring, Security, Application Lifecycle Management and Data Management the basis for S/4 operations.

For the second time, E3 magazine is organizing a summit for the SAP community in Salzburg to provide comprehensive information on all aspects of S/4 Hana groundwork.

Venue

More information will follow shortly.

Event date

Wednesday, May 21, and
Thursday, May 22, 2025

Early Bird Ticket

Available until Friday, January 24, 2025
EUR 390 excl. VAT

Regular ticket

EUR 590 excl. VAT

Venue

Hotel Hilton Heidelberg
Kurfürstenanlage 1
D-69115 Heidelberg

Event date

Wednesday, March 5, and
Thursday, March 6, 2025

Tickets

Regular ticket
EUR 590 excl. VAT
Early Bird Ticket

Available until December 20, 2024

EUR 390 excl. VAT
The event is organized by the E3 magazine of the publishing house B4Bmedia.net AG. The presentations will be accompanied by an exhibition of selected SAP partners. The ticket price includes attendance at all presentations of the Steampunk and BTP Summit 2025, a visit to the exhibition area, participation in the evening event and catering during the official program. The lecture program and the list of exhibitors and sponsors (SAP partners) will be published on this website in due course.