1. Core Auto - What it is?
1.1. Concept:
Core Auto is a tool that allows to integrate and monitor all processes run within the enterprise. Processes can be run on one or more servers while maintaining the connections between them. The tool includes two types of processing control programs:
- Batch manager (BT) for activating daily processing, for example feeding the data warehouse or big data system from source systems.
- Real Time (RT) type manager – for launching event handling processes. The whole thing is managed from a web application that integrates both mechanisms. The application allows you to configure the tool, monitor the running processes, and easily resume steps that ended with an error.
1.2. Unique features
A unique feature of Core Auto is the automatic optimization of processing and shortening it to the theoretical minimum - to the length of the critical path. For example, the BT manager, based on the analysis of previous runs, prepares a forecast of the critical path on a given day and organizes the processing so that the time to complete the entire supply is reduced to the length of the critical path. Even after the process was starting it is possible to change the objective function - for example, the user may be more interested in finishing the indicated DataMart as quickly as possible, while the duration of the entire supply may be considered a secondary criteria.
The RT manager behaves similarly in the case of events that require many steps to be handled.
The second unique feature of Core Auto is the built-in run simulators (applies to BT).The entire run simulator allows for optimal throttle setting, while the continuation simulator provides information on the expected completion time of steps that have not yet been completed.
Core Auto also supports the methodology of developing scripts that do not contain any credentials. Apart from the obvious security issue, it also allows easy transfer of codes between different environments without any changes.
