Find out what ETL processes are and what their main applications are. Take note of what happens in each of their phases.
ETL processes are one part of data integration, but it is an important element whose function completes the result of the entire development of the cohesion of applications and systems.
The word ETL corresponds to the acronym in English for:
• Extract: extract.
• Transform: transform.
• And Load: load.
By this, we mean that every ETL process consists of precisely czech republic number dataset three phases: extraction, transformation and loading. Let's define what each of these phases consist of.
Extraction Phase in ETL processes
In order to correctly carry out the extraction process, the first phase of the ETL processes,
the following steps must be followed:
● Extract the data from the source systems.
● Analyze the extracted data by obtaining a check.
● Interpret this check to verify that the extracted data complies with the
expected pattern or structure. If not, the data should be rejected.
● Convert the data to a format ready to begin the transformation process.
In addition, one of the most important precautions to take into account during the extraction process would be to always demand that this task causes a minimal impact on the source system . This requirement is based on practice since, if there is a lot of data to be extracted, the source system could slow down and even collapse, causing it to no longer be able to be used normally for daily use.
ETL Processes: The Basis of Business Intelligence
ETL processes: Transformation phase
The transformation phase of ETL processes applies a series of business rules or functions to the extracted data to convert it into data to be loaded . These guidelines can be declarative, they can be based on exceptions or restrictions, but to enhance their pragmatism and effectiveness, it is necessary to ensure that they are:
Declarative.
Independents.
Claras.
Intelligible.
For a useful business purpose.
Loading Process: The culmination of ETL processes
In this phase, data from the previous phase (transformation phase) is loaded into the target system. Depending on the organization's requirements, this process can involve a wide variety of different actions.
There are two basic ways to develop the charging process:
Simple accumulation : this way of loading data consists of summarizing all the transactions included in the selected time period and transporting the result as a single transaction to the data warehouse, storing a calculated value that will typically consist of a sum or an average of the magnitude considered. This is the simplest and most common way of carrying out the loading process.
What are ETL processes?
-
- Posts: 1092
- Joined: Tue Dec 24, 2024 4:27 am