![]() ![]() If it takes longer, then we advise you to switch to real-time ETL.įigure 1: The ETL process and associated architecture. A maximum of 2 hours is an acceptable limit here. So the key is to make sure your ETL can run quickly and is done on time. If the overall ETL process takes too long, it won’t be ready in the morning and the numbers on your dashboard won’t be updated. Each process is responsible for a piece of the total transformation you want to achieve. For example, to update a data warehouse every night you might need two hundred ETL processes. Often not one process is needed but several. Read more about ETL Tools The complete ETL process in one visualĪs explained earlier, every ETL process consists of three major steps: extraction, transformation and loading. What is the relationship between ETL and BI? With BI you want to be able to monitor and analyze data quickly via reports, dashboards or algorithms and then you need a solid data infrastructure that you can create with ETL. The amount of the bill you get depends on the size of the data, the number of users or the duration of the ETL process. With “ETL as a service” or “SaaS ETL” you make data integration available on demand. The ETL data integration can take place via and in the cloud (cloud ETL) or simply on an ETL server in your own data center. This can be a data warehouse, a CRM system where you want to be able to view customer data from other systems or a file that an analyst or controller, for example, wants to use to perform an analysis.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |