Against a backdrop characterised by the digitisation and data analysis, our course provides an essential foundation for understanding and managing enterprise information architecture. We will delve into ETL processes – which are vital for data transformation and transfer – and into the effective organisation of data, whilst exploring the various types of databases, both relational and NoSQL. We will explore data organisation models and techniques for database optimisation, preparing participants to tackle current challenges in any sector. Furthermore, the section on data warehouses and data marts will provide an understanding of how they work and how to make the most of the stored data, including an examination of leading platforms such as Amazon RedShift. This course Data transformation and organisation: Data warehouses, data marts and end-to-end ETL It is a crucial step for those seeking to keep up to date with the demands of managing large volumes of information and turning them into strategic decisions, without the pressure of having to become a specialist overnight.
Data transformation and organisation: Data warehouses, data marts and ETL
Introduction
Objectives
-
Understanding the logic ETL and its key use.
-
Drive data using current ETL tools.
-
Discover Data warehouse and data marts.
-
Explore Database relational and NoSQL.
-
Learn about columnar databases and optimisation.
-
Designing and utilising data in Data Marts.
-
Assess Inmon and Kimball in DWH.
Table of Contents
TEACHING UNIT 1. ETL PROCESSES
Introduction to ETL
ETL tools
ETL process elements
Microsoft SSIS ETL
Comparison of tools
TEACHING UNIT 2. ORGANISATION OF DATA (I)
Introduction and trends in the data
Relational databases (I)
Relational databases (II)
NoSQL databases
SQL vs NoSQL Comparison
TEACHING UNIT 3. ORGANISATION OF DATA (II)
Data organisation models
Columnar Databases
Optimising Databases (I)
Optimising Databases (II)
Relational database design
TEACHING UNIT 4. DATA WAREHOUSES AND DATA MARTS
Data Warehouse
Inmon v Kimbal
Analysing DWH data
Data Mart
Amazon RedShift