The Postgraduate Diploma in Big Data is an educational programme designed to provide you with the knowledge and skills needed to understand, manage and analyse large volumes of data. Through a combination of theory and practice, you will learn about the fundamentals of Big Data, data sources, the use of Open Data, all the phases of a Big Data project and the platform’s ecosystem Hadoop. The software will also be explored Weka and the techniques used in data mining. This diploma course offers you comprehensive training in the field of big data and prepares you to tackle the challenges and make the most of the opportunities offered by data science and the constant growth taking place in the field of big data.
Big Data
Introduction
Objectives
-
Understanding the fundamental concepts of the Big Data and its importance in today’s world.
-
To be familiar with the different sources of data and to understand the importance of selecting them.
-
Explore the use y benefits the use of Open Data in Big Data projects.
-
To learn the key stages involved in the planning, implementation and monitoring of Big Data projects.
-
To familiarise yourself with the ecosystem Hadoop and its relationship with Big Data.
-
Be proficient in tools such as HDFS, MapReduce, Apache Hive, Apache Hue and Apache Spark.
-
Using the software Weka and apply data mining techniques to data analysis.
Table of Contents
TEACHING UNIT 1. INTRODUCTION TO BIG DATA
What is Big Data?
The age of vast amounts of information. A history of big data
The importance of storing and retrieving information
Business-focused Big Data
Open Data
Public information
IoT (Internet of Things)
TEACHING UNIT 2. DATA SOURCES
Definition and significance of the selection of data sources
The nature of Big Data sources
TEACHING UNIT 3. OPEN DATA
Definition, Benefits and Features
Example of the use of Open Data
TEACHING UNIT 4. STAGES OF A BIG DATA PROJECT
Initial diagnosis
Project design
Implementation process
Project monitoring and control
Person in charge and available resources
Timetable
Scope and economic valuation of the project
TEACHING UNIT 5. THE HADOOP ECOSYSTEM
What is Hadoop? Its relationship with Big Data
Installation and configuration of the Hadoop infrastructure and ecosystem
HDFS file system
MapReduce with Hadoop
Apache Hive
Apache Hue
Apache Spark
TEACHING UNIT 6. WEKA AND DATA MINING
What is Weka?
Data Mining Techniques in Weka
Weka interfaces
Selection of attributes