Data Engineering Unlimited

The Data Engineering Unlimited Cloud Learning Subscription is a competency based training programme designed to bridge the gap between academia and industry in partnership with over 100 institutions and companies and equips you with the skills and knowledge to design, develop, deploy and manage databases.

You will gain proficiency with Data Integration techniques, extract, transport and load data- ETL into data warehouses, big data integration, data lakes, big data tools such as Apache Hadoop, MapReduce, Kafka, Oozie, ETL Pipelines with Flume, Sqoop, HDInsight and more.

On successful Completion of this course you will be able to:

• Describe Data Integration techniques such as ETL, ELT, EAI and EII
• Understand the differences between Data Integration and Data Wrangling
• Understand Open source and commercial data integration tools and platforms
• Understand the ETL Development Lifecycle
• Understand basic Data warehousing Concepts
• Understand basic Dimension Modelling
• Understand Data Quality Issues in ETL Process
• Understand the architecture of the complete Informatica system
• Design and build simple mappings and workflows
• Learn to Plan and Scope your Data Integration Projects
• Learn to Plan and Scope your Data Warehouse Projects
• Retrieve data from example database and big data management systems
• Learn how to model, transform and prepare data frames and visualize them
• Learn about table transformation - merging data, table information, transpose, group by, pivoting etc
• Describe the connections between data management operations and the big data processing patterns
• Describe the patterns needed to utilize them in large-scale analytical applications
• Identify when a big data problem needs data integration
• Gain a high-level understanding of big data and Hadoop
• Understand Hadoop Components: MapReduce and HDFS
• Understand Hadoop Components: YARN and Apache Tez