⤵️ Quick shortcut: Select the module you’re currently studying ⤵️

  Courses      Module 1     Module 2      Module 3     Module 4     Module 5     Module 6    

👉 Welcome to Module 1: Data Ingest!

This module is designed to help you understand, implement, and practice the fundamentals of data ingestion pipelines. You'll gain hands-on experience building scripts and working with cloud services to manage real-world data efficiently.

Module Overview

Objective: Learn to gather and store raw input data for processing.

Lesson Structure

Each lesson contains:

1. Video Lecture 

2. Hands-On Coding Session: 

3. Activities & Assignments: Practice exercises to apply your knowledge.

4. Quiz: Short quiz to test your understanding.

5. Resources: Links to external documentation and courses for deeper learning.

What You´ll Learn in Module 1

• Lesson 1: Understanding Data Sources

  • Types of data: Databases, APIs, and file uploads.

  • Differences between real-time and batch ingestion.

• Lesson 2: Setting Up Cloud Storage (AWS S3)

  • Create your own AWS account and set up an S3 bucket.

  • Learn to upload data programmatically using Python and boto3.

• Lesson 3: Building a Data Ingestion Script

  • Connect to a database, fetch data, and store it locally.

  • Automate data uploads to AWS S3.

Course Navigation and Tools

Course Dashboard

• Video lectures and downloadable materials are organized in the dashboard.

• Hands-on labs and coding environments are integrated (e.g., AWS, Jupyter).