Module 8: Big Data & Cloud
Weeks 41 to 45. So far you have learned data analysis, statistics, machine learning, deep learning and Generative/Agentic AI. All of that ran on a single laptop . In this module you will see how work gets done when data becomes so big that one computer cannot handle it : the principles of Big Data, Apache Spark (PySpark), and Cloud computing (AWS or Azure) . Then, in class projects and home projects , you will combine all of these to build real pipelines .
| Chapter | Week | Topics |
|---|---|---|
| 41 | Week 41 | Big Data (5 Vs, HDFS, MapReduce, Parquet, partitioning, batch vs streaming) |
| 42 | Week 42 | Apache Spark (RDD, DataFrame, SQL, lazy evaluation, join, window, Parquet, MLlib) |
| 43 | Week 43 | Cloud Computing: AWS or Azure (IaaS/PaaS/SaaS, IAM, storage, cost, data pipeline) |
| 44 | Week 44 | Class-Based Projects (Retail ETL, Cloud Data Lake, Log Analysis) |
| 45 | Week 45 | Home-Based Projects (Big Data Analytics, Cloud Pipeline, Streaming Monitor) |
Chapters
- Chapter 41: Big Data
- Chapter 42: Apache Spark
- Chapter 43: Cloud Computing (AWS or Azure)
- Chapter 44: Class-Based Projects
- Chapter 45: Home-Based Projects