Skip to main content

Module 8: Big Data & Cloud

Weeks 41 to 45. So far you have learned data analysis, statistics, machine learning, deep learning and Generative/Agentic AI. All of that ran on a single laptop . In this module you will see how work gets done when data becomes so big that one computer cannot handle it : the principles of Big Data, Apache Spark (PySpark), and Cloud computing (AWS or Azure) . Then, in class projects and home projects , you will combine all of these to build real pipelines .

ChapterWeekTopics
41Week 41Big Data (5 Vs, HDFS, MapReduce, Parquet, partitioning, batch vs streaming)
42Week 42Apache Spark (RDD, DataFrame, SQL, lazy evaluation, join, window, Parquet, MLlib)
43Week 43Cloud Computing: AWS or Azure (IaaS/PaaS/SaaS, IAM, storage, cost, data pipeline)
44Week 44Class-Based Projects (Retail ETL, Cloud Data Lake, Log Analysis)
45Week 45Home-Based Projects (Big Data Analytics, Cloud Pipeline, Streaming Monitor)

Chapters​

Module Test​

Module 8 Test.