Autoplay
Autocomplete
Previous Lesson
Complete and Continue
Hadoop Developer In Real World
Thank You and Let's Get Started
Course Structure (11:03)
Tools & Setup (Windows) (9:09)
Tools & Setup (Linux) (7:42)
Introduction To Big Data
What is Big Data? (17:47)
Understanding Big Data Problem (14:24)
History Of Hadoop (3:46)
Test your understanding of Big Data
HDFS
HDFS - Why Another Filesystem? (13:20)
Blocks (7:50)
Working With HDFS (16:09)
HDFS - Read & Write (9:31)
HDFS - Read & Write (Program) (8:38)
Test your understanding of HDFS
HDFS Assignment
MapReduce
Introduction To MapReduce (8:51)
Dissecting MapReduce Components (18:03)
Dissecting MapReduce Program (Part 1) (12:00)
Dissecting MapReduce Program (Part 2) (16:09)
Combiner (6:20)
Counters (6:43)
Facebook - Mutual Friends (17:38)
New York Times - Time Machine (15:43)
Test your understanding of MapReduce
MapReduce Assignment
Apache Pig
Introduction to Apache Pig (12:52)
Loading & Projecting Datasets (13:41)
Solving a Problem (13:32)
Complex Types (21:12)
Pig Latin - Joins (19:53)
Million Song Dataset (Part 1) (10:29)
Million Song Dataset (Part 2) (15:01)
Page Ranking (Part 1) (8:11)
Page Ranking (Part 2) (19:26)
Page Ranking (Part 3) (12:16)
Test your understanding of Apache Pig
Apache Pig Assignment
Apache Hive
Introduction to Apache Hive (9:58)
Dissect a Hive Table (10:14)
Loading Hive Tables (11:17)
Simple Selects (6:07)
Managed Table vs. External Table (6:20)
Order by - Sort By - Cluster By (9:44)
Partitions (19:31)
Buckets (7:27)
Hive QL - Joins (9:21)
Twitter (Part 1) (9:33)
Twitter (Part 2) (8:43)
Test your understanding of Apache Hive
Apache Hive Assignment
Hive Window and Analytical Functions
Introduction to Hive Window and Analytical functions (8:04)
Kickstarter campaign duplicates and top campaigns (8:01)
Kickstarter campaign bands and user sessions (8:28)
Architechture
HDFS Architechture (12:46)
Secondary Namenode (11:24)
Highly Available Hadoop (8:48)
MRv1 Architechture (10:40)
YARN (11:22)
Test your understanding of Hadoop Architechture
Cluster Setup
Vendors & Hosting (6:35)
Cluster Setup (Part 1) (23:43)
Cluster Setup (Part 2) (25:35)
Cluster Setup (Part 3) (18:01)
Amazon EMR (15:46)
Test your understanding of Cluster Setup
Hadoop Administrator In Real World (Preview)
Cloudera Manager - Introduction (13:08)
Cloudera Manager - Installation (24:07)
File Formats
Compression (14:55)
Sequence File (18:32)
AVRO (19:08)
File Formats - Pig (18:08)
File Formats - Hive (11:03)
Introduction to RCFile (15:28)
Working with RCFile (15:14)
Introduction to ORC (20:53)
Working with ORC (12:03)
Parquet - Another Columnar Format (17:43)
Avro Schema and It's Importance (6:27)
Schema Evolution in Avro (Part 1) (9:32)
Schema Evolution in Avro (Part 2) (13:26)
Test your understanding of File Formats
Troubleshooting and Optimizations
Exploring Logs (8:49)
MRUnit (9:31)
MapReduce Tuning (12:39)
Pig Join Optimizations (Part 1) (17:17)
Pig Join Optimizations (Part 2) (13:56)
Hive - Join Optimizations (19:36)
Test your understanding of Troubleshooting & Optimizations
Apache Sqoop
Sqoop Imports (13:58)
Sqoop - File Formats (9:01)
Jobs & Incremental Imports (15:33)
Hive - Exports (7:30)
Apache Flume
Introduction to Flume (14:03)
Replication (14:03)
Consolidation & Mutliplexing (16:23)
Streaming Twitter with Flume (14:03)
Kafka
Kafka - The Why and the What (8:43)
Kafka Concepts (12:32)
Tolerating Failures - Producers and Consumers (12:51)
Tolerating Failures - Brokers (12:06)
Kafka Installation (10:20)
Experiments with Kafka (19:18)
Streaming Meetup with Kafka (Part-1) (14:17)
Streaming Meetup with Kafka (Part-2) (17:15)
Writing production ready Kafka application (12:09)
Schema management with Kafka Schema Registry (15:25)
Schema evolution with Kafka Schema Registry (15:23)
Bonus
Preparing For Hadoop Interviews (19:18)
Teach online with
Test your understanding of Hadoop Architechture
Lesson content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock