File Formats - Pig | Big Data In Real World

Autoplay
Autocomplete

Previous Lesson Complete and Continue

Hadoop Developer In Real World

Thank You and Let's Get Started

Course Structure (11:03)
Tools & Setup (Windows) (9:09)
Tools & Setup (Linux) (7:42)

Introduction To Big Data

What is Big Data? (17:47)
Understanding Big Data Problem (14:24)
History Of Hadoop (3:46)
Test your understanding of Big Data

HDFS

HDFS - Why Another Filesystem? (13:20)
Blocks (7:50)
Working With HDFS (16:09)
HDFS - Read & Write (9:31)
HDFS - Read & Write (Program) (8:38)
Test your understanding of HDFS
HDFS Assignment

MapReduce

Introduction To MapReduce (8:51)
Dissecting MapReduce Components (18:03)
Dissecting MapReduce Program (Part 1) (12:00)
Dissecting MapReduce Program (Part 2) (16:09)
Combiner (6:20)
Counters (6:43)
Facebook - Mutual Friends (17:38)
New York Times - Time Machine (15:43)
Test your understanding of MapReduce
MapReduce Assignment

Apache Pig

Introduction to Apache Pig (12:52)
Loading & Projecting Datasets (13:41)
Solving a Problem (13:32)
Complex Types (21:12)
Pig Latin - Joins (19:53)
Million Song Dataset (Part 1) (10:29)
Million Song Dataset (Part 2) (15:01)
Page Ranking (Part 1) (8:11)
Page Ranking (Part 2) (19:26)
Page Ranking (Part 3) (12:16)
Test your understanding of Apache Pig
Apache Pig Assignment

Apache Hive

Introduction to Apache Hive (9:58)
Dissect a Hive Table (10:14)
Loading Hive Tables (11:17)
Simple Selects (6:07)
Managed Table vs. External Table (6:20)
Order by - Sort By - Cluster By (9:44)
Partitions (19:31)
Buckets (7:27)
Hive QL - Joins (9:21)
Twitter (Part 1) (9:33)
Twitter (Part 2) (8:43)
Test your understanding of Apache Hive
Apache Hive Assignment

Hive Window and Analytical Functions

Introduction to Hive Window and Analytical functions (8:04)
Kickstarter campaign duplicates and top campaigns (8:01)
Kickstarter campaign bands and user sessions (8:28)

Architechture

HDFS Architechture (12:46)
Secondary Namenode (11:24)
Highly Available Hadoop (8:48)
MRv1 Architechture (10:40)
YARN (11:22)
Test your understanding of Hadoop Architechture

Cluster Setup

Vendors & Hosting (6:35)
Cluster Setup (Part 1) (23:43)
Cluster Setup (Part 2) (25:35)
Cluster Setup (Part 3) (18:01)
Amazon EMR (15:46)
Test your understanding of Cluster Setup

Hadoop Administrator In Real World (Preview)

Cloudera Manager - Introduction (13:08)
Cloudera Manager - Installation (24:07)

File Formats

Compression (14:55)
Sequence File (18:32)
AVRO (19:08)
File Formats - Pig (18:08)
File Formats - Hive (11:03)
Introduction to RCFile (15:28)
Working with RCFile (15:14)
Introduction to ORC (20:53)
Working with ORC (12:03)
Parquet - Another Columnar Format (17:43)
Avro Schema and It's Importance (6:27)
Schema Evolution in Avro (Part 1) (9:32)
Schema Evolution in Avro (Part 2) (13:26)
Test your understanding of File Formats

Troubleshooting and Optimizations

Exploring Logs (8:49)
MRUnit (9:31)
MapReduce Tuning (12:39)
Pig Join Optimizations (Part 1) (17:17)
Pig Join Optimizations (Part 2) (13:56)
Hive - Join Optimizations (19:36)
Test your understanding of Troubleshooting & Optimizations

Apache Sqoop

Sqoop Imports (13:58)
Sqoop - File Formats (9:01)
Jobs & Incremental Imports (15:33)
Hive - Exports (7:30)

Apache Flume

Introduction to Flume (14:03)
Replication (14:03)
Consolidation & Mutliplexing (16:23)
Streaming Twitter with Flume (14:03)

Kafka

Kafka - The Why and the What (8:43)
Kafka Concepts (12:32)
Tolerating Failures - Producers and Consumers (12:51)
Tolerating Failures - Brokers (12:06)
Kafka Installation (10:20)
Experiments with Kafka (19:18)
Streaming Meetup with Kafka (Part-1) (14:17)
Streaming Meetup with Kafka (Part-2) (17:15)
Writing production ready Kafka application (12:09)
Schema management with Kafka Schema Registry (15:25)
Schema evolution with Kafka Schema Registry (15:23)

Bonus

Preparing For Hadoop Interviews (19:18)

Teach online with

File Formats - Pig

Lesson content locked

If you're already enrolled, you'll need to login.

Enroll in Course to Unlock