Course Content
day 1 big data intro
day 2 workshop
3 software overview big data basics evolution
4 hdfs 1.0 architecture
5 hdfs metadata management 2.0 architecture
6 hdfs federation linux hdfs commands intro
7 linux and hdfs commands
8 sqoop intro handson multi mappers
9 sqoop multi mappers control imports incremental append
10 sqoop incremental job and last modified
11 sqoop last modified deep dive and semi structured formats
12 sqoop serialization export staging1
13 sqoop performance tuning hive intro
14 hive intro thoery handson db table data loads
15 hive types of tables location hdfs loads
16 hive partitions static load
17 hive static insert partitions dynamic partitions sub partitions
18 aws hive cloud analytics
19 hive avro schema evolution and automation
20 hive bucketing dml project explanation
21 spark intro lazy evolution in memory computation
22 spark eclipse set up cluster deployement
23 spark rdd intro list iterations
24 spark rdd schema rdd intro
25 spark rdd joins spark row rdd dataframe conversion
26 spark seamless semi structured data reads-writes
26 spark extra class path deployment modes partition writes
27 spark revision usecase
28 spark covid use case revision
29 spark domain specific language
30 spark domain specific deep dive with column
31 spark complex json struct data processing and generation
32 spark complex array data processing and generation
33 spark xml data handling hive integration
34 spark hive integration deep rdbms integration aws s3 integration
35 hbase intro cap theorem project 3
37 phase 2 project hbase hive integration hbase handson
38 spark hbase integration pyspark intro
39 pyspark rdd dataframe operations resume building
40 aws intro s3 commands integration
41 aws s3 commands ec2 emr spark deployment
42 aws emr spark deployment command runner
43 project 4
44 spark aws emr project deployement
45 nifi intro data flow ingestion
46 nifi aws s3 write spark streaming consumption
47 cassandra intro handson spark integration
48 streaming intro kafka spark memory optimization
49 spark streaming kafka handson
50 kafka isr consumption model aws spark kinesis streaming
51 yarn architecture spark structured streaming kafka
52 git version control
About this course
Enroll for Free
This course includes:
- 52 modules
- Comprehensive reading materials
- Full lifetime access