Course Content
1 big data pre requisite session
2 big data execution learning plan discussion
3 hadoop evolution deep cloud touch
4 hdfs 1.0 cluster adminstration setup details
5 hadoop metadata management 2.0
6 linux commands hdfs commands intro
7 hdfs commands deep handson
8 hdfs aws cloud integration sqoop intro
9 sqoop design deep command first import sqoop controlling import where
10 sqoop query imports incremental import
11 sqoop password field automation job cloud intro
12 sqoop cloud imports aws azure gcp serialization intro
13 serialized deep file formats
14 sqoop avro serialization multi mappers hive intro
15 hive vs sql deep hive table creation hdfs integration
16 hive table creation data loads location types of tables
17 hive types of tables deep partitions static load
18 hive static insert dynamic partitions revision
19 hive cloud analytics avro schema evolution project
20 hive performance tuning spark intro lazy evaluation
21 spark vs mr performance tuning deployment intro
22 pyspark ways to process data file read
23 pyspark list iteration lambda operations
24 pyspark usecase string iterations flatmap map
25 pyspark file processing iterations
26 pyspark rdd to dataframe conversion file reads
27 pyspark semi structured data read file reads dsl intro
28 pyspark dsl processing select drops filters
29 pyspark deel dsl withcolumn scenarios
30 pyspark dsl anti join cross join
31 pyspark aggregations windowing revision
32 pyspark complex data processing intro writes
33 pyspark complex data processing deep dive
34 pyspark complex data 3rd type deep dive aws intro
35 aws intro s3 emr step function resume building
36 pyspark aws emr project deployment step functions api s3 snowflake
37 pyspark emr detail project deployment aws
38 pyspark aws s3 handson cli
39 pyspark s3 deep handson ec2 creation aws
40 pyspark emr development and deployment deep
41 pyspark emr step function automation secret aws secret manager
42 aws athena spark scala intro
43 spark scala deep dive aws deployment
44 nifi data flow orchestration
45 streaming intro workshop
46 kafka deep dive nifi integration
47 kafka deep dive consumption models isr
48 pyspark streaming kafka integration aws kinesis integration
49 google cloud gcp pyspark deployment cloud function
50 azure datapipeline hdinsight datafactory
51 nosql database cassandra spark integration
About this course
Enroll for Free
This course includes:
- 51 modules
- Comprehensive reading materials
- Full lifetime access