Big Data Systems Fundamentals

Course details

Part -1 Linux Administration for Big Data
 
Linux and its Eco-system: History, Open Source Philosophy, Distributions
Installation of Linux OS with tips and tricks
Linux file system
Linux users groups and permissions
Introduction to yum & dnf package managers
Basic file commands
Basic process commands
Basic network commands
Basic monitoring commands
Basics of ssh and ssh keys
Using the man pages
Introduction to AWK and SED commands
Shell scripting
Introduction to Services Management
 
Part -2  Introduction to Big Data
 
Characteristics of Big Data, What are the V’s of Big Data and The Impact of Big Data on modern business
Sources of Big Data, Today's Examples and Impacts, Adoption rate
Data Science role in Big Data Systems
The Big Data Platforms and Eco-systems
Skills for various Big Data roles
Big Data use cases: 1- 360 Customer Overview
Big Data use cases: 2- Security and Intelligence
Google Papers: 2003 and 2004
Hadoop and Big Data systems characteristics
Hadoop HDFS
Hadoop Map-Reduce
Writing Hadoop jobs
Introduction to Hadoop yarn
Hadoop eco-system
Hadoop SQL like DB: Hive
Hadoop ETL System like: NiFi
Queueing Systems: Kafka
Real Time analysis vs Batch processing
Real Time analysis system implementation
Real Time analysis using storm
Storm Use case
Batch Processing
Batch processing system Implementation
Batch Processing using Spark
Spark Use case
Conclusion & Recap

  Updated on 16 February, 2021