Data Engineering
Data Engineering
Course Features
Data Engineering Course Overview
Who Can Apply for the Data Engineering Course?
- Freshers and Undergraduates willing to pursue a career in data engineering
- Anyone looking for a career transition to data engineering
- IT professionals
- Experienced professionals willing to learn data engineering
- Technical and non-technical professionals with basic-level programming knowledge can also apply
- Project Managers
What Roles Does a Data Engineer Play?
Big Data Engineer
They design and build complex data pipelines and have expert knowledge in coding using Python, etc. These professionals collaborate and work closely with data scientists to run the code using various tools such as the Hadoop ecosystem, etc.
Data Architect
They are typically the database administrators and are responsible for data management. These professionals have in-depth knowledge of databases, and they also help in business operations.
Business Intelligence Engineer
They are skilled in data warehousing and create dimension models for loading data for large-scale enterprise reporting solutions. These professionals are experts in using ELT tools and SQL.
Data Warehouse Engineer
They are responsible for looking after the ETL processes, performance administration, dimensional design, etc. These professionals take care of the full back-end development and dimensional design of the table structure.
Technical Architect
They design and define the overall structure of a system to improve the business of an organization. The job role of these professionals involves breaking large projects into manageable pieces.
Course Curriculum
- Introduction to SQL
- Database Normalization and Entity Relationship Model
- SQL Operators
- Join, Tables, and Variables in SQL
- Deep Dive into SQL Functions
- Subqueries in SQL
- SQL Views, Functions, and Stored Procedures
- User-defined Functions in SQL
- SQL Optimization and Performance
- SQL Parsing
- Managing Database Concurrency
- Python Basics
- OOPs Concept
- NumPy
- Pandas
- Data Visualization
- File Handling
- Exception Handling
- Regular Expressions Fundamentals
- Introduction to Linux
- File System Navigation
- File and Text Manipulation
- User and Group Management
- Process Management
- System Configuration and Networking
- System Monitoring and Logging
- Shell Scripting
- Security and Permissions
- Advanced Linux Commands
- Basic Concepts of Data Modelling
- Business Data Requirements – Entities and Classes
- Business Data Requirements – Attributes
- How To Link Things Together – Relationships
- Requirements Analysis
- Conceptual Data Modeling
- Logical Data Modeling
- Physical Data Modelling
- Data Modelling Tools and Techniques
- Data Modelling Documentation and Communication
- AWS Basics
- Amazon Kinesis
- Amazon MSK (Managed Streaming for Apache Kafka)
- AWS Glue
- Amazon EMR (Elastic MapReduce)
- Amazon S3 (Simple Storage Service)
- Amazon S3 Glacier
- DynamoDB
- AWS Redshift
- Amazon Athena
- Amazon QuickSight
- Introduction to Microsoft Azure
- Authentication, Authorization, and Monitoring
- Data Storage and Integration
- Azure Synapse Analytics and Databricks
- Azure Stream Analytics, and Azure Service Bus
Introduction to Airflow
- Introduction to Airflow
- Testing a Task in Airflow
- Examining Airflow Commands
- Airflow DAGs
- Defining a Simple DAG
- Working With DAGs and the Airflow Shell
- Troubleshooting DAG Creation
- Airflow Web Interface
- Starting the Airflow Webserver
- Navigating the Airflow UI
- Examining DAGs With the Airflow UI
- Introduction to Apache Spark
- PySpark SQL and Data Frames
- Apache Kafka and Flume
- PySpark Streaming
- Introduction to PySpark Machine Learning
- Introduction to DevOps
- Git
- Docker
- Kubernetes
- Jenkins
- Introduction to Power BI
- Data Extraction
- Data Transformation – Shaping & Combining Data
- Data Modeling & DAX (Data Analysis Expressions)
- Data Visualization with Analytics
- Power BI Service (Cloud), Q & A, and Data Insights
- Power BI Settings, Administration & Direct Connectivity
- Embedded Power BI with API & Power BI Mobile
- Power BI Advance & Power BI Premium
Enroll for a Jagathi IT Online courses Today!
Student’s Testimonial
How You Benefit From This Program
- 1 -1 Mentor coaching and Career support
- 30% Average Salary Hike
- 500+ Hiring Partners
- Guidance from Corporate Specialists
- Participate in workshops and live webinars