Job Description

Job Title: Azure Data Engineer

Experience: 4–6 Years
Location: Bangalore / Chennai / Hyderabad (Hybrid)
Employment Type: Full-Time

Job Summary

We are seeking a skilled Azure Data Engineer with strong experience in building, optimizing, and maintaining scalable data pipelines on Azure. The ideal candidate will have hands-on expertise in Azure data services, strong data modeling skills, and experience in ETL/ELT processes along with production support exposure.

Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure data services
Build and manage ETL/ELT workflows using Azure Data Factory and Azure Databricks
Develop and optimize data transformation logic using PySpark and Databricks SQL
Handle structured and semi-structured data (JSON, Parquet, XML, CSV, etc.)
Collaborate with cross-functional teams to ensure smooth data integration and delivery
Provide production support, ensuring SLA adherence and timely issue resolution
Perform data migration from on-premise systems to Azure cloud
Optimize performance for large-scale data ingestion and processing
Implement data security best practices across Azure services
Participate in Agile ceremonies and ensure timely project delivery
Analyze business requirements and translate them into scalable data models
Perform reverse engineering of existing data systems and suggest improvements
Technical Skills Required
Azure Data Stack
Strong experience with:
Azure Data Factory (ADF)
Azure Data Lake
Azure Synapse Analytics (MPP)
Azure Logic Apps
Big Data & Processing
Hands-on experience with:
Azure Databricks
PySpark
Databricks SQL
Delta Lake
Data Engineering Concepts
Strong understanding of:
Data Warehousing concepts
ETL/ELT processes
Slowly Changing Dimensions (SCD)
Data Modeling (Conceptual, Logical, Physical)
Databases
Strong SQL skills:
Stored Procedures
CTEs
Functions
Query Optimization
Experience with:
Relational Databases
NoSQL Databases
Data Integration
Experience with data ingestion from:
Relational Databases
FTP
SAP
Handling multiple file formats (JSON, CSV, XML, Parquet)
Additional Skills
Experience with production support and SLA-driven environments
Knowledge of Azure security best practices
Performance tuning (partitioning, cluster optimization, code optimization)
Experience with large-scale data migration projects (On-Prem to Cloud)
Familiarity with CI/CD pipelines (ADF, Databricks, SQL deployments)
Strong analytical and problem-solving skills
Excellent communication and stakeholder management
Preferred Qualifications (Nice to Have)
DP-203: Microsoft Certified – Azure Data Engineer Associate
Databricks Data Engineering Certification
Soft Skills
Strong analytical mindset and data affinity
Ability to work in Agile environments
Excellent collaboration and communication skills
Proactive and solution-oriented approach