Azure Data Engineer

Azure Data Engineer

A highly skilled Azure Data Engineer with strong hands-on experience in Azure Databricks, PySpark, and Azure Data Services is required. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines and enterprise data platforms that support analytics, reporting, and business intelligence initiatives.

Key Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
• Build scalable batch and real-time data processing solutions.
• Develop and maintain data ingestion frameworks from multiple data sources.
• Implement data models, Delta Lake architecture, and performance optimization techniques.
• Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Synapse Analytics.
• Ensure data quality, security, governance, and monitoring across the platform.
• Troubleshoot and resolve data pipeline performance issues.
• Implement CI/CD processes using Azure DevOps.
• Collaborate with business stakeholders, architects, and data analysts to deliver data solutions.
• Create technical documentation, HLD/LLD, and operational runbooks.

Requirements

• Strong experience in Azure Databricks and PySpark.
• Hands-on expertise in Python and SQL.
• Experience with Azure Data Factory (ADF).
• Experience with Delta Lake, Unity Catalog, and data governance.
• Strong understanding of ETL/ELT, data warehousing, and data modeling.
• Experience with Azure DevOps, Git, and CI/CD pipelines.
• Knowledge of batch and streaming data processing.
• Good analytical, troubleshooting, and communication skills.

Work Arrangements

• Work schedule: 11 a.m. to 8 p.m.
• Work mode: Hybrid (Face to Face, WFO/WFH)
• Shift timings: 11 a.m. to 8 p.m.