566792_Senior Data Engineer

Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer with 3-11 years of experience to join our dynamic team. The ideal candidate will gather and analyze business requirements, translating them into structured and actionable data standards in collaboration with cross-functional teams. This role involves designing, developing, and optimizing ETL processes to ensure data integrity and reliability.

Key Responsibilities

• Gather and analyze business requirements, translating them into structured and actionable data standards.
• Design, develop, and optimize ETL processes to extract, transform, and load data from multiple sources including SQL Server, JSON, and PostgreSQL systems.
• Build and maintain scalable data pipelines and workflows using Azure Data Factory (ADF) to support data integration and analytics.
• Perform ETL testing, data validation, and quality assurance using SQL and automated Python scripts.
• Develop automated workflows and orchestrations using Azure Data Factory and Apache Airflow for scheduling and monitoring data pipelines.
• Leverage Python scripts to integrate with external APIs, fetch data, and store it into databases for downstream analytics.
• Implement version control and CI/CD best practices using GitHub for Python scripts and ETL processes.
• Develop and deploy Power BI semantic models, dashboards, and paginated reports to provide meaningful business insights.
• Publish reports to Power BI Service using deployment pipelines and configure on-premise gateways for automated data refresh.
• Perform data modeling, DAX development, and report optimization for performance and scalability.

Requirements

• Degree in a relevant field.
• Strong experience with Azure Data Factory (ADF), SQL Server (SSMS), PostgreSQL, and Data Modeling.

Work Arrangements

• Contract position.
• Location: Hyderabad, Telangana, India | Bengaluru, Karnataka, India | Chennai, Tamil Nadu, India.