Databricks Data Engineer INFYSYJP00007375

Databricks Data Engineer

We are seeking a Databricks Data Engineer with 5+ years of experience building modern data platforms using Databricks Lakehouse architecture. The candidate should have strong expertise in Spark, Delta Lake, and large-scale cloud-native data engineering.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks.
• Build and optimize data processing frameworks using PySpark and Spark SQL.
• Implement modern Lakehouse architectures using Delta Lake.
• Develop and maintain bronze, silver, and gold layer data models.
• Optimize cluster utilization and processing performance.
• Build reusable frameworks and accelerate data ingestion capabilities.
• Support real-time and batch data processing requirements.
• Collaborate with data analysts, architects, and business users.

Requirements

• 5+ years of data engineering experience.
• 5+ years of Databricks platform experience.
• Strong expertise in:
• PySpark
• Spark SQL
• Python
• Delta Lake
• Databricks Workflows
• Strong understanding of:
• Lakehouse Architecture
• Medallion Architecture
• Data Modeling
• Data Warehousing Concepts
• Experience building scalable data pipelines handling large data volumes.
• Strong SQL development and optimization skills.

Work Arrangements

• Location: Bengaluru, Karnataka, India | Hyderabad, Telangana, India
• Remote: Not specified
• Shift/schedule details: Not specified
• Office visits: Not specified
• Travel requirements: Not specified

Salary and Benefits

• Salary: Not specified
• Benefits: Not specified

Preferred Skills

• Snowflake integration
• Kafka/Event Streaming
• Airflow
• dbt
• MLflow exposure

Soft Skills

• Strong debugging and performance tuning abilities.
• Excellent communication and stakeholder interaction skills.
• Ability to independently drive technical solutions.