DNACRL _Data Engineering / Data Warehousing

Data Engineer

We are seeking a hands-on Data Engineer with strong skills in PySpark, Python, and SQL to build and optimize scalable data pipelines and solve complex data processing problems. The ideal candidate will have a problem-solving mindset and a strong ability to identify and fix inefficient code.

Key Responsibilities

• Develop and maintain scalable data pipelines using PySpark.
• Write optimized SQL queries and handle large-scale data transformations.
• Perform data integration from multiple sources.
• Debug and optimize Spark jobs for performance.
• Work on complex data processing and analytical scenarios.

Requirements

• Strong PySpark and Spark optimization techniques.
• Advanced SQL skills, including joins, aggregations, and analytical queries.
• Proficiency in Python for data processing and transformation.
• Understanding of partitioning, data distribution, and performance tuning.
• Experience with any relational database.

Work Arrangements

• Experience required: 3-11 years.
• Type: Contract.
• Location: Bengaluru, Karnataka, India | Hyderabad, Telangana, India | Chennai, Tamil Nadu, India.