Data Engineer (Big Data & GCP)

Data Engineer (Big Data & GCP)

We are seeking a skilled Data Engineer with expertise in Big Data and Google Cloud Platform (GCP) to join our team on a contract basis. The ideal candidate will provide thought leadership, engineering expertise, and direction to engineering teams while collaborating with business stakeholders and product teams to drive continuous delivery. This role requires a strong analytical mindset and the ability to communicate effectively with both technical and non-technical partners.

Key Responsibilities

• Provide engineering expertise and direction to engineering teams, collaborating with business stakeholders and cross-functional technology groups.
• Drive user story analysis, design, and development of software applications, and build automation tools.
• Own all technical aspects of software development including architecture, design, and development for assigned applications.
• Perform hands-on software development, including writing code, API specifications, proof of concepts, conducting code reviews, and testing in ongoing sprints.
• Drive consistent development practices and tools across the team.
• Develop a deep understanding of integrations with other systems and platforms.
• Work with technical product managers to contribute to blueprints and assist with annual planning of feature sets.
• Identify opportunities for adopting new technology to solve existing needs and predict future challenges.
• Effectively communicate solution designs to internal and external business partners.

Requirements

• Bachelor?s Degree in Computer Science, Computer Science Engineering, or a related field (advanced degree preferred).
• 4+ years of commercial software development experience.
• Proficient in developing and hosting solutions on Google Cloud Platform, including Google Cloud Storage and Big Query.
• Hands-on experience with Big Data platforms such as Scala, Spark, and Hive SQL.
• Experience with ETL processes and tools, as well as data modeling in Big Data platforms.
• Proficiency in Secure File Transfer (SFT) operations for data management.
• Experience with Agile development, Continuous Integration, and Continuous Delivery, including tools in the CI/CD pipeline like Maven, Salt, Git, and Jenkins.
• Strong skills in architecture design and modeling of complex systems.
• Good understanding of web technologies (HTTP, Apache) and familiarity with Unix/Linux.
• Strong analytical and strategic thinking skills.
• Excellent written communication and documentation abilities.
• Leadership and communication skills to lead teams and collaborate with stakeholders.

Work Arrangements

• Type: Contract
• Location: Chennai, Tamil Nadu, India