562862 - Data Engineer (Snowflake)

Data Engineer (Snowflake)

We are seeking a skilled Data Engineer with expertise in Snowflake to join our team on a contract basis. The ideal candidate will possess a strong background in building and maintaining scalable ETL/ELT pipelines, utilizing modern data processing technologies to optimize data storage and analytics.

Key Responsibilities

• Build and maintain scalable ETL/ELT pipelines using Apache Spark (Scala/Python) to process raw data from AWS S3 and deliver it to Snowflake via Snowpipe.
• Apply expertise in big data file formats (Parquet, Avro) and handling procedures to optimize storage.
• Utilize geospatial libraries to process and index location-based telemetry at scale.
• Engineer robust filtering and anomaly detection layers to scrub "noise" from source data, ensuring high-quality inputs for downstream datasets, machine learning models, and analytics.
• Conduct deep-level optimization of SQL and Python/Spark code to reduce execution runtime and minimize cloud compute costs (Snowflake credits/AWS EMR).
• Leverage modern AI tools and analytical frameworks to accelerate data exploration, automate feature engineering, and support predictive modeling workflows.
• Manage scheduled tasks and orchestration to ensure the seamless delivery of materialized data for BI and data science teams.

Requirements

• Degree in a relevant field.
• 4-15 years of experience as a Data Engineer.
• Mandatory skills: Apache Spark using Scala or Python, advanced SQL and Python skills, strong understanding of AWS ecosystem (S3, IAM, EMR/Glue), and Snowflake architecture.
• Desired skills: Expert-level proficiency in Apache Spark, hands-on experience with geospatial libraries (e.g., GeoPandas, PySpark-Magellan), advanced SQL and Python skills focused on query plan optimization and memory management, deep knowledge of file partitioning, bucketing, and compression strategies for petabyte-scale environments, background in Snowflake task optimization and Snowpipe troubleshooting, and familiarity with using LLM and ML functions in Snowflake.

Work Arrangements

• Type: Contract
• Project Location: Pan India