Snowflake Data Engineer - Lead

Snowflake Data Engineer - Lead

This role involves leading Snowflake Data Warehouse & SQL development, data ingestion and integration, CDC & pipeline automation, AWS integration, and external tables & data access.

Key Responsibilities

• Develop and optimize complex SQL queries, including joins, aggregations, window functions, and stored procedures
• Support Snowflake Data Warehouse development, maintenance, and performance optimization
• Design and implement data loading solutions using COPY INTO, Snowpipe, and Snowflake stages
• Manage internal and external stages for efficient data ingestion and processing
• Implement Change Data Capture (CDC) solutions using Snowflake Streams
• Automate data pipelines and workflows using Snowflake Tasks
• Integrate Snowflake with AWS services, including Amazon S3 and AWS Glue
• Create and manage Snowflake External Tables for querying data directly from Amazon S3
• Support Data Lake integration and external data access requirements
• Build and maintain ETL pipelines using AWS Glue
• Develop and support Python/PySpark-based Glue jobs for data transformation and processing
• Design and manage workflow automation using AWS Step Functions
• Implement state machines, job sequencing, dependency management, and error handling
• Monitor and optimize Snowflake query performance and warehouse utilization
• Troubleshoot ETL pipelines, data loading processes, and integration issues across Snowflake and AWS platforms

Requirements

• Must-haves: Snowflake Data Warehouse experience, advanced SQL development skills, experience with COPY INTO, Snowpipe, internal and external stages, Snowflake Streams, AWS integration, AWS Glue ETL, and performance tuning & troubleshooting
• Desirable: experience with Snowflake External Tables, AWS Step Functions, and collaboration & communication skills

Work Arrangements

• Work schedule: 9 AM to 6 PM
• Remote work: Hybrid (Face to Face, WFO / WFH)
• Office visits: Not specified
• Travel requirements: Not specified