Lead Snowflake Data Engineer

Data Integration, Snowflake, Python, Apache Airflow, dbt, DevOps, Amazon Web Services, Microsoft Azure

Hyderabad, Bangalore, Pune, Chennai, Gurgaon

We are seeking an experienced Lead Snowflake Data Engineer to spearhead our data warehousing solutions, with a focus on creating scalable and secure architectures using Snowflake.

The ideal candidate will drive development, optimization, and governance of our Snowflake environment to support intricate data ingestion, storage, and analytics requirements.

Responsibilities

Lead the design and implementation of scalable Snowflake data models to meet data ingestion and analytics needs
Develop and maintain robust ETL pipelines, ensuring data consistency and integrity across multiple sources
Optimize Snowflake configurations for performance enhancements, query tuning, and efficient data partition management
Implement data security measures, role-based access control, and data masking within Snowflake to adhere to compliance and governance standards
Automate data processing and pipeline monitoring using dbt and Apache Airflow
Collaborate with cross-functional teams to solve complex data challenges and effectively troubleshoot Snowflake-related issues
Produce thorough documentation and reports on data structures, ETL workflows, and system processes for team transparency and knowledge sharing

Requirements

8 to 12 years of experience in data engineering
Proficiency in Python programming
Background in Snowflake modeling, including roles, schema, and databases
Expertise in data modeling using Data Vault methodology
Competency in design and development of data transformation pipelines with the DBT framework
Skills in workflow management using tools such as Argo, Oozie, or Apache Airflow
Familiarity with AWS as a cloud service provider
Understanding of how to build scalable, secure, and highly performant warehousing solutions that integrate with monitoring and observability features