backGo to search

Lead Snowflake Data Engineer

hot
bullets
Data Integration, Snowflake, Python, Apache Airflow, dbt, DevOps, Amazon Web Services, Microsoft Azure
bullets
Hyderabad, Bangalore, Pune, Chennai, Gurgaon

We are seeking an experienced Lead Snowflake Data Engineer to spearhead our data warehousing solutions, with a focus on creating scalable and secure architectures using Snowflake.

The ideal candidate will drive development, optimization, and governance of our Snowflake environment to support intricate data ingestion, storage, and analytics requirements.

Responsibilities
  • Lead the design and implementation of scalable Snowflake data models to meet data ingestion and analytics needs
  • Develop and maintain robust ETL pipelines, ensuring data consistency and integrity across multiple sources
  • Optimize Snowflake configurations for performance enhancements, query tuning, and efficient data partition management
  • Implement data security measures, role-based access control, and data masking within Snowflake to adhere to compliance and governance standards
  • Automate data processing and pipeline monitoring using dbt and Apache Airflow
  • Collaborate with cross-functional teams to solve complex data challenges and effectively troubleshoot Snowflake-related issues
  • Produce thorough documentation and reports on data structures, ETL workflows, and system processes for team transparency and knowledge sharing
Requirements
  • 8 to 12 years of experience in data engineering
  • Proficiency in Python programming
  • Background in Snowflake modeling, including roles, schema, and databases
  • Expertise in data modeling using Data Vault methodology
  • Competency in design and development of data transformation pipelines with the DBT framework
  • Skills in workflow management using tools such as Argo, Oozie, or Apache Airflow
  • Familiarity with AWS as a cloud service provider
  • Understanding of how to build scalable, secure, and highly performant warehousing solutions that integrate with monitoring and observability features