Senior Consultant

Technical Lead – Data Engineering

We are looking for an experienced Technical Lead – Data Engineering with strong expertise in Snowflake, dbt, AWS, Python, SQL, ETL/ELT, Data Warehousing, and CI/CD. The ideal candidate will lead the design and development of scalable data solutions, provide technical leadership, and mentor engineering teams.

Key Responsibilities

Lead data architecture and solution design activities.

Drive technical discussions, architecture reviews, and engineering best practices.

Design and develop scalable data solutions using Snowflake.

Manage Snowflake databases, schemas, virtual warehouses, roles, and security configurations.

Develop and maintain dbt models, transformations, and reusable components.

Build scalable ELT frameworks using dbt.

Develop Python-based data ingestion, transformation, and automation solutions.

Integrate data from APIs, files, databases, and cloud platforms.

D

Develop dimensional data models including Fact and Dimension tables.

Work with AWS services such as S3, Lambda, Glue, IAM, Step Functions, and EventBridge.

Process and transform semi-structured data including JSON.

Develop solutions for JSON parsing, flattening, and nested data transformations.

Implement CI/CD pipelines for data engineering projects.

Automate code deployment, testing, and release management.

Promote DevOps and DataOps best practices across the platform.

Required Skills

Strong expertise in Snowflake.

Hands-on experience with dbt Core.

Advanced Python programming skills.

Strong SQL development and query optimization experience.

Experience with AWS cloud services.

Expertise in ETL/ELT design and development.

Strong understanding of Data Warehousing concepts and dimensional modeling.

Experience with JSON parsing and flattening.

Experience implementing CI/CD pipelines using GitHub Actions, Jenkins, GitLab CI/CD, or similar tools.

Performance tuning and troubleshooting experience.

Leadership Requirements

Experience leading technical teams and data engineering initiatives.

Strong problem-solving and decision-making skills.

Ability to drive architecture discussions and technical governance.

Excellent communication and stakeholder management skills.

Experience working in Agile environments.