Lead Data Engineer

Job Title: Lead Data Engineer

Experience: 9–12 Years

Location: [Onsite / Hybrid / Remote]

Employment Type: Full-time

Job Summary

We are seeking an experienced Lead Data Engineer to drive the design, development, and delivery of scalable data platforms and pipelines. This role combines hands-on engineering, technical leadership, and stakeholder collaboration, ensuring high-quality data solutions that support analytics, reporting, and advanced use cases.

Key Responsibilities

Technical Leadership

• Lead the design and implementation of end-to-end data engineering solutions.
• Define data engineering standards, best practices, and architecture guidelines.
• Perform design and code reviews to ensure quality, performance, and scalability.
  
  

• Build and maintain robust ETL/ELT pipelines for batch and streaming data.
• Develop and optimize data lakes, data warehouses, and lakehouse platforms.
• Ensure data quality, reliability, and availability across systems.
  
  

• Architect and develop solutions on cloud platforms (AWS / Azure / GCP).
• Work with big data technologies such as Spark, Kafka, Hadoop.
• Optimize cloud cost, performance, and resource utilization.
  
  

• Partner with business, analytics, and data science teams to translate requirements into scalable solutions.
• Act as a technical point of contact for data engineering initiatives.
• Support project planning, estimation, and delivery commitments.
  
  

• Mentor and guide junior and senior data engineers.
• Support hiring, onboarding, and capability building within the team.
  
  

• Implement CI/CD pipelines for data workflows.
• Ensure adherence to data governance, security, and compliance standards.
• Monitor, troubleshoot, and proactively improve data platform reliability.
  
  

• Strong hands-on experience with Python / Scala / Java.
• Advanced SQL expertise and query optimization skills.
• Extensive experience with Spark (PySpark), Airflow, or similar tools.
• Strong knowledge of data warehousing and data modeling.
• Experience with cloud-native data services (e.g., Azure Data Factory, Synapse, AWS Glue, Redshift, Snowflake).
• Exposure to real-time/streaming platforms (Kafka, Kinesis, Event Hubs).
  
  

• Proven leadership and mentoring capabilities.
• Strong communication and stakeholder management skills.
• Ability to balance hands-on delivery with strategic thinking.
• Experience working in Agile/Scrum environments.
  
  

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  
  

• Cloud certifications (AWS / Azure / GCP).
• Experience with Power BI / Tableau for data consumption understanding.
• Exposure to ML/AI data pipelines and feature engineering.
• Experience in regulated or enterprise-scale environments.