Job Description

Job Title Lead Data Engineer
Location (s) Cochin
Years of Experience 5-10yrs
Job Description

Lead Data Engineer

What You’ll Do

  • Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in multi-cloud, multi-region, distributed environments.
  • Define and apply appropriate data engineering patterns and architectures based on business and technical requirements.
  • Drive technical investigations and resolve complex data, operational, and production issues.
  • Design scalable, flexible, efficient, and supportable solutions using appropriate technologies and disciplined development practices.
  • Provide technical leadership, guidance, and mentorship to data engineering teams.
  • Collaborate with architects, engineering teams, and business stakeholders to deliver robust data solutions.

Key Skills

  • Data Engineering & Architecture: Strong understanding of data engineering patterns and modern architectures such as Data Mesh, Data Fabric, Data Lake, and Data Warehouse.
  • Big Data & Cloud: Proficiency in Amazon EMR, AWS Glue, Data Lake, and technologies for processing large datasets.
  • Programming: Strong proficiency in Python, Java, or Scala, with solid OOP expertise.
  • Data Warehousing: Strong knowledge of data warehousing solutions, preferably Snowflake.
  • ETL/ELT & Orchestration: Hands-on experience with ETL/ELT pipelines and data orchestration tools.
  • Databases: Strong expertise in relational and NoSQL databases.
  • Data Modelling: Experience designing efficient OLAP and OLTP data models.
  • Streaming: Knowledge of streaming data technologies and architectures.
  • Version Control: Experience with Git and modern development practices.
  • Containers & Orchestration: Understanding of Docker and Kubernetes.
  • Data Security: Knowledge of encryption, access control, data privacy, and compliance.
  • Monitoring & Logging: Experience implementing monitoring, logging, alerting, and observability for data pipelines.

 

Role & Responsibilities
  • Lead Data Engineer
    • What You’ll Do
    • Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in multi-cloud, multi-region, distributed environments.
    • Define and apply appropriate data engineering patterns and architectures based on business and technical requirements.
    • Drive technical investigations and resolve complex data, operational, and production issues.
    • Design scalable, flexible, efficient, and supportable solutions using appropriate technologies and disciplined development practices.
    • Provide technical leadership, guidance, and mentorship to data engineering teams.
    • Collaborate with architects, engineering teams, and business stakeholders to deliver robust data solutions.
    • Key Skills
    • Data Engineering & Architecture: Strong understanding of data engineering patterns and modern architectures such as Data Mesh, Data Fabric, Data Lake, and Data Warehouse.
    • Big Data & Cloud: Proficiency in Amazon EMR, AWS Glue, Data Lake, and technologies for processing large datasets.
    • Programming: Strong proficiency in Python, Java, or Scala, with solid OOP expertise.
    • Data Warehousing: Strong knowledge of data warehousing solutions, preferably Snowflake.
    • ETL/ELT & Orchestration: Hands-on experience with ETL/ELT pipelines and data orchestration tools.
    • Databases: Strong expertise in relational and NoSQL databases.
    • Data Modelling: Experience designing efficient OLAP and OLTP data models.
    • Streaming: Knowledge of streaming data technologies and architectures.
    • Version Control: Experience with Git and modern development practices.
    • Containers & Orchestration: Understanding of Docker and Kubernetes.
    • Data Security: Knowledge of encryption, access control, data privacy, and compliance.
    • Monitoring & Logging: Experience implementing monitoring, logging, alerting, and observability for data pipelines.
    •  
Technical Qualifications Python + AWS EMR + AWS Glue + Snowflake + ETL/ELT + Data Engineering + Data Architecture + Big Data + SQL


Job Details

Role Level: Mid-Level Work Type: Full-Time
Country: India City: Kanayannur ,Kerala
Company Website: http://www.ibsplc.com Job Function: Data Science & AI
Company Industry/
Sector:
Software Development

What We Offer


About the Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.


ad 1
Talentmate Instagram Talentmate Facebook Talentmate YouTube Talentmate LinkedIn