Job Description

We're looking for a Senior Data Engineer to join our team in Abu Dhabi, United Arab Emirates in an onsite working mode. This role involves working on a large-scale data platform migration using modern data technologies and building production-ready pipelines in a dynamic delivery environment. You will be part of a dedicated engineering team focused on high-impact work that requires strong hands-on expertise.

 

Responsibilities

  • Build, optimize and productionize data pipelines on Databricks using PySpark and SQL
  • Re-engineer and migrate transformation logic from a legacy platform to Databricks
  • Design and perform data validation and reconciliation to ensure accuracy across platforms
  • Tune performance through partitioning, Delta optimization, cluster configuration and ingestion strategies
  • Contribute to medallion-layer design and implement data quality frameworks
  • Review code and mentor junior engineers to promote best practices
  • Work within Git-based CI/CD setups and follow Agile delivery processes

Requirements

  • 7+ years of data engineering experience with recent hands-on delivery
  • Strong proficiency with Databricks platform, PySpark, SQL and Delta Lake
  • In-depth knowledge of ingestion patterns, Spark performance tuning and partitioning strategies
  • Solid SQL expertise with practical ability to write and validate queries
  • Experience in data migration or re-platforming projects
  • Professional-level English communication skills
  • Bachelor’s degree in computer science, information technology or a related field

Nice to have

  • Databricks Certified Data Engineer Professional certification
  • Familiarity with Palantir Foundry
  • Background in financial services or asset management
  • Experience with Unity Catalog governance
  • Knowledge of large-scale data quality or reconciliation frameworks

 

We offer

  • End of service gratuity
  • Private healthcare and life insurance
  • Employee assistance program
  • Wellness program
  • Annual air travel allowance for expatriates
  • Regular performance feedback and salary reviews
  • Global travel medical and accident insurance
  • Referral bonuses
  • Learning and development opportunities including in-house training and coaching, professional certifications, and courses


Job Details

Role Level: Mid-Level Work Type: Full-Time
Country: United Arab Emirates City: Abu Dhabi
Company Website: http://www.epam.com Job Function: Data Science & AI
Company Industry/
Sector:
Other

What We Offer


About the Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.


Recent Jobs
View More Jobs
Talentmate Instagram Talentmate Facebook Talentmate YouTube Talentmate LinkedIn