Data Engineer M F D

12 months extendable contract onsite in Abu Dhabi for a Data Engineer who has solid hands-on experience with Azure Services and experience in healthcare.

Skills:

• 6+ years of relevant experience in data engineering.
• High proficiency in SQL and Python. Experience with additional languages (Scala / Java) is a plus.
• Strong experience with Spark (PySpark, Spark SQL), including understanding of how to optimize jobs (memory, shuffle, parallelism).
• Hands-on experience with Databricks
• Experience using VS Code for development; experience with Git for version control, branching strategies, merging etc.
• Proficiency with cloud environments; specifically Azure — Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), Azure SQL or SQL DW.
• Familiarity with real-time data or streaming techs (e.g. Kafka, Spark Streaming).
• Strong understanding of data modelling (dimensional, relational), schema evolution, open table formats.
• Good to have experience in Healthcare domain
• Good to have Databricks or Azure certifications