Data Engineer

Data Engineer – Data and AI Tribe

Responsibilities

• Design, architect and maintain secure data platform with focus on optimal data warehousing and modelling, data processing and storage
• Assess and work with the right infrastructure and data technologies based on stakeholder requirements, ensuring highly available and scalable data capabilities
• Implement and maintain optimized workflows, ETL / ELT processes, and pipelines
• Produce visualization and insights on ingested data and be able to communicate results with non-technical stakeholders
• Work with colleagues such as Product Owner, Data Analysts, Software Engineers, and tech leads on implementing solutions involving end to end data ingestion, storage, and consumption
  
  

• Proficiency and experience in programming languages such as Python
• Expertise in SQL / RDBMS and NoSQL databases
• Extensive experience in design and implementation of data warehousing and data handling processes (ingestion, transformation, modelling, and storage). Experience with MS SQL / SQL Server , Oracle Databases
• Expertise in cloud platforms and technologies. Experience with Azure and its products such is a plus.
• Expertise in cloud platforms and technologies (Azure, AWS, GCP) is a plus but not required
• Experience with streaming platform setup and consumption such as Kafka, Flink
• Experience with consumption from other storages for streaming such as S3, Spark
• Experience in containers and container orchestration platforms such as Docker and Kubernetes
• Experience in CI / CD and Devops, scripting languages such as shell and automation
• Experience with software quality and data pipeline testing
• ETL concepts and tools.
• Preferably a degree in the related fields of Computer Science
• Strong problem solving and solutions engineering mindset
• Experience in working and coordinating remotely