Delivery Manager - Data Engineer

Job Purpose

As a member of the Data and Technology practice, you will be working on advanced AI & ML engagements tailored for the investment banking sector. This includes developing and maintaining data pipelines, ensuring data quality, and enabling data-driven insights. Your core responsibility will be to build and manage scalable data infrastructure that supports our proof of-concept initiatives (POCs) and full-scale solutions for our clients. You will work closely with data scientists, DevOps engineers, and clients to understand their data requirements, translate them into technical tasks, and develop robust data solutions

Desired Skills And Experience

5+ years of relevant experience in:

• Experience in data engineering role, preferably within the financial services industry.
• Experience with building data pipeline and ETL frameworks with programming abilities in Python, SQL, and Spark.
• Proficiency in cloud platforms, particularly Azure and Databricks.
• Experience with data integration from various sources including APIs, SFTPs and databases.
• Strong understanding of data warehousing concepts and practices.
• Experience building CI/CD pipelines and automating unit and integration testing.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills, both written and oral, with a business and technical aptitude.
  
  

• Familiarity with big data technologies and frameworks.
• Experience with financial datasets and understanding of investment banking metrics.
• Knowledge of visualization tools (e.g., PowerBI).
  
  

• Develop, optimize, and maintain scalable and reliable data pipelines using tools such as Python, SQL, and Spark.
• Integrate data from various sources including APIs, databases, and cloud storage solutions such as Azure and Databricks.
• Implement data quality checks and ensure the accuracy and consistency of data.
• Manage and optimize data storage solutions, ensuring high performance and availability.
• Work closely with data scientists and DevOps engineers to ensure seamless integration of data pipelines and support machine learning model deployment.
• Monitor and optimize the performance of data workflows to handle large volumes of data efficiently.
• Create detailed documentation of data processes.
• Implement security best practices and ensure compliance with industry standards.