Data Ingestion Engineer - ADF

Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteering for causes that matter most to them.

Chart your own path and grow your career while helping more customers achieve financial freedom. Empower Yourself.

Summary: As a Data Ingestion Engineer, you will join a dynamic and high-performing Canada Life Data team dedicated to providing Data and AI solutions by ensuring the robustness, scalability, and reliability of data ingestion systems within our organization. Your key focus will be on designing, implementing, and maintaining the pipelines necessary for efficient and seamless data ingestion from various sources into our data platforms. You will partner with cross functional teams, enterprise, and portfolio architects to enhance operational performance, trouble shoot issues and implement best practices for data reliability.

Essential Functions

• Build data pipelines in MS Azure platform that supports the consumption of structured and unstructured data from various sources with the use of Azure Data Factory and Data Bricks
• Collaborate with cross functional teams to understand data requirements, design efficient data ingestion patterns and workflows.
• Implement and maintain controls and alerts to monitor data pipelines to proactively identify data related issues. Ensure data quality and integrity is maintained across the pipelines.
• Collaborate with support teams to triage incidents to quickly resolve major incidents, system outages or disruptions.
• Automate processes to support smooth operation of data pipelines to improve reliability, efficiency, scalability using the MS Azure tools.
• Conduct performance and capacity assessments, identify bottlenecks, and develop plans to improve performance, and reduce operational cost.
• Focused on implementing data governance and compliance controls, and security measure to protect sensitive data.
• Apply best practices for creation and maintenance of data pipelines including scalability, reusability, and reliability.
• Document system configurations, processes and troubleshooting procedures.
  
  

Experience

• 3+ years of development experience in MS-Azure (ADF + Databricks).
• 3+ years of prior experience in a data operations or development role (e-g ETL, Data Warehouse).
• Demonstrated experience in designing and implementing data ingestion systems using MS-Azure /Databricks.
• Experience in Kafka, CI/CD and CDC tools preferred.
• Solid programming experience with Python or SQL.
• Experience in setting up monitoring and controls for MS Azure data pipelines (prior experience with Data warehousing/ other data technologies is accepted).
• Strong knowledge in service management including incident and change management procedures.
• Microsoft Azure, Azure Data Services.
• Problem-solving skills and the ability to trouble shoot complex issues.
• Contributing to positive team culture and promoting common goals, team success and business outcomes.
• Valuing and appreciating different views and bring in collaborative approach to achieving consensus.
• Encourages inclusivity and a sense of unity within all operational areas of Canada Data team.
• Familiarity with Agile methodologies and DevOps practices.
  
  

We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age, race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.

---