Lead DevOps Data Engineer (225-818)

As a Lead DevOps Data Engineer, you will be at the forefront of transforming our data infrastructure and operations into a more agile and efficient system. You will work collaboratively with cross-functional teams to design, implement, and manage automated systems that facilitate the fast-paced and seamless integration of data operations. Your extensive expertise will guide the strategic development of new methodologies for continuous integration and delivery of data services, enhancing the overall performance and availability of data systems. The ideal candidate should have an innovative mindset capable of driving improvements in data handling processes, combined with a strong technical acumen and leadership skills to mentor and oversee the DevOps data engineering team.

Responsibilities

• Lead the design and implementation of scalable and reliable data infrastructure.
• Oversee the automation of deployment processes for data pipelines and services.
• Collaborate with cross-functional teams to enhance data lifecycle management.
• Ensure high availability and performance of data systems through proactive monitoring.
• Mentor and lead the DevOps engineering team to meet organizational goals.
• Drive continuous integration and development practices for the data engineering team.
• Design solutions for data processing that optimize performance and resource utilization.
• Evaluate and integrate new tools and technologies into the existing data framework.
• Manage cloud infrastructure, including provisioning, monitoring, and scaling resources.
• Develop documentation for system procedures, project plans, and architecture designs.
• Conduct performance tuning and capacity planning for data operations.
• Implement security measures to protect data integrity and privacy.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field required.
• Extensive experience in DevOps practices and data engineering environments.
• Proficient in cloud platforms like AWS, Azure, or Google Cloud Platform.
• Strong understanding of CI/CD pipelines and related tools and technologies.
• Experience with data orchestration tools such as Apache Airflow or equivalent.
• Excellent leadership skills with the ability to inspire and drive a team.
• Deep knowledge of containerization technologies like Docker and Kubernetes.
• Solid scripting skills with languages such as Python, Bash, or similar.
• Understanding of networking and security best practices in cloud environments.
• Strong analytical skills with the ability to troubleshoot complex issues.