Lead DevOps Data Engineer 02F25

The Lead DevOps Data Engineer plays a crucial role in bridging the gap between software development and IT operations. By leveraging both development and operations skills, this role ensures smooth automation of the infrastructure and effective management of the data lifecycle. A Lead DevOps Data Engineer is responsible for designing, building, and maintaining an organization's data pipeline architectures, which will support data analytics and machine learning requirements. This dynamic role requires a proactive approach to troubleshooting and optimizing systems to achieve the best possible performance. The position involves close collaboration with software developers, data scientists, data analysts, and other IT staff to manage codes releases, creating an efficient, reliable environment for rapid software delivery and secure data handling.

Responsibilities

• Design and implement data pipeline architectures for robust data handling capabilities.
• Ensure high availability and reliability of data infrastructure services and tools.
• Collaborate with software developers and IT staff to optimize automation processes.
• Monitor system performance metrics to actively troubleshoot and identify improvements.
• Implement data security measures in line with organizational policies and standards.
• Develop and maintain continuous integration and continuous deployment frameworks.
• Create and manage cloud-based data storage solutions for scalable operations.
• Coordinate software updates and releases alongside development and operations teams.
• Lead sessions on DevOps best practices and foster a culture of continuous improvement.
• Mentor junior team members to increase overall team skillsets and productivity.
• Develop infrastructure as code to facilitate version control and automation.
• Analyze existing systems and suggest improvements for enhanced data processing.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related technical field is required.
• Proven experience in a DevOps or Data Engineering role, with leadership responsibilities.
• Strong knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
• Proficiency in scripting languages such as Python, Bash, or PowerShell.
• Experience with configuration management tools like Ansible, Puppet, or Chef.
• Familiarity with containerization and orchestration tools, including Docker and Kubernetes.
• Excellent problem-solving skills and ability to work collaboratively in a team environment.
• Sound understanding of version control systems, such as Git, for managing codebases.