Senior Lead Software Engineer- Data Engineering (225-925)

A Senior Lead Software Engineer in Data Engineering plays a crucial role in designing, developing, and maintaining the architecture and infrastructure required for optimal data extraction, transformation, and loading (ETL) of large data sets from a variety of sources. This position requires a seasoned professional who combines superior technical expertise with strong leadership and management skills to guide engineering teams towards successful project deliveries. The ideal candidate will have significant experience with big data technologies and frameworks, as well as the ability to work collaboratively across various teams to implement solutions that meet organizational needs. The Senior Lead Software Engineer will also be responsible for ensuring high data quality and operational efficiency in data processing and analysis activities, thereby driving improvements in data architecture across the organization.

Responsibilities

• Lead the design and implementation of data engineering projects and strategies.
• Manage and mentor a team of software engineers to enhance productivity and morale.
• Collaborate with cross-functional teams to define data requirements and solutions.
• Develop and maintain scalable data pipelines using appropriate technologies and tools.
• Ensure data accuracy, consistency, and integrity within all engineering projects.
• Drive continuous improvement efforts in code quality, architecture, and performance.
• Oversee troubleshooting and debugging of complex data issues within systems.
• Implement industry best practices for data security and data governance.
• Evaluate and recommend new data technologies and platforms for strategic advantage.
• Maintain comprehensive documentation of data engineering processes and procedures.
• Collaborate with data scientists to integrate advanced analytics models into data systems.
• Ensure compliance with data privacy regulations and organizational standards.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field is required.
• A minimum of 7 years of experience in software engineering or data engineering roles.
• Proven experience with big data technologies, such as Hadoop, Spark, and Kafka.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and experience with optimizing complex data systems.
• Demonstrated leadership skills and experience managing engineering teams effectively.
• Solid understanding of data security standards and data governance practices.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud is preferred.
• Strong communication skills and ability to work collaboratively in a team environment.
• Detailed understanding of ETL processes, data warehousing, and database management.