senior cloud engineer

General Responsibilities

The Platform Developer will ensure the seamless operation and optimization of data pipelines and platforms under Project Ultron. The role entails troubleshooting data pipeline issues, conducting rigorous testing, coordinating delivery across teams, and collaborating closely with Data Science and Marketing to uphold platform reliability and performance.

Data Pipeline Management

• Collaborate with the Data Science team to identify, troubleshoot, and resolve data pipeline issues.
• Conduct thorough end-to-end testing of data pipelines across all environments (development, staging,
  
  

• Prepare and deliver comprehensive Root Cause Analyses (RCAs) for data-related incidents.
  
  

• Maintain proactive communication with the Marketing team throughout the resolution of bugs and hotfixes.
• Document issues and remediation actions in detailed RCA documentation for transparency and future
  
  

• Raise and track prediction data delivery issues across internal and external platforms.
• Coordinate closely with Marketing, Data Science, and Platform Tech Support teams for resolution and
  
  

• Assist in building and maintaining egress pipelines from Project Ultron to delivery platforms.
• Promote adherence to platform engineering best practices and documentation standards.
• Participate in sprint planning and regular stand-ups with cross-functional teams.
  
  

• Support the upkeep and monitoring of Project Ultron’s platform infrastructure.
• Identify opportunities for performance tuning, reliability enhancements, and availability improvements.
• Ensures platform integrity, stability, and data delivery continuity across projects.
• Contribute to the automation of monitoring and maintenance tasks.
  
  

• Graduated to any related IT course.
• Had experienced as Platform Developer
• Experience in Docker, Kubernetes, Apache, Spark, GIT,
• Exp in at least 1-2 cloud: prio is AWS Cloud (can be google cloud or Microsoft) 4-5+ years of experience in data engineering or platform engineering roles.
• Demonstrated experience in platform operations, data pipeline development, and support.
• KnowledgeProficient in SQL, Python, PySpark, and Pandas for data manipulation and analysis.
• Hands-on experience with Docker and Kubernetes for containerization and orchestration.
• Familiar with Git or similar version control systems.
• Experience working within cloud environments, preferably AWS (e.g., S3, Lambda, EMR, ECS).