Senior Data Engineer

Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and efficient systems. This role involves working closely with cross-functional teams to deliver high-quality solutions that meet project requirements and drive business success.

Responsibilities

• Design and implement data pipelines using Python, Elasticsearch, Postgres, and RabbitMQ.
• Develop and maintain scalable, efficient, and reliable data processing workflows.
• Collaborate with team members to define project requirements, design solutions, and deliver high-quality software.
• Optimize system performance and troubleshoot issues to ensure reliability and scalability.
• Write clean, maintainable, and well-documented code.
• Participate in code reviews and provide constructive feedback to peers.
• Stay updated with emerging technologies and best practices in data engineering to drive innovation within the team.
  
  

• 4+ years of experience in software development with expertise in Python.
• Proficiency in Elasticsearch, SQL DB (like Postgres/MySQL/Similar), Unix Shell scripting, Queue system (like Celery)
• Strong understanding of data pipeline design and implementation.
• Experience with AWS services (e. g., S3 EMR) is highly desirable.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
  
  

• Experience with cloud-based data processing frameworks.
• Knowledge of CI/CD pipelines and Jenkins.
• Familiarity with containerization technologies (e. g., Docker, Kubernetes).
• Experience with monitoring and logging tools (e. g., Grafana).