Walk In Drive For Women Senior Data Integration Specialist ML Engineer

Senior Data Integration specialist - BEAT

We are looking for a senior data engineer/Integration specialist who will help us to source, validate and create rule-based data ingestion system using state of art data integration strategies. Responsibility includes designing validation engines, Integrating with MDS API, Snowflake, CRM and DataBricks etc., error monitoring and reviewing for RCA, doing statistical analysis on our datasets and creating robust data pipeline for data consumption.

Responsibilities

• Building efficient data pipeline and data integration setup for large scale data platforms (AWS, Azure, Snowflake)
• Design, construct, install, test and maintain the data integrations setup like MDS, CRM or proprietary systems.
  
  

• Expert in Advanced python, FastAPI, MongoDB, Elasticsearch/OpenSearch, Temporal
• Strong AWS/Azure experience.
• Proficient in DevOps/DataOps (CI/CD, Github Actions/Docker/podman).
• Strong problem-solving and communication skills.
• Ensure that all systems meet the business/company requirements as well as industry practices.
• Research new uses for existing data.
• Collaborate with members like data architects, IT team, data scientists etc. on the project’s goals.
• Install/update disaster recovery procedures and manage the data security requirements
• Recommend different ways to constantly improve data reliability and quality.
• Designing and building validation engines for monitoring of sourced data
• Processing, cleansing, and verifying the integrity of data used for analysis
• Enhancing data collection procedures to include information that is relevant for building analytic systems
  
  

• Graduate in Engineering, Technology, applied mathematics, physics statistics along with good business skills
• Intellectual curiosity to find new and unusual ways of how to solve data management issues.
  
  

• Ability to approach data organization challenges while keeping an eye on what’s important.
• Experience of working in Cloud based infrastructure with exposure to Data Ops. or ML Ops. Would be added advantage.
• Good scripting and programming skills in Python and LLM
• Experience with some data visualization tools
• Experience with NoSQL & Vector databases
• Good communication skills
• Good problem solving and negotiation skills