Data Engineer

• Collect progress updates from Squad on a regular basis.
  
• Consolidate updates into weekly project status reports and share with the Squad Leads for their review.
  
• You participate in early state design and feature definition activities.
  
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
  
• Responsible for creating reusable and scalable data pipelines.
  
• You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  
• You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
  
• Develop and manage L3-level project plans with sufficient details for tasks, milestones, and dependencies
  

Requirements

• Knowledge and experience with relational and non-relational databases.
  
• Strong analytic skills related to working with structured and unstructured datasets.
  
• Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  
• Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  
• Strong proficiency in building JIRA dashboards based on tasks.
  
• Strong experience in Project Management will be considered as an additional advantage.
  
• Azure DevOps experience to deploy the data pipelines through CI/CD.
  
• Minimum 5-7 years of practical experience.
  
• Bachelor’s degree in computer science, software engineering, information technology, or a related field.
  
• Azure cloud stack in-production experience