Data Engineer

Job Title: Data Engineer

Job ID: POS-20689

Primary Skill: Databricks, ADF

Key Skills: Azure Databricks, PySpark

Secondary Skills: Azure Data Factory, Azure Data Lake, Advanced SQL, Python, Azure Synapse

Mode of Work: Work From Office

Job Location: Hyderabad / Pune / Coimbatore / Bengaluru

Experience: 6–9 Years

About The Job

We are seeking a highly skilled Senior Software Engineer – Azure Data Engineer with strong expertise in Azure Databricks and PySpark to join our dynamic team. This role involves designing and developing scalable data pipelines, working with large volumes of data, building complex ETL solutions and contributing to Data & BI transformation and analytics initiatives.

The ideal candidate will have hands-on experience with Azure Databricks and PySpark, along with strong knowledge of Azure data services, SQL and data engineering practices.

Know your team

At ValueMomentum’s Engineering Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through a strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams and core engineering archetypes. Our core expertise lies in six key areas: Platform, App & Infra Engineering, Data & Advanced Analytics, Core Engineering, and Software Assurance & AI.

Join a team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You'll have the opportunity to showcase your talents by contributing to impactful projects.

Responsibilities

• Design and develop scalable data pipelines using Azure Databricks and PySpark.
• Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation.
• Write SQL, Python and PySpark code for efficient data processing and transformation.
• Work with Azure Data Lake and other Azure data services to build robust data solutions.
• Handle and process large volumes of data efficiently.
• Understand business requirements and translate them into technical solutions.
• Understand functional and technical specification documents.
• Develop mapping documents and transformation rules as per project scope and requirements.
• Troubleshoot data processing, pipeline and transformation-related issues.
• Communicate project status with stakeholders and ensure smooth project execution.
• Follow JIRA stories and development processes for data engineering activities.
  
  

Requirements

• 6–9 years of experience in data engineering, data ingestion, data processing and analytical pipelines for big data, relational databases and data warehouse solutions.
• Strong hands-on experience with Azure Databricks and PySpark.
• Experience developing data pipelines using Azure Data Factory.
• Strong programming experience in Python, PySpark and SQL.
• Experience working with DataFrames and large volumes of data.
• Hands-on experience with Azure Data Lake and Azure data services.
• Experience with data transformation, ETL and data processing.
• Good understanding of DevOps and CI/CD deployments.
• Good understanding of Agile/Scrum methodologies.
• Strong problem-solving skills with the ability to troubleshoot complex data processing issues.
• Strong attention to detail in high-pressure situations.
• Effective communication and collaboration skills with the ability to interact with stakeholders at different levels.
• Experience in the insurance or financial industry is preferred.
  
  

Good To Have

• Azure Synapse
• Azure SQL DB
• Azure Functions
• Azure Blob Storage and Storage Explorer
• Insurance domain experience, including Underwriting, Claims or Policy Issuance
• Financial industry experience
  
  

About The Company

Founded in 2000 with the core belief that impactful change comes from deep commitment, ValueMomentum specializes in delivering measurable results across the P&C value stream. For more than 25 years, we have empowered more than 100 carriers to reimagine their businesses with AI and emerging technologies, navigate market shifts, unlock speed to value, and become future-ready. We help insurers in the US, Canada, and Europe stay ahead with sustained growth and high performance to enhance stakeholder value and foster resilient societies.

Our culture – Our fuel

At ValueMomentum, we believe in making employees win by nurturing them from within, collaborating and looking out for each other.

• People firs - Empower employees to succeed.
• Nurture leaders - Nurture from within.
• Enjoy wins - Recognize and celebrate win.
• Collaboration - Foster a culture of collaboration and people-centricity.
• Diversity - Committed to diversity, equity, and inclusion.
• Fun - Create a fun and engaging work environment
  
  

Company Benefits

• Compensation - Competitive compensation package comparable to the best in the industry.
• Career Growth - Career development, comprehensive training & certification programs, and fast track growth for high potential associates.
• Health Benefits: Comprehensive health benefits and life insurance.

---