Senior Data Engineer

Company: SourcingXPress

Website: Visit Website

Business Type: Startup

Company Type: Product

Business Model: D2C

Funding Stage: Seed

Industry: Media Tech

Salary Range: ₹ 35-40 Lacs PA

Job Description

We are seeking a highly skilled Data Engineer to build and maintain scalable data pipelines, manage large-scale event data, and provide actionable insights into user behavior, content performance, and platform usage. You will play a key role in enabling analytics that drives data-driven decisions across the organization.

Key Responsibilities

• Design, develop, and maintain robust ETL pipelines for large-scale data processing.
• Handle event streaming data from platforms such as Kafka or AWS Kinesis.
• Work with Apache Spark (Scala or Python) for batch and real-time data processing.
• Manage and optimize data storage, retrieval, and analytics using AWS services like Glue, EMR, S3, Redshift, and Athena.
• Collaborate with analytics, product, and engineering teams to provide insights on user behavior, content performance, and platform metrics.
• Implement data modeling and data warehouse solutions for structured and semi-structured datasets.
• Ensure data quality, reliability, and performance at scale.
  
  

• Bachelors degree in Computer Science, Engineering, or a related field
• 5+ years of experience in Data Engineering or related roles
• Strong experience with Apache Spark (Scala or Python) and Spark SQL
• Experience building ETL pipelines using AWS services such as Glue and EMR
• Hands-on experience with event streaming systems like Kafka or AWS Kinesis
• Proficiency in SQL and experience working with large-scale datasets
• Experience with AWS ecosystem (S3, Redshift, Athena)
• Good understanding of data modeling and data warehouse concepts
• Internet B2C product experience
  
  

• Experience working with consumer-facing applications (OTT / media platforms preferred)
• Exposure to real-time analytics and event-driven architectures
• Familiarity with data visualization tools like AWS QuickSight (or similar)
• Understanding of user behavior analytics (engagement, retention, etc.)