Job Description

We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. The ideal candidate will design, build, and optimize scalable data pipelines with strong SQL proficiency and data modeling expertise.

Responsibilities

  • Design, develop, and maintain scalable pipelines to process structured and unstructured data.
  • Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
  • Experience working with data warehouse solutions (e. g., Redshift, BigQuery, Snowflake) for analytics and reporting.
  • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
  • Experience in Implementing solutions for streaming data (e. g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
  • Ensure data quality, governance, and security across pipelines and storage systems.
  • Document architectures, processes, and workflows for clarity and reproducibility.

Requirements

  • 4 or more years of experience in Data Engineering file.
  • Expertise in SQL (complex queries, optimization, and database design).
  • Write optimized and production-grade SQL scripts for transformations and data validation.
  • Solid understanding and hands-on experience in creating data pipelines and patterns.
  • Proficiency in any programming languages like Python or R for scripting, automation, and pipeline development.
  • Hands-on experience with Google Bigquery and Apache Airflow.
  • Experience working on any cloud-based platforms like AWS or GCP or Azure.
  • Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
  • Familiarity with cloud-based data warehouses (Redshift, BigQuery, Snowflake).
  • Knowledge of version control systems (e. g., Git) and CI/CD practices.

This job was posted by Kumar Ags from BigThinkCode.


Job Details

Role Level: Not Applicable Work Type: Full-Time
Country: India City: Chennai ,Tamil Nadu
Company Website: https://www.bigthinkcode.com/ Job Function: Information Technology (IT)
Company Industry/
Sector:
Software Development IT Services and IT Consulting and Technology Information and Internet

What We Offer


About the Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.


Recent Jobs
View More Jobs
Talentmate Instagram Talentmate Facebook Talentmate YouTube Talentmate LinkedIn