Job Description
Location: Hyderabad, India
Experience: 6–12 Years
Role Overview
We are looking for experienced Data Engineer with strong expertise in SQL, PySpark, Python, and Snowflake to design and maintain scalable data pipelines and engineering frameworks. The role involves cloud data services, Medallion Architecture, ETL/ELT workflows, and orchestration, with exposure to GenAI technologies as an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark, SQL, Python, and Snowflake.
- Build reusable data engineering frameworks for efficient data processing and transformation.
- Implement Medallion Architecture across Bronze, Silver, and Gold layers.
- Develop data ingestion and processing pipelines using AWS Glue and AWS Lambda.
- Implement event-driven and streaming data pipelines using Kafka.
- Orchestrate workflows using Apache Airflow or equivalent tools.
- Optimize SQL queries, Snowflake workloads, and PySpark jobs for performance and scalability.
- Ensure data quality, reliability, and consistency across pipelines.
- Explore GenAI-based data solutions using LLMs, RAG, and LangChain.
- 6–12 years of relevant data engineering experience.
- Strong hands-on expertise in SQL, PySpark, Python, and Snowflake.
- Experience building scalable data pipelines and reusable engineering frameworks.
- Strong understanding of Medallion Architecture and ETL/ELT processes.
- Hands-on experience with Kafka, AWS Glue, and AWS Lambda.
- Experience with Apache Airflow or other workflow orchestration tools.
- Strong problem-solving skills and a focus on data quality and performance.
Apply Now: careers@d4insight.com
Job Details
| Role Level: | Not Applicable | Work Type: | Full-Time |
|---|---|---|---|
| Country: | India | City: | Greater Hyderabad Area |
| Company Website: | http://www.d4insight.com/ | Job Function: | Data Science & AI |
| Company Industry/ Sector: |
Information Technology and Services | ||
What We Offer
About the Company
Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.
Job Snapshot
