PySpark Developer Senior Data Engineer
Talentmate
India
19th August 2026
2608-43628-14
Job Description
Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees. If you are a PySpark Developer / Senior Data Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page. We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long-term project. Here are a few details. Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.
Requirements
We are looking for an experienced PySpark Developer with strong hands-on expertise in big data processing, distributed computing, and data engineering. The ideal candidate will have deep experience building scalable data pipelines, transforming large datasets, and working with Spark-based ecosystems in production environments.
Key Responsibilities
- Design, build, and maintain scalable data pipelines using PySpark and Apache Spark
- Develop efficient ETL/ELT workflows for batch and near-real-time processing
- Optimize Spark jobs for performance, reliability, and cost efficiency
- Work with large structured and unstructured datasets
- Integrate data from multiple sources such as databases, APIs, files, and cloud storage
- Write reusable, modular, and maintainable PySpark code
- Troubleshoot job failures, data quality issues, and performance bottlenecks
- Collaborate with data architects, analysts, platform teams, and business stakeholders
- Implement data validation, monitoring, and logging frameworks
- Support deployment, scheduling, and orchestration of data pipelines
- Participate in design reviews, code reviews, and technical discussions
- Mentor junior engineers and contribute to team best practices
Required Skills
- Strong hands-on experience with PySpark and Apache Spark
- Deep understanding of Spark concepts such as RDDs, DataFrames, datasets, partitioning, caching, shuffling, joins, and window functions
- Strong Python programming skills
- Experience with SQL and relational databases
- Knowledge of big data concepts and distributed data processing
- Hands-on experience with ETL/ELT pipeline development
- Good understanding of performance tuning and optimization techniques in Spark
- Experience with version control tools like Git
- Familiarity with Linux/Unix environments
- Strong debugging and analytical skills
Benefits
Visit us at http://alignity.io/careers. Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.
CEO Message: Click Here
Clients Testimonial: Click Here
Job Details
| Role Level: | Mid-Level | Work Type: | Contract |
|---|---|---|---|
| Country: | India | City: | Hyderabad ,Telangana |
| Company Website: | https://alignity.io | Job Function: | Data Science & AI |
| Company Industry/ Sector: |
IT Services and IT Consulting | ||
What We Offer
About the Company
Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.
Recent Jobs
View More Jobs
Copyright © 2026 TALENTMATE. All rights reserved.
