Java Spark Lead

Strong understanding of distributed computing and big data concepts. Experience with Hadoop ecosystem, Kafka, Hive, and other data tools is a plus. Proficiency in writing optimized Spark jobs and handling large-scale data. Familiarity with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes). Excellent problem-solving, communication, and leadership skills.

Lead the design and development of scalable data processing solutions using Java and Apache Spark. Collaborate with data architects, analysts, and other stakeholders to understand data requirements. Optimize Spark jobs for performance and scalability in distributed environments. Ensure code quality through code reviews, unit testing, and best practices. Mentor and guide junior developers and contribute to team growth. Work closely with DevOps to deploy and monitor applications in production. Troubleshoot and resolve technical issues across the data pipeline. Stay updated with emerging technologies and propose improvements.

Experience with CI/CD pipelines and version control systems (Git). Knowledge of Scala or Python is a plus. Certifications in Big Data or Cloud technologies.