Developer - Java Spark L3

Job description:

Job Description

Role Purpose

We are seeking a skilled Developer with expertise in Java, Spring, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.

Responsibilities

•             Develop and maintain Java-based applications using the Spring framework.

•             Design and implement batch processing solutions using Spark Batch for large-scale data processing.

•             Build real-time data pipelines using Spark Streaming for processing streaming data.

•             Collaborate with cross-functional teams to define, design, and deliver new features.

•             Optimize data processing workflows for performance, scalability, and reliability.

•             Troubleshoot and resolve issues related to data processing, application performance, and system integration.

•             Write clean, maintainable, and well-documented code following best practices.

•             Participate in code reviews, unit testing, and system testing to ensure quality deliverables.

•             Stay updated with emerging technologies and propose improvements to existing systems.

Required Skills and Qualifications

•             Education: Bachelor’s degree in computer science, Engineering, or a related field.

•             Experience: 7+ years of professional experience in Java development.

•             Technical Skills:

o             Strong proficiency in Java (version 8 or higher) and object-oriented programming.

o             Hands-on experience with Spring (Spring Boot, Spring MVC, or Spring Data) for building enterprise applications.

o             Expertise in Spark Batch for large-scale data processing and analytics.

o             Experience with Spark Streaming for real-time data processing and streaming pipelines.

o             Familiarity with distributed computing concepts and big data frameworks.

o             Proficiency with version control systems like Git.

o             Knowledge of build tools such as Maven or Gradle.

o             Understanding of Agile/Scrum methodologies.

Soft Skills:

o             Strong problem-solving and analytical skills.

o             Excellent communication and teamwork abilities.

o             Ability to manage multiple priorities and work independently.

Preferred Skills

•             Experience with big data technologies like Hadoop, Kafka, or Hive.

•             Knowledge of containerization tools like Docker or Kubernetes.

•             Experience with CI/CD pipelines and tools like Jenkins.

•             Understanding of data storage solutions like HDFS, Cassandra, or MongoDB.