senior analyst

Job Description

JOB DESCRIPTION

We are seeking a skilled and motivated Data Engineer with 3+ years of experience to join our team. The ideal candidate should be experienced in data engineering on Databricks, with a focus on developing, maintaining, and optimizing large-scale data pipelines and solutions. You will collaborate with cross-functional teams to deliver high-quality data solutions that meet business requirements.

Key Responsibilities:

• Design, develop, and maintain data pipelines using Databricks and Apache Spark.
• Extract, transform, and load (ETL) data from various sources(structured and unstructured) into the Databricks platform.
• Optimize data pipelines for performance and scalability.
• Collaborate with data analysts and data scientists to understand data requirements and provide data solutions.
• Implement data quality checks and monitoring mechanisms.
• Troubleshoot and resolve data pipeline issues.
• Stay up-to-date with the latest data engineering technologies and best practices.
• Participate in code reviews and contribute to documentation to ensure best practices are followed.
  
  

Required Skills and Experience:

• Bachelors degree in Computer Science, Data Science, Engineering, or a related field.
• 3+ years of experience in data engineering or related fields.
• Strong proficiency in Python or Scala programming languages.
• Hands-on experience with Databricks and Apache Spark.
• Knowledge of SQL and data warehousing concepts.
• Experience with cloud platforms (AWS, Azure, GCP).
• Understanding of data modeling and data warehousing principles.
• Strong problem-solving and analytical skills, with attention to detail.
• Excellent communication and collaboration skills.
• Exposure to CI/CD practices in Databricks environments.
• Basic knowledge of machine learning lifecycle and model deployment on Databricks.
• Experience with data orchestration tools such as Apache Airflow.
  
  

Bonus Skills:

About The Team

eClerx is a global leader in productized services, bringing together people, technology and domain expertise to amplify business results. Our mission is to set the benchmark for client service and success in our industry. Our vision is to be the innovation partner of choice for technology, data analytics and process management services. Since our inception in 2000, weve partnered with top companies across various industries, including financial services, telecommunications, retail, and high-tech. Our innovative solutions and domain expertise help businesses optimize operations, improve efficiency, and drive growth. With over 18,000 employees worldwide, eClerx is dedicated to delivering excellence through smart automation and data-driven insights. At eClerx, we believe in nurturing talent and providing hands-on experience.

eClerx is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, or any other legally protected basis, per applicable law.

---