Databricks

Role & Responsibilities

• Develop and optimize data pipelines using Databricks and Apache Spark to support scalable data analytics solutions.
• Collaborate with data engineers and data scientists to implement advanced data models and machine learning algorithms.
• Maintain and enhance existing data workflows, ensuring efficient ETL processes and data integrity.
• Monitor system performance and troubleshoot issues proactively to ensure high availability.
• Contribute to the deployment of data solutions on cloud platforms such as Azure or AWS.
• Document technical specifications and best practices for data engineering projects.
  
  

• Must-Have: Expertise in Apache Spark and Databricks platform, proficiency in Python and SQL, experience with Data Lake architecture, knowledge of ETL processes, familiarity with cloud platforms like Azure or AWS, strong analytical and problem-solving skills, ability to work on-site in India.
• Preferred: Experience with Scala programming, understanding of data security and governance, certifications in Databricks or cloud services.
  
  

• Dynamic work environment fostering innovation and growth.
• Opportunities for professional development and certifications.
• Collaborative team culture committed to excellence.