PySpark Databricks

Bachelors degree or equivalent in Computer Engineering, Computer Science, or a related field.

5+ years of experience in data / software engineering role.

3+ years of experience with building AWS or Azure cloud-based data pipelines and AI solutions.

3+ years of experience with Python and Spark.

Strong experience with Databricks, including Spark-based processing, data pipelines, and the platforms tools for analytics and machine learning.

The role holder will possess a blend of design skills needed for Agile data development projects.

Proficiency or demonstratable passion for learning, in data engineer techniques and testing methodologies.

Strong written and verbal communications skills.

Desirable Skill

Databricks certification.

Experience working within a DevOps delivery model.

Experience of working within a quality and compliance environment and application of policies, procedures, and guidelines.

Industry experience with data in large, complex data settings, consultancy or vendor experience