Databricks Developer

Overview

We are seeking ETL Developers with 3-6 years of experience to join our data engineering team. The ideal candidates will have strong expertise in PySpark, Python, and Databricks, with a proven ability to design, build, and optimize ETL pipelines for large-scale data processing.

Key Responsibilities

• Design, develop, and maintain ETL workflows using PySpark and Databricks.
• Write efficient, reusable, and scalable code in Python for data transformation and integration.
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver high-quality solutions.
• Optimize ETL processes for performance, scalability, and reliability.
• Ensure data quality, consistency, and security across all pipelines.
• Troubleshoot and resolve issues in ETL workflows and data pipelines.
• Document processes, workflows, and best practices.
  
  
  

Required Skills & Qualifications

• 3-6 years of experience in ETL development and data engineering.
• Strong proficiency in PySpark for distributed data processing.
• Solid programming skills in Python.
• Hands-on experience with Databricks for building and managing ETL pipelines.
• Knowledge of data warehousing concepts, relational databases, and SQL.
• Experience with performance tuning and debugging ETL jobs.
• Strong problem-solving skills and ability to work in a collaborative environment.
  
  
  

Preferred Qualifications

• Exposure to cloud platforms (Azure, AWS, or GCP).
• Experience with CI/CD pipelines and version control (Git).
• Familiarity with data governance and security best practices.
  
  
  

Responsibilities

We are seeking ETL Developers with 3-6 years of experience to join our data engineering team. The ideal candidates will have strong expertise in PySpark, Python, and Databricks, with a proven ability to design, build, and optimize ETL pipelines for large-scale data processing.

Key Responsibilities

• Design, develop, and maintain ETL workflows using PySpark and Databricks.
• Write efficient, reusable, and scalable code in Python for data transformation and integration.
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver high-quality solutions.
• Optimize ETL processes for performance, scalability, and reliability.
• Ensure data quality, consistency, and security across all pipelines.
• Troubleshoot and resolve issues in ETL workflows and data pipelines.
• Document processes, workflows, and best practices.
  
  
  

Requirements

We are seeking ETL Developers with 3-6 years of experience to join our data engineering team. The ideal candidates will have strong expertise in PySpark, Python, and Databricks, with a proven ability to design, build, and optimize ETL pipelines for large-scale data processing.

Key Responsibilities

• Design, develop, and maintain ETL workflows using PySpark and Databricks.
• Write efficient, reusable, and scalable code in Python for data transformation and integration.
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver high-quality solutions.
• Optimize ETL processes for performance, scalability, and reliability.
• Ensure data quality, consistency, and security across all pipelines.
• Troubleshoot and resolve issues in ETL workflows and data pipelines.
• Document processes, workflows, and best practices.

---