Data Engineer 2

Division: Information Technology

Employment Status: Exempt

Salary Grade: 106

Shift

Requisition ID: 77099

Please be aware that if you are selected to formally interview for an internal position you will be required to notify your current manager. Please refer to the Employee Transfers Guidelines posted on Skylink.

Description

We are seeking a Data Engineer II to design, build, and enhance scalable, high‑performance data solutions across the enterprise. This role is hands-on and focused on delivering reliable, well‑architected data pipelines and platforms that enable analytics, reporting, and data-driven decision-making.

As a Data Engineer II, you will contribute to our evolving data ecosystem by implementing best practices, optimizing data workflows, and collaborating with cross-functional teams. You will help shape the data engineering foundation by building robust pipelines, improving data quality, and ensuring efficient data access for business and analytics teams.

Responsibilities

Key Responsibilities

• Implement, scalable data pipelines using Apache Spark, Databricks, and Azure Data Factory.
• Design and optimize ETL/ELT workflows for both structured and unstructured data.
• Build and maintain distributed data platforms using Databricks, Delta Lake, Cassandra, and other modern data stores.
• Leverage Delta Live Tables (DLT) to deliver reliable, maintainable, and testable batch and streaming pipelines.
• Design and maintain data models for cloud data warehouses such as Databricks and/or Snowflake.
• Apply advanced performance‑optimization techniques including partitioning, indexing, and compression.
  
  

• Integrate Databricks with Azure Machine Learning, Azure Synapse, and other Azure services.
• Implement and govern CI/CD pipelines using Azure DevOps and Terraform.
• Collaborate with data scientists to deploy and manage ML models using MLflow.
• Ensure high standards for data quality, security, compliance, and governance across all platforms.
• Troubleshoot and resolve complex issues related to data pipelines, infrastructure, and workflows.
  
  

• Bachelor’s degree with 3-5 years of data engineering experience
• Strong in Azure‑based data platforms, including Databricks, Spark, Kafka, and Cassandra.
• Proficient in Python, SQL, and/or Scala, with experience in large‑scale distributed systems.
• Experience in cross‑functional teams and delivering complex, enterprise data solutions.
• Azure or Databricks certifications preferred.