Azure Data Engineer - Hybrid

Our brand, Lennor Metier Consulting, a DOLE-licensed headhunting and recruitment agency in the Philippines, is proud to partner with a AI Consulting and IT Services Company in their search for an Azure Data Engineer living in the Philippines to work on a hybrid, but primarily remote set up

Salary Range: up to $20 per hour

Working Hours: 8 hours a day, 40 hours a week

Work Setup: Hybrid

Shift Schedule: Shifting Schedule

Location: Luzon, Visayas, or Mindanao. The office address will depend on your location

The Role

This position designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.

Your Responsibilities

• Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
• Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
• Ensure data quality and integrity through data validation techniques and frameworks.
• Develop and maintain documentation for data processes, configurations, and best practices.
• Monitor and troubleshoot data pipeline issues to ensure timely resolution.
• Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
• Manage the CI/CD process for deploying and maintaining data solutions.
  
  

• Bachelor’s Degree in computer science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals is required
• At least 5-7 years of experience as a Data Engineer or in similar roles dealing with data and ETL processes.
• Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
• Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
• Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
• Experience with big data technologies (e.g., Spark).
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills
  
  

• We kindly request your patience as we receive a significant number of applications. Rest assured that our team will update your applications status soon. In the meantime, we encourage you to follow our LinkedIn page to stay informed about future opportunities and company updates.