Data Engineer

Job Requirements

As a Fabric Data Engineer, you will be responsible to design, develop and optimize enterprise-scale data solutions leveraging Microsoft Fabric. You will work closely with cross-functional teams to integrate data from various sources, including SAP ERP and non-ERP systems. The ideal candidate will possess strong expertise in PySpark, Python,SQL Fabric Lakehouse, Data Factory and Data Warehousing.

·      Design and implement data integration solutions using Microsoft Fabric.

·      Integrate data from API, SAP ERP and non-ERP sources like Zoho CRM, Wrench, ManageEngine ITSM tool, Sourcing Tool, HRMS, and other digital solutions.

·      Develop and maintain ETL processes using PySpark and Python to ensure data accuracy and consistency.

·      Design, develop and maintain scalable data pipelines using Microsoft Fabric.

·      Develop solutions leveraging Fabric Lakehouse, Data Warehouse, Notebooks and Data Factory.

·      Implement medallion architecture (Bronze, Silver, Gold) for enterprise data platforms.

·      Perform data transformation, cleansing, validation and enrichment activities.

·      Develop reusable frameworks and accelerators for data processing.

·      Collaborate with business stakeholders to understand data requirements and deliver actionable insights.

·      Create and optimize data models and dashboards in Power BI.

·      Monitor and troubleshoot data integration workflows to ensure optimal performance.

·      Good exposure on Fabric Administration, Governance, Monitoring and Automation.

·      Document data integration processes and provide training to end-users.

·      Communicate with IT business partners to elicit, analyze, communicate, document, and validate requirements.

·      Documentation and adherence to change control policies & procedures of software development or project management lifecycle methodologies.

Qualifications:

·      Bachelor’s degree in computer science, Information Technology, or a related field.

·      Proven experience as a Data Engineer, with expertise in Microsoft Fabric and Power BI.

·      Strong knowledge of SAP ERP and non-ERP systems integration.

·      Proficiency in ETL tools and techniques.

·      Experience with data modeling and visualization in Power BI.

·      Excellent problem-solving skills and attention to detail.

·      Strong communication and collaboration skills.