Roles & Responsibilities
Job Type: [Full-Time]
Experience Level: 12+ years
Data Architect
Role Summary
We are seeking a highly skilled Azure Data Architect with strong expertise in Azure Cloud, Databricks, and Unity Catalog. The role requires end-to-end ownership of data engineering activities including requirement gathering, solution design, development, and optimization. The candidate will work closely with business stakeholders, analysts, and architects to deliver scalable and secure data solutions that enable advanced analytics and reporting.
Key Responsibilities
- Collaborate with business stakeholders to gather, analyze, and translate requirements into technical data engineering solutions.
- Design, develop, and maintain data pipelines and ETL/ELT processes using Azure Data Factory, Databricks (PySpark, Delta Lake), and Synapse Analytics.
- Implement and manage data governance and security frameworks using Unity Catalog for cataloging, lineage, and access control.
- Develop data models for curated, semantic, and analytical layers to support BI/AI/ML workloads.
- Optimize data pipelines for scalability, performance, and cost-efficiency.
- Ensure data quality, validation, and monitoring across ingestion and transformation layers.
- Integrate multiple Azure services: ADLS Gen2, Azure Data Factory, Azure Synapse, Azure SQL, Event Hub/IoT Hub.
- Support data migration initiatives from on-premises to Azure cloud.
- Collaborate with Data Architects and Analysts on solution design and reporting requirements.
- Contribute to Agile ceremonies (sprint planning, stand-ups, retrospectives) and maintain Jira/ADO work tracking.
- Mentor junior data engineers on best practices and coding standards.
Required Skills & Experience
- 12+ years of professional experience in data engineering.
- Strong hands-on experience with Azure Databricks (PySpark, Delta Lake, Unity Catalog).
- Proficiency in Azure Data Factory, ADLS Gen2, Azure SQL DB, Synapse Analytics.
- Strong programming in Python, PySpark, and SQL.
- Experience in requirement gathering and stakeholder collaboration.
- Good understanding of data modeling, lakehouse concepts, and data warehousing (Kimball/Star Schema).
- Familiarity with CI/CD pipelines, Git-based version control, and DevOps practices.
- Knowledge of security, compliance, and access management in Azure environments.
Preferred Skills
- Azure certifications: Azure Data Engineer Associate (DP-203) or Azure Solutions Architect Expert or Data Bricks Professional / Associate Certification
- Experience with streaming data pipelines using Event Hubs or Kafka.
- Exposure to Power BI integration with Azure data platforms.
- Knowledge of Terraform/ARM templates for IaC.
Education
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
Soft Skills
- Strong analytical and problem-solving mindset.
- Excellent communication and requirement elicitation skills.
- Ability to work independently and mentor team members.
- Strong collaboration with business and technical stakeholders.
Experience
Skills
- Primary Skill: Data Engineering
- Sub Skill(s): Data Engineering
- Additional Skill(s): Python, AWS - EKS, AWS - CloudFormation, Apache Hive, Azure Storage, AWS-Apps, AWS-Infra, Azure Datalake, Azure Data Factory, AWS CloudTrail
About The Company
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.