Databricks Solution Architect

Job Summary

We are seeking a highly experienced and strategic Solution Architect with 15 17 years of expertise in cloud platforms (Azure), data engineering (Databricks, PySpark, Scala), and full-stack development. The ideal candidate will have a strong background in solution architecture, IT strategy, and end-to-end product delivery, with proven leadership in managing technical teams and driving enterprise-scale transformation initiatives.

Key Responsibilities

Architecture & Design

Lead the design and implementation of scalable, secure, and high-performing solutions across Azure Cloud (PaaS, IaaS, SaaS, AKS).

Architect and integrate Databricks solutions including PySpark, Scala, and Unity Catalog for advanced data processing and analytics.

Define and enforce architectural standards, governance models, and best practices.

Technology Leadership

Provide full-stack technical leadership across .NET Core (C#, Web API, MVC), Python, NodeJS, ReactJS, Angular, and SQL.

Oversee development pipelines using Jenkins, Git, and agile tools like JIRA.

Guide containerization and microservices strategies using Docker and AKS.

Cloud Strategy & DevOps

Drive cloud migration, modernization, and cost optimization initiatives on Azure.

Automate infrastructure provisioning and management using Azure CLI and PowerShell.

Ensure seamless CI/CD pipeline integration and DevOps practices across environments.

Business & IT Alignment

Collaborate with business stakeholders and product owners to understand requirements and align technical solutions with business goals.

Conduct feasibility studies, solution evaluations, and technical assessments.

Lead business analysis and contribute to IT strategy and long-term technology planning.

Leadership & Delivery

Manage cross-functional development teams and mentor junior engineers.

Own delivery and quality of complex IT solutions from ideation to production.

Establish and track KPIs, development standards, and performance metrics.

Required Skills & Qualifications 17 years of progressive experience in software engineering, with at least 5+ years in architecture roles.

Hands-on experience with Databricks (PySpark, Scala, Unity Catalog).

Strong Azure expertise across PaaS, IaaS, SaaS, AKS, and DevOps.

Expertise in Python, SQL, NodeJS, C#, .NET Core, Web API, MVC, and full-stack web frameworks.

Frontend proficiency in ReactJS and Angular.

Strong scripting and automation skills using Azure CLI and PowerShell.

Experience with SharePoint, Office 365 integrations.

Solid understanding of solution architecture, cloud computing, software development lifecycle (SDLC), and product delivery.

Proven ability to manage teams and deliver enterprise solutions at scale.

Preferred Qualifications

Bachelor or Master degree in Computer Science, Engineering, or a related field.

Microsoft Azure or Databricks certifications.

Experience with enterprise architecture frameworks (e.g., TOGAF).

Exposure to hybrid/multi-cloud environments.

Familiarity with AI/ML integrations and modern data platforms is a plus.