Azure Databricks Manager

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

At PwC - AC, we are looking for an Azure Manager- Data & AI who will have: Strong expertise in managing end-to-end implementations of Azure Databricks within large-scale Data & AI programs. The role involves architecting, designing, and deploying scalable and secure solutions aligned with business requirements, including ETL, data integration, and migration. The candidate will work closely with cross-functional, geographically distributed teams and clients to understand strategic requirements and translate them into effective technology solutions. Responsibilities include technical project scoping, delivery planning, team leadership, and ensuring timely execution of high-quality solutions. The manager will utilize big data technologies to develop scalable, fault-tolerant components, facilitate stakeholder engagement, resolve roadblocks, and stay current with emerging technologies to maximize client ROI

Years of Experience: Candidates 8-12 years of hands on experience

Position Requirements

Must Have:

• Experience with designing, architecting, and implementing scalable Azure Data Analytics solutions leveraging Azure Databricks.
• Proficiency in Azure Databricks, including Spark architecture and optimization.
• Proficient with Azure cloud computing including big data technologies.
• Experience with deep understanding in both traditional and modern data architecture and processing concepts including relational databases (e.g., SQL Server, MySQL, PostgreSQL), Data warehousing, big data, NoSQL and business analytics
• Rich experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
• Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Practical knowledge of end-to-end design and build process of Near-Real Time and Batch Data Pipelines; expertise with SQL and Data modeling working in Agile development process.
• Architecture, design, implementation, and/or support of complex application architectures (i.e. having an architectural sense for connecting data sources, data visualization, structured and unstructured data, etc.)
• Demonstrable hands on experience implementing Big Data solutions using Microsoft Data Platform and Azure Data Services using the Azure Data Analytics platform including Azure Databricks, Azure Cosmos DB, Azure Data Factory, Azure Logic Apps, Azure Functions, Azure Storage, Azure Synapse Analytics, Azure Data Lake, Azure Search
• Experience working in a Dev/Ops environment with tools such as Chef, Puppet or Terraform
• Strong analytical skills and troubleshooting skills
• Should be well versed with quality processes and implementation
• Excellent communication skills
• Business / domain knowledge in one of the domains -Financial Services/ Healthcare/ Consumer Market/Industrial Products/ Telecommunication,Media and Technology /Deal advisory along with technical expertise
• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
• Good understanding of Data Modeling and Data Architecture
  
  

• Data Engineering on Microsoft Azure (DP 200/201/203)
  
  

• Cloud - AWS, GCP, Informatica-Cloud, Oracle-Cloud
• Cloud DW - Snowflake, Databricks
• Certifications in Azure Databricks
• Open Source technologies such as Apache Spark, Hadoop, NoSQL, Kafka, Solr/Elastic Search
• Data Engineering - Java, Python, Pyspark, R-Programming
• Data Visualization – Tableau, Qlik
  
  

• BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA
  
  

• Travel Requirements: Travel to client locations may be required as per project requirements.
• Line of Service: Advisory
• Horizontal: Technology Consulting
• Designation: Manager
• Location: Bangalore, India
  
  

• Add here AND change text color to black or remove bullet and section title if not applicable
  
  

• Add here AND change text color to black or remove bullet and section title if not applicable