Fabric Pyspark SQL - Senior Manager

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

At PwC - AC, we are looking for an Azure Senior Manager- Data & AI who will have:

• Passion for technology, in the space of Analytics
• Hands-on experience in Cloud Analytics, Data Engineering
• Hands-on experience in building large data repositories in Cloud
• Hands-on experience in designing and implementing large-scale transformation programs in Cloud, Enterprise Data Management
• Engage with business stakeholders, to understand client requirements and build technical solutions and delivery plans
• Demonstrable technical knowledge in skills and streams mentioned in the Technical Skills section
• Lead the end-to-end design and architectural strategy for TMT services solutions leveraging Azure and Databricks
• Demonstrate strong business acumen with a proven ability to understand market dynamics, financial implications of operational choices, and deliver long-term strategic value
• In-depth understanding of core banking systems, risk management, regulatory frameworks, and digital transformation in financial services
• Experience in working with cross functional and geographically separated teams
• Experience in technical scoping of projects, drawing delivery plans
• Experience in leading technical teams, guiding and mentoring team members
• Experience in presenting technical and business executive presentations to leadership
• Responsible for the design and execution of abstractions and integration patterns (APIs) to solve complex distributed computing problems.
  
  

Years of Experience: 12 - 16 Years

Position Requirements

Must Have Skills:

• Proficient with Azure cloud computing, including big data technologies.
• Experience with deep understanding in both traditional and modern data architecture and processing concepts including relational databases (e.g., SQL Server, MySQL, PostgreSQL), Data warehousing, big data, NoSQL and business analytics
• Rich experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
• Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Understanding of big data use-cases and Lambda/Kappa design patterns
• Knowledge of real time/stream analytics trends.
• Architecture, design, implementation, and/or support of complex application architectures (i.e. having an architectural sense for connecting data sources, data visualization, structured and unstructured data, etc.)
• Demonstrable hands-on experience implementing Big Data solutions using Microsoft Data Platform and Azure Data Services
  
  

Azure SQL DB, Azure Synapse Analytics, Azure HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Azure Machine Learning, Stream Analytics, Azure Data Factory, Azure CosmosDB and Power BI

• Exposure to Open-Source technologies such as Apache Spark, Hadoop, NoSQL, Kafka, Solr/Elastic Search
• Should be well versed with quality processes and implementation
• Excellent communication skills
• Business / domain knowledge in TMT Domain
• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
• Good understanding of Data Modeling and Data Architecture
  
  

Certification

• Data Engineering on Microsoft Azure (DP 200/201/203)
• Azure Solutions Architect Expert (AZ 303/304)
  
  

Good To Have Skills

• Cloud - AWS, GCP, Informatica-Cloud, Oracle-Cloud
• Cloud DW - Snowflake, Databricks
• Data Engineering - Java, Python, Pyspark, R-Programming
• Data Integration - Informatica, DataStage, AbInitio
• Business Intelligence - MicroStrategy, Business Objects, Cognos
• Data Visualization – Tableau, Qlik
• Data Appliance - Teradata, Netezza
  
  

Additional Skills

• Excellent communication skills, client presence, presentation skills
• People skills, Leadership skills
• Engage with business and technical teams to drive consensus
• Experience in Pre-Sales and proposal response
  
  

Education

• BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA
  
  

Additional Information

• Travel Requirements: Travel to client locations may be required as per project requirements.
• Line of Service: Advisory
• Horizontal: Technology Consulting
• Designation: Senior Manager
• Location: Bangalore, India
  
  

The Opportunity

When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.

As part of the Data Engineering team you will lead the design and implementation of innovative data solutions that drive business intelligence. As a Senior Manager, you will serve as a strategic advisor, leveraging your knowledge to influence project outcomes and secure operational excellence while guiding top-performing teams to deliver exceptional results.

Responsibilities

• Lead the development and execution of innovative data solutions
• Serve as a strategic advisor to influence project success
• Secure operational excellence through impactful team guidance
• Foster top-performing teams to achieve exceptional outcomes
• Analyze complex data challenges and propose actionable solutions
• Collaborate with stakeholders to align data initiatives with business goals
• Drive continuous improvement in data engineering processes
• Communicate effectively to convey project vision and objectives
  
  

What You Must Have

• Bachelors Degree
• 12 years of experience in data engineering or related roles
• Oral and written proficiency in English required
  
  

What Sets You Apart

• Experience developing reports and dashboards using Power BI
• Understanding of DevOps practices in data projects
• Familiarity with Delta Lake or Lakehouse architecture
• Experience with Data Modeling and ETL orchestration
• Demonstrating problem-solving skills and teamwork
• Additional Graduate/Post Graduate educational requirements
• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Power BI Data Analyst Associate

---