Azure Databricks Design And Architecture - Senior Associate

A career in our Advisory Acceleration Centre is the natural extension of PwC’s leading class global delivery capabilities. We provide premium, cost effective, high quality services that support process quality and delivery capability in support for client engagements.

Brief Company Description

At PwC, we connect people with diverse backgrounds and skill sets to solve important problems together and lead with purpose—for our clients, our communities and for the world at large. It is no surprise therefore that 429 of 500 Fortune global companies engage with PwC.

Acceleration Centers (ACs) are PwC’s diverse, global talent hubs focused on enabling growth for the organization and value creation for our clients. The PwC Advisory Acceleration Center in Bangalore is part of our Advisory business in the US. The team is focused on developing a broader portfolio of solutions for Risk Consulting, Management Consulting, Technology Consulting, Strategy Consulting, Forensics as well as vertical specific solutions.

PwCs high-performance culture is based on passion for excellence with a focus on diversity and inclusion. You will collaborate with and receive support from a network of people to achieve your goals. We will also provide you with global leadership development frameworks and the latest in digital technologies to learn and excel in your career. At the core of our firms philosophy is a simple construct: We care for our people.

Globally PwC is ranked as the 3rd most attractive employer according to Universum. Our commitment to Responsible Business Leadership, Diversity & Inclusion, work-life flexibility, career coaching and learning & development makes our firm one of the best places to work, learn and excel.

Apply to us if you believe PwC is the place to be. Now and in the future!

Job Overview

At PwC - AC, as an Azure Senior Developer, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions.The candidate should have strong experience in Azure cloud using Storage services (Blob, ADLS, PaaS SQL), Azure Data factory and Azure Synapse . Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cloud solutions.

Years of Experience: Candidates with 4-8 years of hands-on experience

Position Requirements

Must Have:

• Proficient with Azure cloud computing, including big data technologies.
• Experience with deep understanding in both traditional and modern data architecture and processing concepts including relational databases (e.g., SQL Server, MySQL, PostgreSQL), Data warehousing, big data, NoSQL and business analytics
• Rich experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
• Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Design and implement scalable ETL/ELT pipelines using Databricks and Apache Spark
• Optimize data workflows and ensure efficient data processing
• Understanding of big data use-cases and Lambda/Kappa design patterns
• Knowledge of real time/stream analytics trends.
• Architecture, design, implementation, and/or support of complex application architectures (i.e. having an architectural sense for connecting data sources, data visualization, structured and unstructured data, etc.)
• Demonstrable hands-on experience implementing Big Data solutions using Microsoft Data Platform and Azure Data Services
  
  

• Exposure to Open-Source technologies such as Apache Spark, Hadoop, NoSQL, Kafka, Solr/Elastic Search
• Should be well versed with quality processes and implementation
• Excellent communication skills
• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
• Good communication and presentation skills
  
  

• Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O
• Knowledge in Python
• Certification on AWS Architecture desirable
• Worked in Offshore / Onsite Engagements
• Experience in AWS services like STEP & Lambda
• Good Project Management skills with consulting experience in Complex Program Delivery
• Good to have knowledge in Cloud - AWS, GCP, Informatica-Cloud, Oracle-Cloud, Cloud DW - Snowflake & DBT
  
  

• BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA
• Good analytical & problem-solving skills
• Good communication and presentation skills