Sr Azure Databricks Developer

Area(s) of responsibility

About Birlasoft

Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CKA Birla Group, a multibillion-dollar enterprise, we boast a 12,500+ professional team committed to upholding the Groups 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose.

About the Job – Our project is hiring a skilled Databricks Developer to drive data engineering and analytics solutions.

Job Title - Azure Data Engineer

Location: Hyderabad , Pune

Educational Background: Bachelor’s degree in computer science, Information Technology, or related field.

Mode of Work- Hybrid

Experience Required - 6-8 Years

Key Responsibilities

• Experience in Perform Design, Development & Deployment using Azure Services ( Data Factory, Azure Data Lake Storage, Databricks, PySpark, SQL)
• Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity.
• Experience in create the Technical Specification Design, Application Interface Design.
• Files Processing – XML, CSV, Excel, ORC, Parquet file Formats
• Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data
• Good to have experience with ETL development both on-premises and in the cloud using SSIS, Data Factory, and related Microsoft and other ETL technologies (Informatica preferred)
• Demonstrated in depth skills with Azure Data Factory, Azure Databricks, PySpark, ADLS (must have) with the ability to configure and administrate all aspects of Azure SQL DB.
• Collaborate and engage with BI & analytics and business team
• Deep understanding of the operational dependencies of applications, networks, systems, security and policy (both on premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.),