Hadoop Architect - Customer Data Platform

Job Title : Hadoop Solution Architect.

Experience : 10-18 years in Analytics and Big Data with at least the last 3-4 years in CDP Hadoop solution Architect role.

Location : Mumbai, India.

Department : Big Data, Analytics and Cloud.

Company : Smartavya Analytica Private limited is niche Data and AI company.

Experience : 12-18 years of experience in Analytics and Big Data, with at least the last 6 years or more in a senior role specifically focusing on Hadoop architecture and administration.

Key Responsibilities

• Lead the end-to-end architecture, design, and implementation of Hadoop-based Cloudera CDP on-prem data solutions.
• Ensure data availability, scalability, and reliability across Hadoop clusters.
• Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and deliver tailored big data solutions.
• Optimize and tune Hadoop systems for performance and scalability.
• Maintain and document Hadoop environments to ensure reproducibility and reliability of data processes.
• Oversee the integration of Hadoop with other data systems and tools.
• Implement and manage data security, privacy, and governance frameworks within Hadoop ecosystems.
• Mentor and guide junior team members, fostering a culture of continuous learning and improvement.
• Drive continuous improvement initiatives to enhance Hadoop capabilities and operational efficiency.
• Communicate complex technical concepts and solutions to non-technical stakeholders effectively.
  
  

• Extensive proficiency in Hadoop ecosystems, including HDFS, Ozone, Kudu, Spark Streaming, YARN, Hive, and Spark.
• Excellent Performance tuning skills is a must.
• Strong leadership and project management skills, with a demonstrated ability to manage large-scale data projects.
• Client Engagement and Presentation skills are mandatory.
• Experience with Hadoop administration and optimization on various operating environments.
• Excellent problem-solving skills and the ability to manage failures in a production setting.
• Familiarity with Reporting tools, Data Integration Tools and ETL processes.
• Strong communication and collaboration skills to work effectively with business users and cross-functional teams.
• Ability to work in high-pressure situations and handle multiple priorities.
  
  

• Bachelors degree in computer science, Information Technology, or a related field.
• Relevant certifications (e.g., Cloudera Certified Architect, Hortonworks Data Platform Certified) are a plus.