Hadoop Admin

Who We Are

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

The Role

As a Data Scientist at Kyndryl you are the bridge between business problems and innovative solutions, using a powerful blend of well-defined methodologies, statistics, mathematics, domain expertise, consulting, and software engineering. Youll wear many hats, and each day will present a new puzzle to solve, a new challenge to conquer.

You will dive deep into the heart of our business, understanding its objectives and requirements – viewing them through the lens of business acumen, and converting this knowledge into a data problem. You’ll collect and explore data, seeking underlying patterns and initial insights that will guide the creation of hypotheses.

In this role, you will embark on a transformative process of business understanding, data understanding, and data preparation. Utilizing statistical and mathematical modeling techniques, youll have the opportunity to create models that defy convention – models that hold the key to solving intricate business challenges. With an acute eye for accuracy and generalization, youll evaluate these models to ensure they not only solve business problems but do so optimally.

Cluster management and maintenance

• Deployment: Install, configure, and deploy multi-node Hadoop clusters and all related ecosystem components on Linux environments.
• Node management: Commission and decommission data nodes to scale the cluster based on data and resource needs.
• Configuration: Manage and update service configurations for components like HDFS, YARN, Hive, and Spark.
• Upgrades and patches: Plan and execute upgrades, including rolling out patches and version upgrades for the Hadoop ecosystem.
• Automation: Use configuration management tools like Ansible, Puppet, or Chef to automate cluster deployment and management tasks.
  
  

Monitoring and performance tuning

• System health: Monitor the overall health and performance of the Hadoop cluster using tools like Cloudera Manager or Ambari.
• Job tracking: Keep a close eye on running jobs and resource utilization to ensure they are performing efficiently.
• Performance optimization: Tune the cluster, including Hadoop MapReduce routines and YARN resource allocation, to improve performance.
• Troubleshooting: Diagnose and resolve cluster issues, including application errors, system failures, and configuration problems.
  
  

Security and access control

• Security setup: Implement and maintain security protocols, such as Kerberos authentication, across the Hadoop environment.
• User administration: Create and manage users and groups within Hadoop and the underlying Linux operating system.
• Access control: Manage permissions to ensure data governance policies are enforced.
  
  

Data management and administration

• Data migration: Manage the movement of data into and out of HDFS using tools like Sqoop and Flume.
• Capacity planning: Monitor disk space usage and forecast future storage needs to ensure sufficient capacity.
• Backup and recovery: Design and implement backup and disaster recovery procedures to protect cluster data.
• Log management: Collect, review, and manage log files from the Hadoop daemons for auditing and troubleshooting purposes.
  
  

Collaboration and support

• Inter-team coordination: Work closely with data engineers, developers, and business intelligence teams to support their big data application needs.
• Escalation point: Serve as the point of contact for vendor escalation to resolve critical issues.
• Documentation: Maintain comprehensive documentation of cluster configurations, procedures, and best practices.
  
  

Who You Are

Who You Are

You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.

Required Skills And Experience

Required qualifications and skills

• 10 years of experience as Hadoop Admin
• Technical expertise: Strong knowledge of the Hadoop ecosystem, including HDFS, YARN, MapReduce, Hive, and Spark.
• Linux proficiency: Excellent command of Linux/UNIX commands and shell scripting, as Hadoop is primarily run on Linux.
• Problem-solving: Exceptional analytical and troubleshooting skills to diagnose complex cluster issues.
• Communication: Strong interpersonal and communication skills to collaborate with various technical and business teams.
• Automation skills: Hands-on experience with automation tools like Ansible or Puppet.
• Cloud experience (optional): Experience with cloud-based Hadoop services like Amazon EMR or Azure HDInsight is a plus.
• Database knowledge: Familiarity with database concepts and SQL can be beneficial, particularly for managing Hive and HBase databases.
  
  

Preferred Skills And Experience

• Degree in a quantitative discipline, such as mathematics, statistics, computer science, or mechanical engineering
• Professional certification, e.g., Open Certified Data Scientist
• Cloud platform certification, e.g., AWS Certified Machine Learning – Specialty, Google Cloud Professional Machine Learning Engineer, or Microsoft Certified: Azure Data Scientist Associate
• Understanding of social coding and Integrated Development Environments, e.g., GitHub and Visual Studio
• Experience in at least one domain, e.g., cybersecurity, IT service management, financial services, or health care
  
  

Being You

Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.

What You Can Expect

With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contacts Kyndryl email address.

---