Lead System Administrator - Hadoop

Sr/ Lead Engineer – Hadoop

Let’s be unstoppable together!

At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana.

Job Responsibilities

• Experience in installing, configuration, Supporting and Managing of MapR and ODP Apache Hadoop Cluster with Ambari.
• Experiencing in installing and configuring components HDFS, MapReduce, TEZ, Hive, Yarn, Sqoop, Oozie, HBase, Scala, Spark, Kafka in Hadoop ecosystems.
• Worked with Ambari and MCS ( MapR ) for monitoring and administrating the Hadoop Multi Node Clusters.
• Expert in Administrating and Managing ODP Apache Hadoop Cluster with Ambari, DR and MapR.
• Experience in Administrating the Linux/Unix systems to deploy Hadoop Clusters.
• Expertise in Monitoring multiple Hadoop Clusters environments using Ambari Metrics, MCS and Grafana.
• Configuring Name Node, Data Node, Resource Manager and HiveServer2 High Availability and Clusters service coordination using Zookeeper.
• Performing Backup, Disaster Recovery, Root Cause Analysis for Hadoop and Troubleshooting Hadoop Cluster issues.
• Importing and Exporting Data between Relational Database Systems (RDBMS) and HDFS using Sqoop.
• Hands on Experience in Configuring Kerberos for Authentication.
• Experience in maintaining and monitoring the MapR and Ambari
• Proficient in performing Minor and Major Upgrades, Commissioning and Decommissioning of data nodes on Hadoop Cluster.
• Experience in integrating Hadoop Cluster components with LDAP, Active Directory and enabling SSL for Hadoop Cluster Components.
• Experiencing writing Hive queries using Hive Query Language HiveQL.
• Strong working knowledge in writing queries in SQL.
• Experience in monitoring the kerberized Hadoop Cluster using Grafana.
• Experience in Installation, Configuration, Backup, Recovery, Maintenance, Support of Linux.
• Extensive knowledge on Hadoop Application Frameworks like Hive and Spark.
• Experience with System Integration, Capacity Planning, Performance Tuning, System Monitoring, System Security and Load Balancing.
• Excellent Knowledge on YUM and RPM Package Administration for Installing, Upgrading and Checking dependencies.
• Very good knowledge on python Familiar with Java.
• Knowledge on Sudoers Configuration and administration on Red Hat Linux Environment.
  
  

• 5+ years of Hadoop Administration and Linux/Unix Experience
• Demonstrated success in communication, collaboration and motivation of cross-functional departments to achieve exceptional service.
• Strategic thinking, complex problem solving and analytical capabilities.
• Excellent Communication, diagnostic and issue resolution skills
• Ability to see the big-picture and take a holistic approach to problem-solving.
• Ability to take complex information and communicate in a manner that is understandable to all audiences.
• Demonstrated understanding of the evolving landscape of technology.
• Ability to effectively network with colleagues to share knowledge and gain new perspectives.
  
  

• Hadoop Distribution: MapR, Apache Hadoop (ODP), Cloudera/Hortonworks.
• Hadoop Ecosystem: HDFS, MapReduce, YARN, Hive, Sqoop, Zookeeper, HBase, Spark.
• Configuration Management: Ambari, MapR, and Cloudera Manager.
• Security: LDAP, AD SSL, and Kerberos.
• Languages: SQL, Shell Scripting, bash, Spark SQL, HiveQL.
• Databases: MySQL, PostgreSQL.
• Monitoring Tools: Ambari, Grafana, Kibana.
• Package Management: RPM, YUM.
• Networking and Protocols: LAN, WAN, TCP/IP, NFS, LDAP, DNS.
• Operating Systems: RHEL, Oracle Enterprise Linux, Cent OS, Ubuntu.
• Job Scheduling Tools: Crontab, Airflow, Oozie.
  
  

• Stay Curious: Being hungry to learn and grow, always asking the big questions
• Seek Clarity: Embracing complexity to create clarity and inspire action
• Own the Outcome: Being accountable for decisions and taking ownership of our choices
• Center on the Client: Relentlessly adding value for our customers
• Be a Challenger: Never complacent, always striving for continuous improvement
• Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
• Commit to each other: Contributing to making Circana a great place to work for everyone