LLM Operations Engineer

Project Role : LLM Operations Engineer

Project Role Description : Utilize cloud-native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations.

Must have skills : Large Language Models (LLMs)

Good to have skills : NA

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary

As an LLM Operations Engineer, you will engage in the deployment and management of large language models using cloud-native services and tools. Your typical day will involve monitoring the performance of these models, addressing any operational challenges that arise, and ensuring that all activities comply with established security and compliance standards in the realm of artificial intelligence operations. You will work collaboratively with various teams to optimize processes and enhance the overall efficiency of AI operations, contributing to the successful implementation of innovative solutions.

Roles & Responsibilities

• Expected to be an SME, collaborate and manage the team to perform.
• Responsible for team decisions.
• Engage with multiple teams and contribute on key decisions.
• Provide solutions to problems for their immediate team and across multiple teams.
• Facilitate knowledge sharing and training sessions to enhance team capabilities.
• Develop and implement best practices for LLM deployment and monitoring.
  
  

• Must To Have Skills: Proficiency in Large Language Models (LLMs).
• Experience with cloud-native services and tools for deployment.
• Strong understanding of AI operational compliance and security standards.
• Ability to analyze and optimize model performance metrics.
• Familiarity with troubleshooting and resolving operational challenges in AI systems.
  
  

• The candidate should have minimum 7.5 years of experience in Large Language Models (LLMs).
• This position is based at our Gurugram office.
• A 15 years full time education is required.