Sr LLM Developer LLM App Python Azure AI Azure OpenAI

We are looking for a Mid-Level LLM Application Developer with 3–5 years of experience in software development, who is passionate about building intelligent applications using Azure OpenAI, Python, and LLM frameworks. This is a full-time role focused on designing, developing, and deploying scalable LLM-powered solutions, including chatbots, knowledge assistants, and RAG-based systems.

You’ll be working closely with cross-functional teams to bring innovative AI solutions to life, leveraging the latest in generative AI and agentic technologies.

Job Description:

Responsibilities:

• Design and develop LLM-powered applications using Python and Azure OpenAI services.
• Build end-to-end Retrieval-Augmented Generation (RAG) pipelines, integrating vector databases, semantic search and other related tools.
• Develop conversational agents and virtual assistants, using frameworks like LangChain or LlamaIndex.
• Craft effective prompts using advanced prompt engineering and prompt design techniques.
• Integrate LLMs with external tools, APIs, and business data systems.
• Apply Agentic AI patterns to RAG and AI Workflows, interacting with LLMs by orchestrating various agents together
• Deploy and manage applications using Azure Functions, Azure AI services, and serverless components.
• Ensure performance, scalability, and reliability of AI solutions on Azure.
• Collaborate across teams and participate in agile development processes.

• Strong proficiency in Python programming language.
• Expertise in Azure OpenAI Service, including foundation model usage and integration.
• Build and deploy AI solutions leveraging Azure AI services (e.g., Cognitive Services, Azure ML, Azure AI Search).
• Deep experience in prompt engineering, including various prompting strategies (few-shot, chain-of-thought, etc.).
• Hands-on experience building RAG pipelines with vector databases and tool integrations.
• Proven experience developing chatbots or virtual assistants using LLMs.
• Proficiency in at least one LLM application framework (e.g., LangChain, LlamaIndex).
• In-depth understanding of LLM models, their capabilities, and applications.
• Good understanding of LLM evaluations, and how to evaluate LLM model outputs.
• Good understanding of using AI Agents and Agentic AI Patterns to integrate with LLMs
• Experience deploying with Azure Function Apps and broader Azure ecosystem.
• Solid grasp of API integrations and data workflow design.
• Strong problem-solving skills and ability to deliver scalable, efficient code.
• Excellent communication and team collaboration abilities.
  
  
  

• Familiarity with Multi-Agent AI orchestration and agentic workflows.
• Experience building cloud-native services with serverless architectures.
• Understanding of NLP techniques and data transformation pipelines.
• Familiarity with LLMOps concepts and AI model lifecycle.
  
  
  

• Bachelor’s degree in computer science, Computer Engineering, or a related field.
• 3+ years of experience in software development.
• Experience with LLM applications and cloud platforms.
• Strong understanding of software development methodologies (e.g., Agile).