Subcontractor- Gen AI QA
Talentmate
India
22nd August 2026
2608-5353-1436
Job Description
AI QA Engineer – Agentic AI / GenAIArea(s) of responsibility
Role Overview
QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities
• Develop Python-based automation frameworks (Pytest)
• Test LLM outputs (accuracy, hallucination, relevance)
• Validate multi-agent workflows and pipelines
• Build evaluation metrics (F1, precision, recall)
• Perform API and integration testing
• Ensure high test coverage and CI/CD integration
Required Skills
• Strong Python programming
• Automation frameworks (Pytest/unittest)
• Understanding of GenAI/LLMs
• API testing and debugging
• CI/CD and version control
Experience
7 years or more in QA experience, exposure to GenAI/ML systems
Job Details
| Role Level: | Mid-Level | Work Type: | Contract |
|---|---|---|---|
| Country: | India | City: | Bengaluru ,Karnataka |
| Company Website: | https://www.birlasoft.com | Job Function: | DevOps & QA |
| Company Industry/ Sector: |
IT Services and IT Consulting | ||
What We Offer
About the Company
Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.
Recent Jobs
View More Jobs
Copyright © 2026 TALENTMATE. All rights reserved.
