Job Description

Job Title:

Associate, Digital Operations

Job Description

ROLE: LLM / AI Red-Team Evaluator
DESIGNATION: LLM / AI Red -Team Evaluator
YEARS OF EXPERIENCE: 3 plus years
Concentrix is a technology-enabled global business services company specializing in customer engagement and improving business performance. We partner with ambitious, progressive executives around the world to future-proof their business and stay ahead of the competition and customer expectations

Role and Key Responsibilities:

·        Act as a specialist individual contributor executing AI red Teaming adversarial evaluation pilot.

·        Formulate risk hypotheses, design creative adversarial scenarios, and execute multi-turn, adaptive prompt attacks on authorized systems.

·        Critically evaluate model outputs for grounding errors, source contradictions, stale information, and trust-boundary violations (such as indirect prompt injections).

·        Capture, package, and document complete, reproducible evidence including exact prompt sequences, session/version context, and timestamps.

·        Submit detailed finding cards for QA and calibrate judgments based on updated rubrics and guidelines.

·        Separately classify candidate findings, quality issues, and inconclusive outcomes, knowing exactly when to stop and escalate unsafe or uncertain cases.

·        Meet or exceed pre-production certification targets (including achieving a ≥85% agreement rate on adjudicated practice sets with zero material omissions).

·        Maintain strong ownership of assigned attack surfaces and test surfaces within client-approved boundaries.

·        Stay informed of client taxonomies, system changes, policy revisions, and evolving risk definitions.

·        Collaborate with cross-functional teams including the Red-Team Team Lead, Project Manager, and QA analysts to resolve challenges constructively.


Key skills & knowledge:

·        Core Technical Competencies: AI Red Teaming, Adversarial AI, Prompt Injection, Jailbreak Testing, Responsible AI, AI Governance, AI Safety.

·        Core Methodology Competencies: LLM Evaluation, Model Evaluation, RLHF (Reinforcement Learning from Human Feedback), Human Feedback, Prompt Engineering, GenAI Testing, AI QA.

·        Strong analytical, skeptical, and troubleshooting capability across LLM/RAG safety environments.

·        Excellent written and verbal communication skills in US-English for structured reporting.·        High attention to detail and structured problem-solving approach to isolate false positives and verify citations.

·        Demonstrated ability to build original, bounded attack hypotheses and execute multi-turn context escalation scenarios.

·        Quality-focused mindset with accountability for complete evidence and defensible coverage over pure prompt volume.

Key Performance & Evaluation Metrics:

·        Defensible Coverage and Finding Reproducibility

·        QA Calibration and Adjudication Scores (≥85% Agreement Target)

·        Client Boundary & Privacy Policy Compliance

·        Execution of Structured Finding Cards and Calibration Updates


Education – Graduate/ Undergraduate


Disclaimer: -

'Neither Concentrix nor any authorized 3rd party who assist with our recruitment process, ever ask candidates for ‘recruitment’, ‘processing’ or any other kind of fees in exchange for offer letters from Concentrix. Offer letters and other recruiting correspondence from Concentrix are printed on Concentrix letter head with authentic signatures of appropriate Concentrix authorities.'


Location:

IND Hyderabad - Unit No. 201, 2nd Flr, Building 4 at Mindspace

Language Requirements:

Time Type:

Full time2026-12-19


Job Details

Role Level: Associate Work Type: Full-Time
Country: India City: Hyderabad ,Telangana
Company Website: http://www.concentrix.com Job Function: Operations Management
Company Industry/
Sector:
IT Services and IT Consulting

What We Offer


About the Company

Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.

Report

Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.


Recent Jobs
View More Jobs
Talentmate Instagram Talentmate Facebook Talentmate YouTube Talentmate LinkedIn