AI Manual Tester

Company: InCruiter

Website: Visit Website

Business Type: Startup

Company Type: Product

Business Model: B2B

Funding Stage: Bootstrapped

Industry: HR Tech

Salary Range: ₹ 6-10 Lacs PA

Job Description

ABOUT INCRUITER

InCruiter is a fast-growing AI-powered Stack Interview Intelligence Platform helping organizations hire smarter and faster using automation and AI-driven intelligence. With six products spanning interviewing, assessment, and hiring automation, we’re redefining how companies recruit at scale.

InCruiter is a market leader and one of India’s Top 3 players in this segment, with a wide range of clients across domestic and international markets. Our major clientele includes some of the large enterprises and Startups like EXL, Welspun, Dentsu, Manhattan Associates, ArcelorMittal, Telstra, Siemens, and so on.

EXCITED ABOUT YOUR TASKS?

• Test Planning & Strategy
• Analyse product requirements, AI model flows, inputs/outputs, and edge cases.
• Create detailed test plans, scenarios, and cases covering functional + AI-specific behaviour.
• Proactively identify risky areas, logical gaps, and unpredictable model responses.
• Functional, Regression & AI Behaviour Testing
• Perform end-to-end testing of SaaS modules and AI-powered features.
• Validate AI model behaviour for accuracy, consistency, and stability.
• Test AI outputs across varied datasets, user inputs, and conditions.
• Conduct regression testing on every release cycle to ensure production reliability.
• Defect Analysis & Reporting
• Log defects with clear reproduction steps, data inputs, expected vs actual model behaviour.
• Collaborate closely with the ML/AI engineering and development teams to verify behaviour anomalies.
• Prioritize issues based on user impact and release timelines.
• Documentation & Release Quality
• Maintain AI-specific test cases, prediction logs, edge-case matrices, and QA documentation.
• Create and maintain release checklists ensuring zero-high severity bugs in production.
• Continuously improve test coverage for both SaaS and AI layers.
• Collaboration & Ownership
• Participate actively in requirement discussions, sprint planning, design reviews, and model behaviour sessions.
• Communicate model inconsistencies or biases early and suggest corrective actions.
• Take ownership of overall product quality and user experience.
  
  

• 4–5 years of hands-on experience in Manual Testing for SaaS platforms.
• Mandatory: Strong understanding of AI/ML model behaviour — inputs, outputs, accuracy, failure modes, edge cases.
• Experience validating AI outputs for correctness, patterns, bias, drift, and consistency.
• Strong logical reasoning, analytical mindset, and problem-solving ability.
• Familiarity with functional, regression, exploratory, and scenario-based testing.
• Basic API testing skills (Postman or similar).
• Good understanding of SDLC, STLC, bug lifecycle, Agile methodology.
• Experience with Jira, TestRail, Confluence or equivalent tools.
• Knowledge of model accuracy metrics (precision, recall, F1 score).
• Experience testing LLM-based features, chat flows, or recommendation systems.
• SQL basics for backend data validation.