Assure AI Engineer

Gemini – AssureAI Engineer

2 positions

Keywords: AssureAI · Evaluation Datasets · Red-Teaming · Bias & Explainability (SHAP/LIME) · Threshold Gates · CI/CD · Audit Evidence · Python

You are one of two hands-on operators of AssureAIs Trustworthiness pillar inside the Governance Control Tower. Where the AI Trust & Compliance Engineer sets the strategy — which regulations map to which checks, what a passing threshold means — you build and run the evaluation suites that prove it, day in and day out, across a growing roster of Gemini-based agents. You report to the AI Trust & Compliance Engineer and work closely with the AI Engineers building the agents you test.

• Build and maintain evaluation datasets and scenarios for each of AssureAIs 19 Trustworthiness checks (explainability, audit provenance, regulation coverage, safety guardrails) as new agents come online.

• Run scheduled and on-commit bias, toxicity, red-team, and explainability (SHAP/LIME) suites; triage failures and route them to the right owner (AI Engineer, Integration Specialist, or Governance Engineer).

• Maintain the CI/CD threshold-gate configuration so a failing Trustworthiness check blocks release rather than just flagging it.

• Package audit evidence — run provenance, evidence exportability, regulation-coverage reports — for the AI Trust & Compliance Engineers CSG review-board submissions.

• Track dataset coverage and flag gaps as agent scope expands into new domains, data types, or regulatory contexts.

• Split coverage with the second AssureAI Engineer across agent domains or pipeline stages so evaluation throughput scales with agent count.

• 5-7 years in QA/test engineering for ML or GenAI systems, ideally with a dedicated eval framework (DeepEval, Ragas, Promptfoo, or comparable).

• Hands-on experience with AssureAI or a directly comparable AI-assurance/evaluation platform.

• Working knowledge of bias/fairness testing, explainability techniques (SHAP/LIME), and red-teaming/adversarial-prompt methodology.

• Comfortable reading AI regulatory requirements (EU AI Act, NIST AI RMF, ISO/IEC 42001) well enough to translate them into test coverage.

• Proficient in Python; comfortable wiring test suites into CI/CD (Cloud Build, GitHub Actions).

• Detail-oriented and comfortable owning a queue of failing checks across multiple agents at once.

• Experience with Gemini Enterprise / ADK agents specifically, or another enterprise agent platform.

• Familiarity with RAG evaluation (faithfulness, hallucination, context precision/recall).

• Prior audit or compliance-adjacent work (SOC 2, ISO 27001, or similar) that makes evidence packaging second nature.

By month two: every live agent has an active Trustworthiness evaluation suite running on every commit, with clear pass/fail thresholds.

By month four: audit-evidence packages are produced on a standing cadence without ad hoc requests, and dataset coverage gaps are tracked and closed as new agents onboard.

 

 

At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.

We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.

---