AI Test Engineer

About Xerox Holdings Corporation

For more than 100 years, Xerox has continually redefined the workplace experience. Harnessing our leadership position in office and production print technology, we’ve expanded into software and services to sustainably power the hybrid workplace of today and tomorrow. Today, Xerox is continuing its legacy of innovation to deliver client-centric and digitally-driven technology solutions and meet the needs of today’s global, distributed workforce. From the office to industrial environments, our differentiated business and technology offerings and financial services are essential workplace technology solutions that drive success for our clients. At Xerox, we make work, work. Learn more about us at www.xerox.com.

We are seeking a highly skilled AI Test Engineer to join our team and ensure the reliability, safety, and performance of AI-driven systems. This role involves designing and executing test strategies for machine learning models, AI applications, and automation frameworks. The ideal candidate will have a strong background in software testing, a deep understanding of AI/ML concepts, and the ability to bridge the gap between engineering and quality assurance.

Key Responsibilities

• Develop and implement test plans, test cases, and automated testing frameworks for AI/ML systems.
• Validate model accuracy, robustness, and fairness across diverse datasets.
• Conduct performance testing to evaluate scalability, latency, and efficiency of AI solutions.
• Collaborate with data scientists and engineers to identify edge cases, biases, and potential risks in AI models.
• Design synthetic and real-world test scenarios to simulate production environments.
• Monitor AI systems in deployment, ensuring continuous quality and compliance with ethical and regulatory standards.
• Document test results, provide clear feedback, and recommend improvements to enhance system reliability.
  
  

• Bachelor’s or master’s degree in computer science, Engineering, or related field.
• Proven experience in software testing, QA automation, or AI/ML model validation.
• Strong programming skills in Python, Java, or similar languages.
• Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn) and testing tools (Selenium, JUnit, pytest).
• Knowledge of data pipelines, model evaluation metrics, and statistical testing.
• Experience with cloud platforms (AWS, Azure, GCP) and CI/CD pipelines.
• Excellent problem-solving, analytical, and communication skills.
  
  

• Exposure to AI ethics, bias detection, and explainability tools.
• Experience with large-scale distributed systems and microservices testing.
• Knowledge of MLOps practices and monitoring tools.
• Ability to work in agile, cross-functional teams.
  
  

• Test AI models
• Build Test Scripts and Data
• Monitor AI Performance
• Support Responsible AI
• Work with Data, QA, Developers, IT and business teams
• Improve Tools and Skills