Testing - DET - Staff- E

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

Job Title: AI Test Engineer

Job Summary:

We are looking for a motivated individual to join our AI Testing team. As a staff AI Test Engineer, you will assist in developing and executing test cases for AI models and systems, ensuring they meet quality and performance standards. You will collaborate with experienced engineers and data scientists to gain hands-on experience in AI testing.

Key Responsibilities:

Test case design:

• Good understanding about the various testing touch points in a model development lifecycle
• Participate in discussions with team members to understand testing needs.
• Support the development of test cases based on project requirements.
• Ability to define test cases to validate input data, Model functional performance, Model response etc
  
  

Test Execution:

• Execute manual tests for AI models and document results.
• Prior experience in performing AI specific testing methods like Pairwise testing, Metamorphic testing, Back-to-Back testing, Bias Testing, Drift testing etc
• Knowledge on responsible AI testing
• Knowledge on explainability testing tools (e.g., LIME, SHAP etc)
• Assist in running automated tests and analysing their outcomes.
  
  

Model Validation Support:

• Help validate AI models against performance metrics such as accuracy and recall.
• Learn to conduct exploratory testing to identify potential issues.
• Exposure to testing LLM models
  
  

Data Quality Checks:

• Collaborate with data teams to ensure the quality of datasets used in testing.
• Participate in data validation activities to maintain data integrity.
• Prior experience in performing various data validation activities like data collection/generation, data augmentation, Exploratory data analysis, data bias and privacy etc
  
  

Documentation:

• Document test results and maintain clear records of defects found during testing.
• Prepare summary reports of testing activities for review.
  
  

Learning and Development:

• Stay informed about AI testing best practices and tools.
• Seek guidance from senior engineers to improve testing skills and knowledge.
  
  

Education: Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.

Experience:

• 1-4 years of experience in software testing / development with exposure to Python
• 1+ years in testing on AI/ML applications.
  
  

Technical Skills:

• Basic understanding of AI/ML concepts and algorithms.
• Familiarity with programming languages such as Python or Java is a plus.
• Exposure to software testing principles and practices.
• Strong analytical and problem-solving skills.
• Attention to detail and a commitment to quality.
• Experience with testing tools (e.g., Selenium, PyTest) through coursework or internships.
• Knowledge of version control systems (e.g., Git) is a plus.
• Experience with Agile methodologies is a bonus.
  
  

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

---