Job Description
- Role Title: South Asian Software Engineers: Coding Tasks for AI Evaluation
- Role Type: Contractor
- Location: Remote
What We're Researching
We're running a paid study on the effectiveness of coding evaluation harnesses used to test AI agents. Our team is building a comprehensive suite of programming environments designed to measure agent performance accurately. This work ensures that AI coding assistants are evaluated against realistic, high-quality development scenarios.
How It Works
You will walk through a series of proposed coding tasks and environments during an AI-moderated session. We will ask you to review the structure, difficulty, and realism of these programming challenges. You will provide technical feedback on the evaluation harnesses and suggest improvements to the test suites. The conversation will focus on ensuring these tasks accurately reflect real-world engineering requirements.
Who This Is For
We are hiring experienced software engineers based in South Asia who have a strong background in building and reviewing complex codebases. We welcome backend developers, test automation engineers, and full-stack engineers who understand evaluation harnesses. Ideal candidates have hands-on experience verifying realistic programming tasks in professional environments.
What You’ll Do
1. You will walk through a series of proposed coding tasks and environments during an AI-moderated session.
2. We will ask you to review the structure, difficulty, and realism of these programming challenges.
3. You will provide technical feedback on the evaluation harnesses and suggest improvements to the test suites.
Apply Now!
Job Details
| Role Level: | Not Applicable | Work Type: | Contract |
|---|---|---|---|
| Country: | United Arab Emirates | City: | Dubai |
| Company Website: | https://joblet.ai/ | Job Function: | DevOps & QA |
| Company Industry/ Sector: |
Technology Information and Media | ||
What We Offer
About the Company
Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@talentmate.com.
Job Snapshot
