Writing Assessor Remote

• Role Title: Educator/ Assessor Writer
• Role Type: Contractor
• Location: Remote

Educator/ Assessor Writers to contribute expertise on a customer project focused on advanced AI system development.

In this role, you'll apply your expertise to help train next-generation AI systems.

Your work will shape how models learn, reason, and perform through high-quality, real-world input.

No prior experience in AI is required — your domain knowledge is what matters.

This opportunity is ideal for individuals experienced in evaluating written work against a rubric, examining academic writing, or designing effective assessments.

The engagement is fully remote and offers the flexibility to participate alongside other professional obligations.

Scope of Work

1. Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.

2. Assign analytical quality scores based on provided rubrics and guidelines.

3. Compose detailed written rationales justifying each assessment or score.

4. Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.

5. Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.

6. Document findings meticulously and maintain thorough records of decisions and observations.

7. Collaborate asynchronously with project managers and reviewers using digital content review platforms.

Preferred Qualifications

1. First-language proficiency or fully equivalent fluency in written English.

2. Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.

3. Experience marking, grading, or examining written work against set criteria or rubrics.

4. Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.

5. Keen attention to detail, critical analysis skills, and the ability to deliver objective, well-articulated judgments.

6. Capable of independent remote work and meeting project deadlines.

7. Experience with model evaluation, RLHF, or annotation is an asset but not mandatory.

What You’ll Do

1. Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.

2. Assign analytical quality scores based on provided rubrics and guidelines.

3. Compose detailed written rationales justifying each assessment or score.

4. Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.

5. Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.

6. Document findings meticulously and maintain thorough records of decisions and observations.

Apply Now!