Board Game Expert Remote

• Role Title: Board Game Expert (Remote)
• Role Type: Full-time
• Location: Remote

Role Overview

We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance.

You will work on challenging tasks involving game logic, decision-making, strategic planning, rule interpretation, and scenario analysis, helping frontier AI systems develop stronger reasoning capabilities.

What Does Day-to-Day Look Like?

1. Create and review game-based reasoning tasks designed to evaluate AI systems.

2. Analyze board game scenarios, strategic decision trees, and rule-based systems.

3. Evaluate AI-generated responses for correctness, consistency, and reasoning quality.

4. Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.

5. Identify logical errors, rule violations, and flawed reasoning in AI outputs.

6. Contribute to benchmark creation and quality assurance processes for AI evaluation projects.

7. Collaborate with project teams to improve dataset quality and evaluation methodologies.

Required Qualifications

1. Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field.

2. 2+ years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or related strategy-focused environments.

3. Strong understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems.

4. Background in game theory, behavioral economics, decision science, or formal logic.

5. Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems.

6. Strong analytical and problem-solving skills.

7. Excellent written communication skills.

Preferred Qualifications

1. Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis.

2. Experience creating evaluation rubrics, benchmark datasets, or quality assurance frameworks.

3. Experience with Python, SQL, or data analysis tools.

4. Experience working on RLHF, model evaluation, synthetic data generation, or LLM benchmarking projects.

5. Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems.

Offer Details

1. Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.

2. Engagement type : Contractor assignment (no medical/paid leave)

3. Duration of contract : 2 months; [expected start date is next week]

Evaluation Process

1. Take home Assessment

What You’ll Do

1. Create and review game-based reasoning tasks designed to evaluate AI systems.

2. Analyze board game scenarios, strategic decision trees, and rule-based systems.

3. Evaluate AI-generated responses for correctness, consistency, and reasoning quality.

4. Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.

5. Identify logical errors, rule violations, and flawed reasoning in AI outputs.

6. Contribute to benchmark creation and quality assurance processes for AI evaluation projects.

Apply Now!