Senior Software Engineer, OpenAI Codex, Claude Code, Cursor
Job Description:
- Evaluate AI-generated coding interactions end to end
- Judge whether outputs are useful, correct at a high level, and aligned with strong engineering judgment
- Assess explanations and reasoning, not just code
- Distinguish between response quality levels
- Provide clear, opinionated written feedback on what worked, failed, or felt misleading
- Help define what excellent interactions look like when using Cursor, Codex, and Claude Code
- Record short video explanations as part of the evaluation work
- Complete one take-home evaluation exercise with a recorded Loom walkthrough; no interview
Requirements:
- Senior, Staff, or Principal-level engineer, or equivalent experience
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor
- Deep familiarity with modern AI-assisted development workflows
- Able to evaluate code without executing it or reviewing every line
- Strong written and spoken English (B2 or above)
- Comfortable giving direct, opinionated feedback
- High standards for engineering quality
- Prior exposure to prompt design or evaluation workflows (nice to have)
- Experience mentoring senior engineers or defining engineering standards (nice to have)
Benefits:
- Flexible schedule
- 10–20 hours per week
- Ongoing project opportunities for evaluators who perform well
- Projects lasting approximately two weeks to a few months
- Start as soon as the take-home is cleared and a project seat is available