Senior Software Engineer, AI Training

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Assess the quality of interactions with contemporary coding agents like OpenAI Codex and Claude Code.

• Evaluate whether AI-generated responses are coherent and if preambles and reasoning add value.

• Determine if outputs showcase strong engineering judgment and are suitable for experienced developers.

• Analyze AI-generated coding interactions comprehensively.

• Evaluate whether outputs are useful, generally accurate, and aligned with robust engineering principles.

• Assess explanations and reasoning, not solely the code itself.

• Differentiate between various levels of response quality.

• Provide clear, opinionated written feedback on what was effective, ineffective, and potentially misleading.

• Assist in defining the standards of excellence when collaborating with Cursor, Codex, and Claude Code.

• Create brief video explanations of evaluations.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer, or equivalent experience.

• Strong expertise in TypeScript/JavaScript or Python.

• Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Profound understanding of modern AI-assisted development workflows.

• Capable of evaluating code without executing it or reviewing every single line.

• Proficient in written and spoken English (B2 level or above).

• Comfortable providing direct, opinionated feedback.

• High standards for what constitutes good engineering practice.

• Prior experience with prompt design or evaluation workflows is a plus.

• Experience mentoring senior engineers or establishing engineering standards is a plus.

• Must complete a take-home evaluation exercise along with a recorded Loom walkthrough.

• Must consent to a simple background check for this project.

🏝️ Benefits

• Flexible hours: 10–20 hours/week.

• Ongoing project opportunities for evaluators who perform well.

• Projects vary in duration from approximately two weeks to a few months.

• Begin as soon as the take-home evaluation is completed and a project has an open position.