Senior Software Engineer, AI Training

This is a fully remote position, open to applicants in Ireland.

📋 Description

• Assess the quality of engagements with contemporary coding agents such as OpenAI Codex and Claude Code.

• Analyze AI-generated coding interactions from start to finish.

• Evaluate whether the outputs are useful, correct at a high level, and consistent with strong engineering principles.

• Examine the quality of explanations and reasoning, not solely the code.

• Differentiate between various levels of response quality.

• Deliver clear, opinionated written feedback on what was effective, what fell short, and what seemed misleading.

• Assist in defining what exemplary interaction looks like with Cursor, Codex, and Claude Code.

• Create short video explanations of evaluations.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong expertise in TypeScript/JavaScript or Python.

• Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Extensive knowledge of modern AI-assisted development workflows.

• Capable of evaluating code without executing it or reviewing every line.

• Proficient in written and spoken English (B2 or higher); detailed written feedback and brief video explanations are mandatory.

• Comfortable providing direct, opinionated feedback.

• High expectations for engineering quality.

• Previous experience in prompt design or evaluation workflows (preferred).

• Experience mentoring senior engineers or establishing engineering standards (preferred).

• Must complete a take-home evaluation exercise with a recorded Loom walkthrough.

• Must consent to a straightforward background check for the project.

🏝️ Benefits

• Flexible hours: 10-20 hours/week.

• Continuous project opportunities for evaluators who excel.

• Start as soon as the take-home is completed and a project has an open position.