Senior Software Engineer, AI Training

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Analyze AI-generated coding interactions from start to finish

• Assess whether outputs are valuable, accurate at a high level, and aligned with robust engineering judgment

• Evaluate the quality of reasoning and explanations, beyond just the code itself

• Differentiate between varying levels of response quality

• Provide clear, insightful written feedback on what was effective, what fell short, and what seemed misleading

• Assist in defining excellence when using Cursor, Codex, and Claude Code

• Create brief video explanations of your evaluations

• Engage in projects that last from approximately two weeks to several months

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience)

• Strong expertise in TypeScript/JavaScript or Python

• Direct experience with at least one of OpenAI Codex, Claude Code, or Cursor

• Extensive knowledge of modern AI-assisted development processes

• Capable of evaluating code without executing it or reviewing every single line

• Excellent written and spoken English (B2 level or higher) is a strict requirement

• Comfortable providing direct, opinionated feedback

• High standards for what constitutes good engineering practices

• Previous experience with prompt design or evaluation workflows (preferable)

• Experience in mentoring senior engineers or establishing engineering standards (preferable)

• Required to complete a take-home evaluation exercise with a recorded Loom walkthrough

🏝️ Benefits

• Flexible working hours: 10–20 hours per week

• Continuous project opportunities for evaluators who perform well

• Immediate start upon clearing the take-home evaluation and when a project has an available position