Senior Software Engineer, Python – AI Training

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Assess the quality of interactions with contemporary coding agents such as OpenAI Codex and Claude Code.

• Evaluate AI-generated coding interactions from start to finish.

• Determine whether outputs are useful, correct at a high level, and aligned with sound engineering judgment.

• Analyze the quality of explanations and reasoning, not solely the code.

• Differentiate between various levels of response quality.

• Provide clear, opinionated written feedback on what was effective, what was lacking, and what seemed misleading.

• Assist in defining what excellence looks like when working with Cursor, Codex, and Claude Code.

• Create short video explanations of evaluations.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong background in TypeScript/JavaScript or Python.

• Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Extensive knowledge of modern AI-assisted development workflows.

• Capable of evaluating code without executing it or reviewing every line.

• Proficient in written and spoken English (B2 or above); this is a strict requirement.

• Comfortable providing direct, opinionated feedback.

• High standards for what constitutes good engineering.

• Previous experience in prompt design or evaluation workflows (preferred).

• Experience mentoring senior engineers or establishing engineering standards (preferred).

• Must complete a take-home evaluation exercise with a recorded Loom walkthrough.

• Must consent to a simple background check for this project.

🏝️ Benefits

• Flexible hours, ranging from 10 to 20 hours per week.

• Ongoing project opportunities for evaluators who perform well.

• Begin as soon as the take-home is completed and a project has an available seat.