Senior Software Engineer, Python – AI Training

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Evaluate end-to-end coding interactions generated by AI.

• Assess whether outputs are useful, generally correct, and reflect sound engineering judgment.

• Analyze the quality of explanations and reasoning, beyond just the code itself.

• Differentiate among various levels of response quality.

• Provide clear, well-informed written feedback regarding successes, failures, and any misleading aspects.

• Assist in defining excellence for tools such as Cursor, Codex, and Claude Code.

• Create brief video explanations of your evaluations.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong expertise in TypeScript/JavaScript or Python.

• Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Extensive knowledge of modern AI-assisted development workflows.

• Ability to assess code without needing to execute it or review every line in detail.

• Proficient in written and spoken English (B2 level or higher).

• Comfortable providing direct and opinionated feedback.

• Maintain high standards for engineering quality.

• Previous experience with prompt design or evaluation workflows is a plus.

• Experience in mentoring senior engineers or establishing engineering standards is a plus.

• Completion of a take-home evaluation exercise with a recorded Loom walkthrough is required.

• Agreement to a straightforward background check for the project is necessary.

🏝️ Benefits

• Flexible work hours, ranging from 10–20 hours per week.

• Continuous project opportunities for evaluators who excel.

• Projects vary in duration from approximately two weeks to several months.

• Immediate start upon successful completion of the take-home evaluation and availability of an open project seat.