Senior Software Engineer, AI Training

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Assess the quality of interactions with contemporary coding agents such as OpenAI Codex and Claude Code.

• Analyze AI-generated coding interactions comprehensively.

• Evaluate whether outputs are useful, accurate at a high level, and aligned with strong engineering principles.

• Review the quality of explanations and reasoning, not solely the code.

• Differentiate between various levels of response quality.

• Provide clear and opinionated written feedback on what succeeded, what failed, and what was misleading.

• Assist in defining what excellence looks like when utilizing Cursor, Codex, and Claude Code.

• Create brief video explanations of evaluations.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong expertise in TypeScript/JavaScript or Python.

• Practical experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Extensive knowledge of modern AI-assisted development workflows.

• Capability to evaluate code without executing it or scrutinizing every line.

• Excellent written and spoken English (B2 or above), which is a strict requirement.

• Comfortable providing direct, opinionated feedback.

• High standards for what constitutes good engineering.

• Previous exposure to prompt design or evaluation processes (nice to have).

• Experience in mentoring senior engineers or establishing engineering standards (nice to have).

• Must complete a take-home evaluation exercise along with a recorded Loom walkthrough.

• Must consent to a simple background check for the project.

🏝️ Benefits

• Flexible schedule of 10-20 hours per week.

• Continuous project opportunities for evaluators who perform well.

• Projects ranging from approximately two weeks to several months.

• Begin as soon as the take-home evaluation is completed and a project has an available seat.