Senior Software Engineer, AI Training

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Assess the quality of interactions with advanced coding agents like OpenAI Codex and Claude Code.

• Analyze AI-generated coding interactions comprehensively.

• Evaluate whether outputs are beneficial, accurate at a high level, and consistent with sound engineering judgment.

• Review the quality of explanations and reasoning, not solely the code itself.

• Differentiate between varying levels of response quality.

• Provide clear, well-informed written feedback on what was effective, what fell short, and what seemed inaccurate or misleading.

• Assist in defining the standards of excellence when using Cursor, Codex, and Claude Code.

• Create brief video explanations of evaluations.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong expertise in TypeScript/JavaScript or Python.

• Practical experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Extensive knowledge of contemporary AI-assisted development workflows.

• Capable of evaluating code without executing it or examining each line in detail.

• Proficient in written and spoken English (B2 or higher); essential for providing detailed written feedback and creating short video explanations.

• Comfortable delivering direct, constructive feedback.

• Maintains a high standard for what constitutes good engineering.

• Previous experience with prompt design or evaluation workflows is a plus.

• Background in mentoring senior engineers or establishing engineering standards is desirable.

• Must complete a take-home evaluation exercise with a recorded Loom walkthrough.

• Must consent to a straightforward background check for this project.

🏝️ Benefits

• Flexible working hours: 10–20 hours per week.

• Ongoing project opportunities for evaluators who perform well.

• Projects ranging from approximately two weeks to a few months.

• Begin as soon as the take-home evaluation is completed and a project has an available position.