Senior Software Engineer, AI Training

This is a fully remote position, open to applicants in Canada.

📋 Description

• Assess the quality of interactions with contemporary coding agents like OpenAI Codex and Claude Code.

• Analyze AI-generated coding interactions from start to finish.

• Evaluate whether the outputs are beneficial, correct at a high level, and consistent with sound engineering principles.

• Review explanations and reasoning, not solely focusing on the code.

• Differentiate between various levels of response quality.

• Deliver clear and opinionated written feedback on what was effective, what fell short, and what seemed misleading.

• Assist in defining excellence when working with Cursor, Codex, and Claude Code.

• Complete a take-home evaluation task accompanied by a recorded Loom presentation.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong expertise in TypeScript/JavaScript or Python.

• Practical experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• In-depth understanding of modern AI-assisted development workflows.

• Capable of evaluating code without executing it or thoroughly reviewing every line.

• Proficient in written and spoken English (B2 level or above).

• Comfortable providing direct, opinionated feedback.

• High standards for what constitutes good engineering.

• Previous experience with prompt design or evaluation workflows (preferred).

• Experience in mentoring senior engineers or establishing engineering standards (preferred).

🏝️ Benefits

• Flexible working hours, ranging from 10 to 20 hours per week.

• Continuation of projects, with new opportunities available for evaluators who perform well.

• Remote work arrangement available worldwide.