Senior Software Engineer, AI Training

This is a fully remote position, open to applicants in Canada.

📋 Description

• Assess AI-driven coding interactions comprehensively from start to finish

• Evaluate the usefulness and accuracy of outputs while applying strong engineering judgment

• Analyze explanations and reasoning, not just the code itself

• Differentiate between varying levels of response quality

• Deliver clear, constructive written feedback regarding what was effective, ineffective, or potentially misleading

• Assist in defining the characteristics of exemplary interactions for Cursor, Codex, and Claude Code

• Create brief video explanations

• Engage in projects that span approximately two weeks to several months, with additional projects available based on performance

⛳️ Requirements

• Senior, Staff, or Principal-level software engineer (or equivalent experience)

• Strong proficiency in TypeScript/JavaScript or Python

• Practical experience with at least one of OpenAI Codex, Claude Code, or Cursor

• Extensive knowledge of contemporary AI-assisted development workflows

• Capability to assess code without executing it or scrutinizing every line

• Excellent written and spoken English (B2 level or higher)

• Comfortable providing direct, opinionated feedback

• High expectations for engineering quality

• Previous experience with prompt design or evaluation workflows (preferred)

• Background in mentoring senior engineers or establishing engineering standards (preferred)

• Must complete and successfully pass a take-home evaluation exercise accompanied by a recorded Loom walkthrough

• Must consent to a straightforward background check

🏝️ Benefits

• Flexible working hours, ranging from 10 to 20 hours per week

• Continuous project opportunities for evaluators who excel in their performance

• Remote work arrangement available globally