Senior Software Engineer, AI Training

This is a fully remote position, open to applicants in Australia.

📋 Description

• Analyze AI-generated coding interactions comprehensively.

• Evaluate the usefulness and correctness of outputs at a high level, ensuring alignment with strong engineering principles.

• Assess the reasoning and explanations provided, not just the code itself.

• Differentiate between various levels of response quality.

• Deliver clear, opinionated written feedback on effective elements, areas that fell short, and any misleading aspects.

• Contribute to defining exemplary interactions with Cursor, Codex, and Claude Code.

• Create brief video explanations.

• Projects typically range from two weeks to a few months, with new opportunities available for successful evaluators.

• Begin immediately after successfully completing the take-home exercise and securing a position on an open project.

⛳️ Requirements

• Senior, Staff, or Principal-level engineer (or equivalent experience).

• Strong expertise in TypeScript/JavaScript or Python.

• Practical experience with at least one of OpenAI Codex, Claude Code, or Cursor.

• Profound understanding of contemporary AI-assisted development processes.

• Capable of evaluating code without the necessity of executing it or reviewing each line.

• Excellent written and spoken English skills (B2 level or higher) are essential for providing detailed written feedback and creating concise video explanations.

• Comfortable offering direct, opinionated feedback.

• High standards for engineering excellence.

• Previous experience in prompt design or evaluation workflows is a plus.

• Background in mentoring senior engineers or establishing engineering standards is advantageous.

• Completion of a take-home evaluation exercise accompanied by a recorded Loom walkthrough is mandatory.

• A simple background check is required.

🏝️ Benefits

• Flexible working hours, ranging from 10 to 20 hours per week.

• Continuous project opportunities for evaluators who perform well.

• Remote work arrangement available globally.