Staff / Principal Rust Engineer, AI Coding Agent Evaluator

This is a fully remote position, open to applicants in United States.

📋 Description

• Assess end-to-end AI-generated coding interactions.

• Evaluate whether outputs are beneficial, accurate at a high level, and consistent with sound engineering principles.

• Analyze the quality of explanations and reasoning, not just the code itself.

• Differentiate between various levels of response quality.

• Deliver clear, well-reasoned feedback on what was effective, what missed the mark, and what seemed incorrect or misleading.

• Assist in defining the characteristics of excellent interactions with tools like Cursor.

• Determine the usefulness and trustworthiness of responses, preambles, reasoning, and outputs from AI coding agents.

• Anticipate a commitment of approximately 10–20 hours per week until early May, starting as soon as possible.

⛳️ Requirements

• Highly skilled software engineer (SR+ level).

• Experience at the Staff/Principal level or equivalent expertise.

• Strong proficiency in TypeScript/JavaScript or Python.

• Practical experience with OpenAI Codex, Claude Code, and Cursor.

• In-depth understanding of modern AI-assisted development processes.

• Capability to assess code without the necessity of executing or meticulously reviewing each line.

• Willingness to provide direct, constructive feedback.

• High standards for what constitutes "good engineering."

• Preferred: experience with Cursor or similar AI-first Integrated Development Environments (IDEs).

• Preferred: previous exposure to prompt design or evaluation processes.

• Preferred: experience in mentoring senior engineers or establishing engineering standards.

• Must complete a take-home evaluation task and one behavioral interview.

• Must consent to a straightforward background check for this project.

🏝️ Benefits

• Hourly rate ranging from $100 to $200.

• Potential for extension beyond early May.

• Flexible part-time role requiring approximately 10–20 hours per week.