Senior Software Engineer – AI Interaction Evaluator, Codex / Claude Code

This is a fully remote position, open to applicants in Florida.

📋 Description

• Evaluate the complete process of AI-generated coding interactions.

• Assess whether the outputs are useful, accurate at a high level, and reflect strong engineering principles.

• Evaluate the quality of explanations and reasoning, not solely the code itself.

• Differentiate between various levels of response quality.

• Offer clear, opinionated feedback on what was effective, what fell short, and what appeared misleading.

• Contribute to defining what exemplary interaction looks like for tools like Cursor.

⛳️ Requirements

• Highly experienced software engineer at Staff / Principal level or with equivalent expertise.

• Strong proficiency in TypeScript / JavaScript or Python.

• Practical experience utilizing OpenAI Codex, Claude Code, and Cursor.

• Extensive knowledge of modern AI-assisted development processes.

• Capability to evaluate code without the need for thorough execution or detailed line-by-line review.

• Comfortable providing direct, opinionated feedback.

• High standards for engineering quality.

• Nice to have: experience with Cursor or similar AI-first integrated development environments (IDEs).

• Nice to have: prior involvement in prompt design or evaluation processes.

• Nice to have: experience in mentoring senior engineers or establishing engineering standards.

• Must complete a take-home evaluation exercise and participate in one behavioral interview.

🏝️ Benefits

• Potential for contract extension.

• Flexible part-time engagement of approximately 10–20 hours per week.