Senior Python Engineer – AI Code Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Assess AI-generated coding interactions comprehensively from start to finish.

• Evaluate whether the outputs are beneficial, accurate at a high level, and aligned with sound engineering principles.

• Examine the quality of explanations and reasoning, beyond just the code itself.

• Differentiate between various levels of response quality.

• Offer clear and decisive feedback on what was effective, what was lacking, and what appeared misleading or incorrect.

• Assist in defining what excellence looks like when utilizing tools like Cursor.

• Make subjective yet rigorous evaluations regarding AI coding-agent interactions.

⛳️ Requirements

• Highly skilled software engineer at the Staff / Principal level or possess equivalent experience.

• Robust background in TypeScript / JavaScript or Python.

• Practical experience with OpenAI Codex, Claude Code, and Cursor.

• Extensive knowledge of contemporary AI-assisted development processes.

• Capability to assess code without the necessity of executing or thoroughly reviewing every single line.

• Comfortable providing straightforward, opinionated feedback.

• High expectations for engineering excellence.

• Nice to have: experience with Cursor or other AI-focused Integrated Development Environments (IDEs).

• Nice to have: previous involvement in prompt design or evaluation processes.

• Nice to have: experience in mentoring senior engineers or establishing engineering standards.

• Must complete a take-home evaluation exercise and participate in one behavioral interview.

• Must consent to a straightforward background check for the project.

🏝️ Benefits

• $100–$200/hour compensation rate.

• Approximately 10–20 hours per week.

• Contract duration until early May, with potential for extension.

• Immediate start date available.