This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Evaluate the technical accuracy, feasibility, solvability, reproducibility, and support by reliable tests and criteria of software engineering tasks.

• Deliver clear and actionable insights regarding integration issues within the codebase, test failures, or logical errors present in tasks.

• Review and assess tasks utilized for training and evaluating AI systems to ensure they meet technical standards, practicality, and accuracy.

⛳️ Requirements

• Proven professional experience and extensive technical expertise in software engineering, including navigating complex codebases, developing real-world applications, and adhering to SWE-Bench standards.

• Excellent analytical and problem-solving abilities to thoroughly test, diagnose, and assess intricate technical situations.

• Candidates will be evaluated for one specific specialty based on their experience; proficiency in other areas is not a prerequisite.

• The contractor must provide a secure computer and high-speed internet connection.