Software Engineer – AI Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Evaluate and analyze the quality of practical programming assignments

• Assess coding environments and technical frameworks for AI testing

• Identify potential issues in the provided code structures

• Offer insights on the difficulty and authenticity of coding challenges

• Evaluate the technical precision, complexity, and realism of coding challenges

• Clarify the logic behind evaluation environments

• Compare evaluation environments against standard industry benchmarks

⛳️ Requirements

• Proven experience as a software engineer or developer

• Knowledge of creating or validating programming tasks

• Experience with code reviews and evaluation frameworks

• Comfortable engaging in discussions about technical architecture and testing methodologies

• Practical experience in developing, reviewing, or testing realistic programming assignments

• Familiarity with evaluation frameworks

• Open to full-stack developers, backend engineers, test automation engineers, and systems architects

🏝️ Benefits

• Compensation for interview/study participation

• $75 per hour payment