Software Engineer, AI Evaluation

This is a fully remote position, open to applicants in India.

📋 Description

• Assess proposed programming tasks and their environments for feasibility

• Offer technical insights regarding the structure and complexity of evaluation harnesses

• Guide the process of validating intricate code challenges

• Recommend enhancements to increase the robustness of test suites

• Engage in an AI-facilitated session centered on coding evaluation harnesses

⛳️ Requirements

• Professional software engineer located in South Asia

• Experience in creating or evaluating realistic programming tasks

• Knowledge of coding evaluation harnesses or test automation

• At ease discussing technical processes during an interview

• Background in backend development, test automation, or full-stack engineering

• Proven experience in building and assessing complex codebases

• Practical experience in verifying realistic programming tasks within professional settings

🏝️ Benefits

• Compensation for participation in studies

• Payment for interviews