
Software Engineering, Data Science, Systems Design Expert – AI Model Evaluation
Posted 12 hours ago

Posted 12 hours ago
This is a fully remote position, open to applicants in United States, +2 more countries.
• Assess the accuracy, reasoning, clarity, and completeness of AI-generated responses.
• Implement and test code to verify correctness and performance.
• Detect bugs, inefficiencies, and logical inconsistencies in model outputs.
• Provide detailed feedback and suggestions for improvement on responses.
• Evaluate code quality, readability, and compliance with best practices.
• Verify technical claims using trustworthy and authoritative sources.
• Consistently apply structured evaluation frameworks and guidelines.
• Generate structured and reproducible evaluation outputs to enhance the reliability of AI-generated code and engineering tasks.
• A Bachelor’s, Master’s, or PhD in Computer Science or a related discipline.
• Over 3 years of professional experience in software engineering, data science, or similar fields.
• Strong expertise in at least two programming languages (e.g., Python, JavaScript, C++, Java, SQL, Go, Rust, etc.).
• Capability to independently resolve medium to complex algorithmic challenges.
• Experience collaborating with or alongside large language models in coding workflows.
• Exceptional attention to detail and the ability to assess intricate technical reasoning.
• Experience in AI model evaluation, reinforcement learning from human feedback (RLHF), or data annotation.
• Background in competitive programming.
• Contributions to open-source projects (preferably with merged pull requests).
• Experience in reviewing production-grade code.
• Ability to articulate complex technical concepts clearly to non-specialists.
• Fully remote work with flexible hours.
• Options for full-time or part-time contracts available.
• Weekly payments based on services provided.
ASRC Federal
Origami Risk
The Standard
Get handpicked remote jobs straight to your inbox weekly.