Software Engineering, Data Science, Systems Design Expert – AI Model Evaluation

Posted 12 hours ago

This is a fully remote position, open to applicants in United States, +2 more countries.

📋 Description

• Assess the accuracy, reasoning, clarity, and completeness of AI-generated responses.

• Implement and test code to verify correctness and performance.

• Detect bugs, inefficiencies, and logical inconsistencies in model outputs.

• Provide detailed feedback and suggestions for improvement on responses.

• Evaluate code quality, readability, and compliance with best practices.

• Verify technical claims using trustworthy and authoritative sources.

• Consistently apply structured evaluation frameworks and guidelines.

• Generate structured and reproducible evaluation outputs to enhance the reliability of AI-generated code and engineering tasks.


⛳️ Requirements

• A Bachelor’s, Master’s, or PhD in Computer Science or a related discipline.

• Over 3 years of professional experience in software engineering, data science, or similar fields.

• Strong expertise in at least two programming languages (e.g., Python, JavaScript, C++, Java, SQL, Go, Rust, etc.).

• Capability to independently resolve medium to complex algorithmic challenges.

• Experience collaborating with or alongside large language models in coding workflows.

• Exceptional attention to detail and the ability to assess intricate technical reasoning.

• Experience in AI model evaluation, reinforcement learning from human feedback (RLHF), or data annotation.

• Background in competitive programming.

• Contributions to open-source projects (preferably with merged pull requests).

• Experience in reviewing production-grade code.

• Ability to articulate complex technical concepts clearly to non-specialists.


🏝️ Benefits

• Fully remote work with flexible hours.

• Options for full-time or part-time contracts available.

• Weekly payments based on services provided.

People also viewed

ASRC Federal10 hours ago

Data Engineer

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Origami Risk11 hours ago

Senior Data Engineer

US flagUnited States OnlyFull-timeData Engineer$117k – $146k/year
ApplyView job
The Standard11 hours ago

Data Engineer IV

US flagOregon OnlyFull-timeData Engineer$131.8k – $223.5k/year
ApplyView job
Acxiom11 hours ago

Senior Data Engineer

US flagNew York OnlyFull-timeData Engineer
ApplyView job
VendueTech11 hours ago

Senior Data Engineer

Anywhere in the WorldPart-timeData Engineer
ApplyView job
qByte Labs LLC11 hours ago

Data Engineer – Databricks, Snowflake

Anywhere in the WorldFull-timeData Engineer$125k – $135k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers