
AI Code Reviewer, Systems Evaluation Engineer 2
Posted Jul 27

Posted Jul 27
This is a fully remote position, open to applicants in Philippines.
• Create objective and verifiable evaluation criteria (rubrics) for assessing system performance.
• Analyze system logs and execution paths to enhance reliability and improve code quality.
• Refactor code and optimize system operations towards achieving ideal outcomes.
• Conduct vulnerability testing on systems, focusing on data exposure and edge-case failures.
• Deliver detailed, high-quality feedback regarding system performance and outputs.
• Over 2 years of experience in backend engineering, AI automation, or systems integration.
• Strong expertise in at least two programming languages (e.g., Python, JavaScript, Go, Java).
• Proficient in working with SQL databases.
• Demonstrated ability to build and maintain production-grade systems.
• Experience in live (non-mocked) environments with multi-step interactions.
• Excellent analytical skills and meticulous attention to detail.
• Familiarity with multi-stage system workflows and coordination tasks (Nice to Haves).
• Knowledge of integrating tools such as APIs, databases, or external platforms (Nice to Haves).
• Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation) (Nice to Haves).
• Experience with AI systems or agent-based workflows (Nice to Haves).
• Comfort in working with persistent state tracking or similar frameworks (Nice to Haves).
• Fully remote work with a flexible schedule.
• Project-based engagement with no guaranteed hours.
• Tasks assigned based on availability and project requirements.
• Compensation is contingent on completed tasks only.
• Acceptance of project invitations is required before commencing work.
• Freelancers have the option to accept or decline tasks based on their availability.
• No guaranteed workload; task volume may fluctuate weekly.
CVS Health
One Impression
Volga Partners
Mercor
Get handpicked remote jobs straight to your inbox weekly.