
AI Code Reviewer, Systems Evaluation Engineer 2
Posted Jul 27

Posted Jul 27
This is a fully remote position, open to applicants in Mexico.
β’ Create objective and measurable evaluation criteria (rubrics) to assess system performance.
β’ Analyze system logs and execution paths to enhance reliability and improve code quality.
β’ Refactor code and optimize system functionality to achieve ideal results.
β’ Conduct vulnerability tests on systems, focusing on data exposure and edge-case failures.
β’ Deliver comprehensive, high-quality feedback on system performance and outputs.
β’ Minimum of 2 years of experience in backend engineering, AI automation, or systems integration.
β’ Strong expertise in at least two programming languages (e.g., Python, JavaScript, Go, Java).
β’ Experience with SQL databases is essential.
β’ Demonstrated ability to develop and maintain production-grade systems.
β’ Experience in live (non-mocked) environments with multi-step interactions.
β’ Strong analytical capabilities and meticulous attention to detail.
β’ Familiarity with multi-stage system workflows and coordination tasks (Nice to Haves).
β’ Knowledge of integrating tools such as APIs, databases, or external platforms (Nice to Haves).
β’ Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation) (Nice to Haves).
β’ Experience with AI systems or agent-based workflows (Nice to Haves).
β’ Fully remote position with a flexible work schedule.
β’ Engagement based on projects with no guaranteed hours.
β’ Compensation is tied to the completion of tasks only.
CVS Health
One Impression
Volga Partners
Mercor
Get handpicked remote jobs straight to your inbox weekly.