AI Code Reviewer, Systems Evaluation Engineer 2

This is a fully remote position, open to applicants in India.

📋 Description

• Create objective and measurable evaluation criteria (rubrics) to assess system performance.

• Analyze system logs and execution paths to enhance reliability and improve code quality.

• Refactor existing code and optimize system functionality to achieve ideal outcomes.

• Conduct tests on systems to identify vulnerabilities, including data exposure and edge-case failures.

• Deliver comprehensive, high-quality feedback regarding system performance and outputs.

⛳️ Requirements

• Minimum of 2 years of experience in backend engineering, AI automation, or systems integration.

• Strong command of at least two programming languages (e.g., Python, JavaScript, Go, Java).

• Experience with SQL databases is essential.

• Demonstrated ability to develop and maintain production-quality systems.

• Experience in live (non-mocked) environments involving multi-step interactions.

• Exceptional analytical skills and meticulous attention to detail.

• Nice to Haves: Familiarity with multi-stage system workflows and coordination tasks.

• Knowledge of integrating tools such as APIs, databases, or external platforms.

• Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation).

• Experience with AI systems or agent-based workflows.

• Comfort with persistent state tracking or similar frameworks.

🏝️ Benefits

• Fully remote work with a flexible schedule.

• Engagement is project-based with no guaranteed hours.

• Tasks are assigned based on availability and project requirements.

• Compensation is based solely on completed tasks.

• Freelancers have the option to accept or decline tasks based on their availability.