Software Engineer – Coding Evaluation, Training Data

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of comprehensive coding data projects, managing them from the initial scoping and pilot design phases through to execution, iteration, and scaling.

• Create training workflows and task structures that emulate real-world software engineering practices (e.g., refactoring, debugging, code review, navigating large repositories, and utilizing tools).

• Establish and refine rubrics, golden sets, and reward signals that accurately reflect true engineering value, rather than merely assessing if the code compiles.

• Assess data and worker outputs with a discerning software engineering perspective, making decisions on what qualifies as meeting the standards for frontier training.

• Design and implement qualification processes for coding workers, which include hands-on evaluations of their programming skills.

• Set up or collaborate on sophisticated technical environments (e.g., containers, repositories, test harnesses, sandboxes, and code execution infrastructure).

• Work alongside technical personnel at our client sites to transform high-level training objectives into tangible projects and technical settings.

• Engage closely with Surge's engineering, product, and operations teams to enhance our coding data products, internal tools, and execution methodologies.

⛳️ Requirements

• 2 to 6+ years of professional software engineering experience in building and maintaining real systems.

• Proficient coding skills in at least one mainstream programming language and comfortable working within production codebases.

• Strong appreciation for quality engineering: you prioritize correctness, code quality, and the operational dynamics of genuine engineering teams.

• Ability to analyze and troubleshoot technical environments, including containers, dependencies, and automated testing configurations.

• Enthusiasm for managing projects from start to finish, encompassing scoping, workflow design, execution, and ongoing enhancement.

• Outstanding written and verbal communication abilities, capable of engaging credibly with senior client engineers and converting ambiguous goals into actionable plans.

• Passion for AI/ML systems and an understanding of how data, evaluation, and reward design can enhance coding capabilities.

🏝️ Benefits

• Competitive salary

• Remote work flexibility

• Professional development opportunities