Research Engineer – Code Generation, Model Evaluation

This is a fully remote position, open to applicants in New York.

📋 Description

• Analyze, debug, and resolve technical challenges across various software codebases

• Investigate bugs, implementation failures, incorrect behaviors, and edge cases

• Utilize algorithmic reasoning and data structure knowledge to tackle complex coding problems

• Evaluate potential solution paths and select the most suitable technical approaches

• Design and implement new features along with technical enhancements

• Refactor codebases to enhance maintainability, clarity, and adaptability

• Optimize code for performance, efficiency, and reliability

• Review implementation choices and identify architectural or technical enhancements

• Produce high-quality, well-structured code that can be consistently tested and evaluated

• Develop and review realistic coding tasks used to assess AI model capabilities

• Evaluate AI-generated code for correctness, completeness, performance, and technical quality

• Identify logical errors, implementation weaknesses, constraint violations, and incomplete solutions

• Validate generated outputs against expected behaviors and objective technical requirements

• Author feedback and annotations that support AI model training and evaluation

• Document technical decisions, best practices, implementation details, and problem-solving strategies

• Collaborate with technical stakeholders and contributors from the open-source community

• Clearly communicate complex engineering concepts in both written and verbal formats

• Contribute to knowledge sharing and maintain consistent technical standards

⛳️ Requirements

• Strong expertise in competitive programming, coding problem analysis, or technically challenging software engineering

• Advanced proficiency in at least one of the following: Python3, Java, Rust, C++, Go, or TypeScript

• Solid grasp of algorithms, data structures, complexity, and software engineering fundamentals

• Proven experience with open-source contributions or involvement in collaborative software projects

• Familiarity with debugging, feature implementation, code refactoring, or performance optimization

• Excellent written and verbal communication abilities

• Capability to clearly and precisely explain technical decisions and reasoning

• Strong attention to detail regarding code validation, correctness, and output consistency

• Comfort in working independently in a remote and collaborative setting

• Ability to produce high-quality, well-documented work within tight timelines

• No prior experience in AI research or model training is needed

• Minimum weekly submission requirements must be met

• Work must be performed without utilizing confidential or proprietary information from any employer, client, institution, or other third party

🏝️ Benefits

• Part-time independent contractor engagement

• Fully remote work

• Output-based compensation for tasks that meet project specifications

• Flexible project workload and task complexity based on experience and workflow