Computer Science Research Expert – AI Benchmarking

This is a fully remote position, open to applicants in New York.

📋 Description

• Create original and thought-provoking multiple-choice questions in the field of computer science.

• Assess and ensure the accuracy, clarity, rigor, completeness, and solvability of pre-existing questions.

• Revise questions and answer options while documenting significant technical modifications.

• Develop assessment material covering topics such as GPU and accelerator programming, computer architecture, formal methods, distributed systems, cloud infrastructure, operating systems, databases, machine learning, software/web/API engineering, embedded systems, graphics, game development, and mobile systems.

• Provide 1–5 academic references for each question as needed.

• Compose structured solution explanations that include appropriate intermediate reasoning.

• Evaluate question difficulty using Medium, Hard, and Expert classifications.

• Uphold consistent technical and academic quality across benchmark content.

• Play a role in creating gold-standard evaluation resources for advanced AI systems.

⛳️ Requirements

• A PhD or current doctoral candidacy in Computer Science, Electrical Engineering, Computer Engineering, or a closely related technical field.

• A Master’s degree may be considered for candidates with exceptional expertise in a relevant subdomain.

• Proficient understanding of graduate-level computer science theory, algorithms, systems design, and/or Machine Learning.

• Expertise in one or more relevant fields such as GPU Kernel Engineering, Computer Architecture, Formal Methods, Distributed Systems, DevOps, Site Reliability Engineering, Data Engineering, Databases, Cloud Infrastructure, Operating Systems, Machine Learning Engineering, Web Development, APIs, Embedded Systems, Computer Graphics, Game Development, or Mobile Engineering.

• Strong capability to analyze complex technical systems and validate rigorous solutions.

• Excellent command of written English with the ability to articulate complex technical concepts effectively and clearly.

• Academic research publications will be highly regarded.

• Significant software engineering or technical industry experience is highly valued.

• Experience with major technology firms, research institutions, or advanced engineering teams is a plus.

• Background in competitive programming, examination development, or advanced technical problem design is highly valued.

• Keen attention to technical accuracy, logical consistency, and problem solvability.

• Expected to be available for at least 10 hours per week.

• Work must be conducted without utilizing confidential or proprietary information from any employer, client, institution, or third party.

• H1-B and STEM OPT support is not available for this position.

🏝️ Benefits

• Flexible scheduling aligned with project requirements.

• Fully remote and asynchronous work environment.

• Part-time independent contractor arrangement.

• Competitive pay ranging from $55 to $75 per hour.

• Project durations may be adjusted based on needs and performance.