Member of Technical Staff, AI Researcher

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and create evaluation frameworks, benchmarks, and methodologies for cutting-edge large language models, AI agents, multimodal models, and reinforcement learning environments.

• Create reward models, programmatic verifiers, graders, and other feedback systems that enhance the measurability and improvement of model behavior.

• Design and conduct controlled supervised fine-tuning and reinforcement learning experiments to assess the impact of datasets on model capabilities, generalization, and alignment.

• Investigate and articulate what constitutes evaluations that reflect real-world tasks and operational settings.

• Construct systems for generating high-quality human data, which include expert task design, annotation methodologies, data-quality signals, and data-attribution techniques.

• Convert research inquiries into streamlined, rigorous experiments that yield actionable insights.

• Rapidly prototype, analyze results, identify failure modes, and translate findings into enhanced benchmarks, datasets, or technical systems.

• Transition effective methods from experimental phases into scalable, production-ready implementations.

• Collaborate across research, engineering, product, and operations to progress a unified technical roadmap.

• Contribute to the wider technical community via benchmarks, open-source tools, research, and technical writing.

⛳️ Requirements

• 5+ years of pertinent experience in machine learning, artificial intelligence, computer science, data science, software engineering, or a similar technical discipline.

• Proven capability to function at the intersection of AI research and software engineering.

• Proficient in Python with experience in developing reliable, scalable software solutions.

• Practical experience with AI agents, model evaluations, reinforcement learning, post-training, or related systems.

• Solid understanding of advanced AI methodologies, including benchmarks, evaluation techniques, agent harnesses, post-training strategies, and training-data design.

• Experience in building or working with reward models, automated verifiers, graders, or other model-feedback mechanisms.

• Experience in designing evaluations or experiments that assess model capabilities, generalization, alignment, or agent performance.

• Ability to create research prototypes and evolve them into maintainable, production-quality systems.

• Strong analytical, problem-solving, written communication, and technical documentation competency.

• U.S. citizenship is mandatory.

• An advanced degree in machine learning, artificial intelligence, computer science, data science, or a related area is preferred but not essential.

• Candidates with equivalent research and engineering experience, including notable technical, open-source, or published contributions, are encouraged to apply.

🏝️ Benefits

• Career progression opportunities with the potential for rapid advancement based on strong performance as the firm expands.

• Comprehensive health care, including medical, dental, and vision, fully covered by the employer for you and your family.

• Paid maternity and paternity leave for 14 weeks at the employee's regular pay rate.

• Unlimited paid time off (PTO), subject to management approval.

• Opportunities for professional growth and ongoing learning.

• Option for 401K, FSA, and equity incentives available.

• Mental health support available through Tara Mind.

• Cost-effective GLP-1 solutions provided through Crux.