Research Engineer – Infrastructure

atHarveyRemoteUS flagUnited StatesFull-timeInfrastructure EngineerMid-levelSenior$230k – $450k/year

Posted 7 hours ago

This is a fully remote position, open to applicants in United States.

πŸ“‹ Description

β€’ Scale the post-training stack that supports SFT and RL on leading open-weight models.

β€’ Develop distributed rollout infrastructure that coordinates model inference, tool execution, and the collection of training experiences for long-horizon tasks.

β€’ Create reproducible agent environments for models to engage with documents, tools, and external systems during training and evaluation.

β€’ Take ownership of the performance and reliability of training runs, including GPU utilization, checkpointing, failure recovery, and observability.

β€’ Identify and eliminate training and inference bottlenecks.

β€’ Construct internal tools and services for managing and versioning training data, evaluating results, browsing outcomes, and tracking training jobs and experiments.

β€’ Integrate models into production, focusing on serving, latency, cost, and online evaluation.

β€’ Collaborate with researchers to transform experimental workflows into reliable systems while facilitating rapid experimentation.


⛳️ Requirements

β€’ Proven experience in building ML infrastructure, distributed systems, or research tooling, with a focus on performance, reliability, and operational excellence.

β€’ Strong proficiency in Python and general software engineering skills across backend services, data systems, and internal tools.

β€’ Familiarity with ML frameworks such as PyTorch, JAX, or similar.

β€’ Experience in distributed training or inference, including the ability to diagnose performance bottlenecks and failures throughout the stack.

β€’ Understanding of post-training workflows.

β€’ Practical judgment regarding what to build versus what to adopt.

β€’ Capability to collaborate with researchers and deliver rapidly as requirements change.

β€’ Experience with RL rollouts, agent environments, or sandboxed tool execution is advantageous.

β€’ United States work authorization and visa sponsorship information must be included in the application.


🏝️ Benefits

β€’ Equity plan.

β€’ Comprehensive health, dental, and vision coverage.

β€’ Retirement benefits, including a 401k match of up to 4%.

β€’ Flexible PTO.

β€’ Eligibility for bonuses.

β€’ Opportunities for personal, professional, and financial growth.

People also viewed

Health Care Service Corporation8 hours ago

Infrastructure Engineer – Teradata

US flagAlabama, +41 more statesFull-timeInfrastructure Engineer$69.8k – $125.9k/year
ApplyView job
Koniag Government Services8 hours ago

Network & Infrastructure Engineering

US flagDistrict of Columbia, +1 more stateFull-timeInfrastructure Engineer
ApplyView job
Liftoff Mobile16 hours ago

Senior Software Engineer, Infrastructure

US flagUnited States, +18 more locationsFull-timeInfrastructure Engineer$141k – $176k/year
ApplyView job
Harvey16 hours ago

Senior Infrastructure Engineer

US flagUnited States OnlyFull-timeInfrastructure Engineer$153k – $210.5k/year
ApplyView job
HelloKindred19 hours ago

Infrastructure Architect

GB flagUnited Kingdom OnlyFreelanceInfrastructure EngineerΒ£352 – Β£384/day
ApplyView job
Solutions for Information Design, Inc.22 hours ago

Cloud Security Engineer – Infrastructure

US flagUnited States OnlyFull-timeInfrastructure Engineer$110k – $130k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers