Principal RL Engineer – E2E Autonomy

This is a fully remote position, open to applicants in California.

📋 Description

• Influence the design of the end-to-end (E2E) training and inference pipeline both on-vehicle and off-vehicle, as well as on-premises and off-premises.

• Create new models and features for the E2E autonomy framework.

• Design and implement cutting-edge online and offline reinforcement learning algorithms for intricate, long-duration tasks.

• Develop reward models and exploration strategies that meet task performance and stringent safety standards.

• Facilitate flexible customer operations across various tasks using natural language instructions.

• Enhance policy robustness against sensor noise, machine degradation, and extreme environmental changes.

• Design and execute experiments while developing evaluation frameworks for both simulation and real-world applications.

• Partner with infrastructure engineers to create scalable E2E training systems and extensive simulation infrastructure.

• Collaborate with pretraining and robotics engineers to incorporate reinforcement learning into the comprehensive E2E autonomy framework.

• Promote the E2E vision and advocate for an E2E-first organizational approach.

• Act as an in-house reinforcement learning expert through code reviews, algorithmic advice, technical leadership, and mentoring.

• Stay updated on the latest advancements in reinforcement learning research and integrate these innovations into the stack.

⛳️ Requirements

• PhD with 3 years of experience or over 5 years of professional experience in delivering high-performance reinforcement learning products.

• Demonstrated success in developing reinforcement learning models; production robotics experience is preferred.

• Proficient in creating simulation environments and addressing sim-to-real transfer challenges.

• Skilled in designing and developing software for complex systems.

• Comfortable working with new hardware systems and tackling new reinforcement learning/machine learning/software challenges.

• Strong proficiency in Python programming.

• Familiarity with deep learning frameworks such as PyTorch.

• Exceptional brainstorming, creative thinking, mathematical analysis, and communication skills.

• Proven ability to anticipate technical challenges and make architectural and design decisions to mitigate them.

• Bachelor’s, Master’s, or PhD in Computer Science or a related field.

• Experience with robotics middleware such as ROS or similar robotics-focused software packages is preferred.

• Strong background in CUDA or other GPU frameworks is preferred.

• Experience in multidisciplinary environments is preferred.

• Background in embedded systems is preferred.

• Experience in system architecture is preferred.

🏝️ Benefits

• Eligibility for Blue River’s bonus and benefits programs.

• Visa sponsorship available.

• An inclusive workplace with diversity, equity, and inclusion initiatives.

• Opportunities for recruiting, mentorship, career development, and learning & development programs.

• Reasonable accommodations for individuals with disabilities.

• A meaningful, challenging mission alongside a team of incredible people.