Lead ML/Perception Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate independently with cross-functional teams to define software and system requirements.

• Spearhead significant architectural enhancements to the perception stack, which include designing at the system level, modularization, and implementing migration strategies to boost scalability, latency, and maintainability across the fleet.

• Conceptualize, develop, and take ownership of scene detection and activation functionalities, identifying the operating scene/scenario and initiating the relevant perception behaviors and operational design domain (ODD) logic during runtime.

• Enhance perception reliability under deteriorating conditions and adverse weather, covering aspects such as sensor fault detection, health monitoring, graceful degradation, and fallback strategies for situations involving rain, snow, fog, glare, low-light, and sensor obstructions/occlusions.

• Design, implement, and rigorously test cutting-edge perception features punctually, ensuring high-quality, industrial-grade production code.

• Integrate large-scale multi-modal models (including, but not limited to, VLMs and LLMs) into the perception stack to advance semantic scene comprehension and reasoning.

• Monitor and analyze the technical performance of perception systems in real-world applications.

• Oversee the development of major features, encompassing feature design, code reviews, issue identification, and resolution.

• Conduct extensive testing to verify features and meet release timelines.

• Guide development related to data, software development, and machine learning pipelines, focusing on multimodal data alignment for training foundational models.

⛳️ Requirements

• At least 5+ years of industry experience in working with real-world robotic systems while maintaining high-quality industrial-grade code.

• A Master's degree in Robotics, Computer Science, Computer Engineering, or a related field that emphasizes a solid mathematical and/or engineering foundation.

• Proven experience in leading or making critical architectural decisions for a perception, robotics, or autonomy software stack.

• Proficient programming skills in C/C++/Python; experienced in software development within Linux environments.

• Strong background in machine learning/deep learning development using PyTorch/TensorFlow.

• Direct experience in developing or refining large-scale multi-modal models (e.g., multi-sensor fusion models, foundation models, including VLM backbones) for practical perception applications.

• Experience in working across multiple real-time domains, including:

• Computer Vision: object detection, classification, and segmentation.

• Semantic scene understanding, scene/scenario detection, and open-vocabulary detection.

• Perception reliability in degraded or adverse weather conditions.

• Multi-target tracking and sensor fusion.

• Extensive experience in deploying features/machine learning/deep learning models in real-time systems with high precision and low latency.

🏝️ Benefits

• Comprehensive healthcare suite that includes medical, dental, vision, life, and disability insurance plans. Domestic partners who have cohabited for at least one year are also eligible for participation.

• Health Savings and Flexible Spending Accounts for Healthcare and Dependent Care are available.

• Generous retirement benefits, featuring an immediately vested employer safe harbor match.

• Ample paid parental leave along with a gradual return to work policy.

• Flexible vacation policy, in addition to paid company holidays.

• Total Wellness Program offering a variety of resources for overall wellbeing.