Software Engineer II, MLOps Framework

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of pipelines that transition models from research to production on edge hardware.

• Design and implement model conversion and compilation pipelines utilizing ONNX, TensorRT, and torch.compile for deployment on edge devices.

• Oversee and enhance the model release registry to ensure traceability and reproducibility across different model versions and target platforms.

• Conduct latency benchmarking and evaluate model quality parity to meet safety-critical performance standards.

• Compare metrics across various platforms to ensure compliance with accuracy and latency requirements prior to release.

• Collaborate with model development teams, perception teams, safety teams, and broader stakeholders to produce reliable and actionable outcomes.

⛳️ Requirements

• A Bachelor’s Degree in Computer Science, Electrical Engineering, Robotics, or a related discipline, alongside 4+ years of pertinent experience; or a Master’s Degree with 2+ years of experience.

• Significant experience with model conversion and compilation pipelines (ONNX, TensorRT, torch.compile), including rigorous latency benchmarking and quality parity validation.

• Practical experience in deploying and testing models on edge hardware platforms such as NVIDIA Orin or similar embedded systems.

• Experience in managing a model release registry within a production setting.

• Capability to analyze and interpret performance metrics across hardware platforms to validate models against stringent latency and accuracy standards.

• Bonus: Proficiency in model quantization (PTQ, QAT) and mixed-precision inference (INT8, FP8, FP4, BF16/FP16).

• Bonus: Experience in releasing multi-target models across diverse platforms.

• Bonus: Familiarity with perception algorithms for autonomous driving and multi-modal sensor fusion.

• Bonus: Development experience in C++ and/or CUDA kernels.

🏝️ Benefits

• A competitive compensation package that includes bonuses and stock options.

• Full coverage of medical, dental, and vision premiums for full-time employees.

• 401K plan featuring a 6% employer match.

• Flexible scheduling and generous paid vacation available immediately upon starting.

• AD+D and Life Insurance coverage.

• Potential sign-on bonuses, relocation assistance, and other compensation forms as part of the total package.