Senior Machine Learning Engineer

This is a fully remote position, open to applicants in New York.

📋 Description

• Design, develop, and refine VLM-based pipelines that produce high-quality labels and annotations at scale, encompassing prompt engineering, fine-tuning, and evaluation.

• Identify the signals, frames, metadata, and contextual features to be transmitted from edge devices to enhance VLM accuracy and minimize ambiguity.

• Work in partnership with Embedded Systems and Hardware teams to establish device-side preprocessing and data-forwarding strategies that optimize bandwidth, latency, and model performance.

• Collaborate with Data Science to create robust evaluation frameworks for assessing label quality, model accuracy, and regression detection.

• Benchmark and incorporate commercial and open-source VLMs, remaining updated on the rapidly evolving landscape of vision-language capabilities.

⛳️ Requirements

• Over 5 years of experience in machine learning engineering, with practical experience in computer vision and/or LLM/VLM systems.

• Strong knowledge of Vision-Language Models — you have utilized, evaluated, or fine-tuned models such as GPT-4V, Claude's vision capabilities, Gemini, LLaVA, or similar.

• Experience in constructing and assessing labeling systems at scale.

• Comprehensive understanding of how edge/device constraints (bandwidth, compute, power) influence the data available to cloud-side models.

• Proficient in a modern ML stack: Python, PyTorch, cloud inference APIs, and tools for experiment tracking and evaluation.

• Hands-on prompt engineering skills — you know how to maximize the effectiveness of large models through structured prompting, few-shot examples, and iterative refinement.

• A practical engineering mindset — you prioritize building systems that function reliably in production, rather than just in notebooks.

• Ability to scope and drive work independently in a dynamic, early-stage environment.

• Excellent communication skills and a collaborative approach to working across hardware, embedded, and ML teams.

🏝️ Benefits

• Flexible PTO

• Medical, dental, and vision coverage