Machine Learning Researcher, Multimodal LLMs

This is a fully remote position, open to applicants in California.

📋 Description

• Play a key role in the evolution of Bland's next-generation multimodal LLM stack.

• Integrate speech, text, tools, and real-time reasoning into a cohesive system.

• Develop conversational AI models that drive Bland's agent functionalities.

• Establish the mechanisms by which agents listen, think, and take action in real-time.

• Incorporate streaming audio, tool execution, and dynamic context seamlessly.

• Advance research concepts into production systems that manage millions of calls daily.

• Convert modeling concepts into enhancements that directly benefit users.

• Take full ownership of projects from research through to deployment.

• Focus on optimizing latency, accuracy, and real-world application.

⛳️ Requirements

• Proven experience with LLMs, multimodal models, or speech-language systems.

• In-depth knowledge of prompting, fine-tuning, and alignment methodologies.

• Familiarity with neural audio codecs and contemporary multimodal LLM strategies.

• Ability to swiftly transition from concept to dataset, experiment, and conclusion.

• Skill in designing experiments that effectively address research questions.

• Strong intuition regarding what differentiates a natural interaction from a robotic one.

• Capability to translate conceptual modeling ideas into tangible user-facing improvements.

• Commitment to ownership throughout the research-to-deployment process.

• Comfort in navigating ambiguous and rapidly changing environments.

• Experience with real-time voice systems or conversational AI applications.

• Background in tool-using agents or agent frameworks.

• Experience with multimodal datasets that encompass audio, text, and actions.

• Contributions to research or open-source projects related to LLM or speech.

• New hires are required to complete Form I-9, and employment will be verified through E-Verify.

🏝️ Benefits

• Significant equity opportunities.

• Comprehensive healthcare, dental, and vision coverage.

• High level of autonomy and impact in your role.

• Office located in Levi's Plaza, San Francisco.