AI Systems, Language & Reasoning Models

This is a fully remote position, open to applicants in California.

📋 Description

• Lead the creation of foundational language and reasoning models that effectively utilize the unique dynamics of our innovative silicon technology.

• Translate the behaviors of contemporary language models directly onto the physical principles of our hardware.

• Innovate traditional sequence modeling to harness the continuous-time dynamics of silicon, moving beyond layers of inefficient digital abstraction.

• Define the training protocols, loss functions, and evaluation metrics required to push the boundaries of language understanding, logical reasoning, and generation speed, while ensuring the high energy efficiency of our platform.

• Work collaboratively with hardware designers, theorists, and system builders to co-develop the model architecture alongside the fundamental physical compute elements.

⛳️ Requirements

• An MS/PhD or equivalent research/project experience in a quantitative discipline such as AI/Machine Learning, Computer Science, Physics, Electrical Engineering, or Applied Mathematics.

• Extensive, hands-on knowledge of the theory, architecture, and training of modern foundational models (transformers, SSMs, text diffusion/flow, etc.).

• Proven, practical experience with model scaling. You have successfully planned and executed extensive, distributed training operations for large language or reasoning models, navigating the challenges of massive compute clusters.

• Proficient in contemporary deep learning frameworks (PyTorch or JAX) with a demonstrated history of producing clean, scalable training code for large language models.

• Additionally, you may have experience in hardware-in-the-loop training, mixed-signal hardware, quantization, or physics-informed neural networks.

🏝️ Benefits

• A comprehensive package featuring top-tier health benefits.

• 401k matching.

• Truly unlimited paid time off (PTO).

• Complimentary meals provided in our Palo Alto office.