Research Scientist, Real-Time Video Generation

This is a fully remote position, open to applicants in Europe.

📋 Description

• Design real-time and streaming generation models that facilitate responsive interactions while ensuring visual quality and consistency over time.

• Examine latency, continuity, and model performance during extended generation periods.

• Investigate character aesthetics, facial expressions, gestures, and body movements.

• Enhance the correlation between speech and motion across various identities and visual styles.

• Tailor video models to accommodate new data, behaviors, and capabilities through fine-tuning and post-training adjustments.

• Explore training objectives and conditioning techniques while implementing and assessing innovative ideas.

• Boost generation speed and efficiency through distillation, model-level strategies, and runtime enhancements.

• Evaluate quality, latency, and memory impacts.

• Detect gaps in data coverage and recurring failure patterns; enhance curation and sampling methods.

• Create datasets that facilitate models in learning desired behaviors.

• Develop both quantitative and qualitative assessments of generated video and interaction experiences.

• Review, replicate, and adapt pertinent research findings.

• Present experiments, demonstrations, and results.

• Assist the team in prioritizing research directions, time management, and computational resources.

⛳️ Requirements

• Proven experience in training or fine-tuning video or similar generative models.

• Capability to swiftly learn unfamiliar methods and translate ideas into productive experiments.

• Strong experimental judgment, ownership, and effective communication skills.

🏝️ Benefits

• Generous company equity.

• Comprehensive medical, dental, and vision insurance – with 99.99% of premiums covered by Cantina.

• 42 days of paid time off, which includes 15 PTO days, 10 sick days, 15 company holidays, and 2 floating holidays.

• Generous parental leave and fertility assistance.

• 401(k) retirement savings plan.

• Lifestyle spending account – $500/month for personal use.

• Complimentary lunch and snacks for employees in the office.

• One Medical membership.

• Benefits provided are applicable to U.S.-based roles.