Senior Research Scientist – Architectures Research

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Create innovative model architectures and methods focusing on areas such as efficient, sparse, and adaptive attention; long-context models and persistent memory; post-training transformation of pretrained models; selective computation and dynamic inference; as well as reasoning and continual adaptation architectures.

• Develop original research questions and convert them into comprehensive experimental programs.

• Design and assess architectural modifications at significant model scales.

• Establish techniques that maintain model quality while minimizing training or inference costs.

• Partner with engineering teams to validate concepts through efficient implementations.

• Publish research findings and contribute to open-source models, methodologies, and tools.

• Mentor fellow researchers and influence the direction of the research stream.

⛳️ Requirements

• A PhD or equivalent research experience in the field of machine learning.

• In-depth understanding of transformers, attention mechanisms, language-model training, and contemporary model architectures.

• A solid publication history or equivalent evidence of original research contributions.

• Proficiency in designing rigorous experiments and deriving clear conclusions from uncertain results.

• Strong programming capabilities in Python and familiarity with a modern deep-learning framework.

• Experience in training or evaluating models on a large scale.

• Excellent technical communication skills and the capability to lead research initiatives independently.

• Relevant experience with long-context modeling, memory systems, sparse or linear attention, model distillation, distributed training, or efficient inference is highly valued.

• Applicants must possess authorization to work in the country of application and provide proof of employment eligibility as a prerequisite for hiring.

🏝️ Benefits

• Competitive compensation package.

• Opportunities for career advancement and professional development.

• Flexibility in work arrangements and a sense of ownership.

• A collaborative and innovative work culture.

• The chance to engage in impactful AI projects.

• An international environment with talented teams.