Senior Research Scientist, Architectures Research

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Develop original research inquiries and convert them into thorough experimental programs.

• Design and assess architectural modifications at significant model scales.

• Create methodologies that maintain model integrity while decreasing training or inference expenses.

• Work alongside engineering teams to validate concepts through effective implementations.

• Publish research findings and contribute to open-source models, methodologies, and tools.

• Mentor fellow researchers and influence the research direction of the stream.

⛳️ Requirements

• A PhD or equivalent research experience in the field of machine learning.

• Extensive knowledge of transformers, attention mechanisms, language model training, and contemporary model architectures.

• A robust publication history or equivalent evidence of innovative research.

• Experience in designing rigorous experiments and deriving clear conclusions from uncertain results.

• Proficient implementation skills in Python and a contemporary deep-learning framework.

• Experience in training or assessing models at scale.

• Strong technical communication abilities and capacity to lead research independently.

• Relevant experience with long-context modeling, memory systems, sparse or linear attention, model distillation, distributed training, or efficient inference is particularly advantageous.

• Must possess authorization to work in the country of application and provide proof of employment eligibility as a condition of hiring.

🏝️ Benefits

• Competitive compensation.

• Opportunities for career advancement and learning.

• Flexibility and ownership in your work.

• A collaborative and innovative culture.

• Chance to engage in impactful AI projects.

• An international environment with talented teams.

• Quick-paced work atmosphere.

• Encouragement of bold thinking.

• Continuous growth opportunities.

• Ability to make a meaningful impact.

• Trust and genuine ownership.

• Opportunity to influence the future of AI.

• Commitment to equal employment opportunities and an inclusive workplace.

• Accommodations in the application process.