AI Research Engineer – Pre Training

This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Conduct pre-training of AI models on extensive, distributed servers that are equipped with thousands of NVIDIA GPUs.

• Design, prototype, and scale novel architectures to improve model intelligence.

• Execute experiments both independently and collaboratively, analyze outcomes, and refine methodologies to achieve optimal performance.

• Investigate, debug, and enhance both model efficiency and computational performance.

• Contribute to the progression of training systems to guarantee seamless scalability and efficiency on targeted platforms.

⛳️ Requirements

• A degree in Computer Science or a related discipline.

• Preferably a PhD in NLP, Machine Learning, or a related area, along with a strong record in AI research and development (with noteworthy publications in A* conferences).

• Hands-on experience in contributing to large-scale LLM training operations on extensive, distributed servers equipped with thousands of NVIDIA GPUs.

• Familiarity and practical experience with large-scale, distributed training frameworks, libraries, and tools.

• In-depth knowledge of cutting-edge transformer and non-transformer modifications aimed at enhancing intelligence, efficiency, and scalability.

• Strong expertise in PyTorch and Hugging Face libraries, with practical experience in model development, continual pretraining, and deployment.

🏝️ Benefits

• Competitive salary.

• Work from home options.

• Opportunity to collaborate with global teams.

• Innovative work environment.