
NLP Engineer
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Spain, +1 more country.
• Enhance and train language models for the copilot.
• Tailor models to fit new conversational contexts, response specifications, and output formats.
• Create training and evaluation datasets.
• Analyze model inaccuracies, identify data deficiencies, outline annotation tasks, and review resultant examples.
• Choose models and develop prompts.
• Evaluate internally hosted models against external APIs in terms of quality, latency, and cost.
• Maintain evaluation datasets and benchmarks.
• Assess new versions for regressions and investigate unsatisfactory responses and user feedback.
• Develop services and APIs surrounding models.
• Package and deploy models, incorporating logging and monitoring, while addressing production issues.
• Enhance inference speed, GPU memory efficiency, and serving costs while preserving response quality.
• Assume responsibility for assigned tasks, ensure reproducibility of experiments, and document decisions and outcomes.
• Proficient in Python with experience in writing maintainable code beyond research notebooks.
• Hands-on experience with PyTorch and Hugging Face Transformers.
• Understanding of transformer models, tokenization, training, and text generation.
• Experience in adapting language models through supervised fine-tuning and techniques such as LoRA.
• Capability to prepare and validate datasets, mitigate data leakage, and analyze model errors.
• Experience in evaluating generated text using benchmarks, human reviews, and automated methods.
• Comprehension of the limitations associated with each evaluation method.
• Familiarity with model APIs, prompts, and structured outputs.
• Ability to develop and maintain APIs using FastAPI or a similar framework.
• Practical experience with Docker, Linux, Git, and deploying models on GPUs.
• Knowledge of an inference framework such as vLLM or a comparable tool.
• Skill in adding logging, monitoring, and appropriate tests, investigating production failures, and rolling back problematic releases.
• SQL proficiency to retrieve and analyze product data.
• Sufficient English proficiency to read technical documentation and research publications.
• Practical experience with recommendation systems, even if limited.
• REMOTE OPPORTUNITY to work full-time.
• 28 calendar days of vacation per year.
• 7 wellness days off each year.
• Children’s education reimbursement: 50% compensation for kindergarten or school expenses, up to $1000 gross per year per child, based on paychecks following the integration period.
• Bonuses up to $5000 for referring successful candidates.
• 50% coverage for professional training, international conferences, and meetings.
• Corporate discount on English lessons.
• Health benefits: up to $1,000 gross per year per employee for self-purchased health insurance or medical fees for the employee and close relatives when corporate medical insurance is not applicable.
• Equipped workplace and necessary equipment in office or co-working spaces.
• Reimbursement of workplace costs up to $1000 gross every 3 years for other locations.
• Internal gamified gratitude system offering bonuses that can be exchanged for merchandise, team-building activities, massage certificates, etc.
Get handpicked remote jobs straight to your inbox weekly.