
Principal Data Scientist, NLP, Applied AI
Posted 9 hours ago

Posted 9 hours ago
This is a fully remote position, open to applicants in United Kingdom.
• Create and develop NLP enrichment pipelines to extract entities, classifications, claims, and summaries from scientific full-text documents at scale.
• Evaluate traditional NLP methods, embedding-based retrieval, LLM prompting, and fine-tuned smaller models, selecting strategies based on assessment, cost, and operational considerations.
• Collaborate with subject-matter experts and vendors to build high-quality evaluation sets.
• Determine metrics while balancing speed, quality, and cost.
• Produce high-quality Python code and manage concurrency and expenses for high-volume LLM workloads.
• Work alongside data engineers to coordinate tasks using Airflow, Dagster, and other data build tools.
• Design pipeline stages that are idempotent, retryable, and evaluable.
• Contribute to agentic AI applications that reason over enriched scientific datasets.
• Partner with editors, product managers, and engineers to guide product decisions and translate stakeholder feedback into modeling tasks.
• Take ownership of models, evaluations, code, production deployments, and outcomes from start to finish.
• Extensive production experience with Python at scale, including knowledge of asyncio, threads, and queues.
• Strong background in NLP covering LLMs, transformers, embeddings, retrieval, NER, classification, and sequence labeling.
• Proven experience in creating evaluations and learning from the results.
• Capacity to compare methodologies and defend decisions based on evaluation, cost, and operational factors.
• Demonstrated history of delivering production systems that provide value to actual users.
• Familiarity with scientific or scholarly text is a plus.
• Understanding of AWS S3, Batch, Lambda, SageMaker, and Parquet or Iceberg data lake patterns is advantageous.
• Experience managing LLMs within production cost and latency constraints is beneficial.
• Exposure to agentic AI applications, tool utilization, multi-step reasoning, guardrails, and trajectory evaluation is a plus.
• A resume/CV is required for application.
• Meeting-free Friday afternoons.
• Opportunities for professional development.
• Employee programs that support community engagement, learning, and personal growth.
• Comprehensive benefits package.
• Competitive salary.
• Reasonable accommodations for applicants and employees with disabilities.
• Opportunities for internal mobility.
Roofr
Wikimedia Foundation
ICA, Inc.
ICA, Inc.
Get handpicked remote jobs straight to your inbox weekly.