
Principal Data Scientist, NLP, Applied AI
Posted Nov 2

Posted Nov 2
This is a fully remote position, open to applicants in United Kingdom.
• Develop and construct NLP enhancement pipelines that extract entities, classifications, claims, and summaries from scientific full texts on a large scale.
• Evaluate traditional NLP methods, embedding-based retrieval, LLM prompting, and fine-tuned smaller models for extraction and enhancement purposes.
• Take ownership of the evaluation process by creating golden sets, selecting metrics, and balancing speed, quality, and cost considerations.
• Write high-quality production-level Python code while managing concurrency and costs associated with high-volume LLM workloads.
• Work in partnership with data engineers to coordinate tasks using Airflow, Dagster, and data build tools.
• Design pipeline stages that are idempotent, retryable, and evaluable.
• Contribute to agentic AI applications that analyze enriched scientific corpora.
• Collaborate with editors, product managers, and engineers to guide product decisions and translate stakeholder feedback into modeling tasks.
• Extensive experience with Python in production environments and at scale.
• Strong background in NLP, including expertise in LLMs, transformers, embeddings, retrieval, NER, classification, and sequence labeling.
• Experience in building evaluations and learning from the findings.
• Capability to compare different approaches by considering evaluation, cost, and operational trade-offs.
• Proven history of deploying production systems that provide value to actual users.
• Nice to have: experience with scientific or scholarly texts.
• Nice to have: knowledge of AWS services including S3, Batch, Lambda, and SageMaker.
• Nice to have: familiarity with Parquet or Iceberg data lake architectures.
• Nice to have: experience in managing LLMs within production cost and latency constraints.
• Nice to have: exposure to agentic AI applications, tool usage, multi-step reasoning, guardrails, and trajectory evaluation.
• Meeting-free Friday afternoons.
• Opportunities for professional development.
• Comprehensive employee programming aimed at fostering community, learning, and growth.
• A thorough benefits package.
• Reasonable accommodations for applicants and employees with disabilities.
TD
IntegriChain
Eli Lilly and Company
Jerry
Get handpicked remote jobs straight to your inbox weekly.