Senior ML Engineer

This is a fully remote position, open to applicants in Europe.

📋 Description

• Take ownership of machine learning projects from initial exploration to production deployment and continuous iteration.

• Design complex LLM workflows that incorporate tool usage, retrieval, and orchestration specifically for clinical environments.

• Create evaluation datasets, both online and offline harnesses, LLM-as-judge pipelines with human reviews, and regression tests.

• Enhance model quality through techniques such as prompting, retrieval, distillation, or fine-tuning based on empirical evidence.

• Collaborate across data preparation, model adaptation, serving, monitoring, and feedback loops in production.

• Work in partnership with Product, Clinical, and Engineering teams to translate clinical needs into technical solutions.

• Conduct code reviews, disseminate knowledge, and mentor junior engineers.

⛳️ Requirements

• Proven experience in deploying machine learning systems to production that are relied upon by users.

• Practical experience with LLMs in production settings, including prompting, retrieval, tool calling, and agent-based workflows.

• A thorough approach to evaluation, encompassing the development of evaluation datasets and frameworks.

• Strong foundational knowledge in machine learning and the ability to assess trade-offs effectively.

• Capability to transform vaguely defined problems into functional production systems.

• Proficient coding skills suitable for production environments.

• Familiarity with distributed systems.

• Competence in debugging complex machine learning pipelines.

• Effective communication skills with both technical and clinical stakeholders.

• Ability to demonstrate at least Level 1 proficiency in AI.

• Bonus: Experience in fine-tuning or preference optimization methods (such as RLHF, DPO, or similar techniques).

• Bonus: Experience in healthcare AI or other high-stakes fields.

• Bonus: Background in developing agent frameworks or evaluation tools from the ground up.

• Bonus: Contributions to open source projects, technical writing, or other forms of knowledge sharing.

🏝️ Benefits

• Sword provides additional benefits that go beyond total compensation.

• Benefits specific to each country may differ and will be outlined separately.

• Total compensation may include variable bonuses or sales incentives.

• Private company stock options may also be part of the total compensation package.