Senior Prompt Engineer

This is a fully remote position, open to applicants in Netherlands.

📋 Description

• Employ Automatic Prompt Generation (APG) tools to establish foundational prompts for intricate parent-child template clusters.

• Operate and oversee the Automated Prompt Optimization (APO) tool, assess the results, and identify instances when the APO encounters deadlocks or plateaus.

• Manually create, test, and enhance prompts to navigate complex template frameworks, address anti-patterns, and manage edge cases where tools may be insufficient or malfunctioning. Resolve edge-case issues by designing and improving manual prompts.

• Observe shadowbot operations to confirm that adequate discrepancies (between human and LLM ratings) are documented, produced, and monitored.

• Execute prompt versions against predefined gold data to consistently evaluate autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.

• Prepare technical launch readiness justifications (Launch Certification Documentation) for final approval.

⛳️ Requirements

• Native fluency in Dutch and proficiency in English.

• Location: Must reside in the Netherlands.

• Education: Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.

• Prompt Engineering & AI Expertise: A minimum of 4 years' experience as a Prompt Engineer. Demonstrated experience in tuning Large Language Models (LLMs) for precise, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.

• Data Analysis: Strong ability to identify error patterns, evaluate model performance, and utilize SQL or other data analytics tools.

• Technical Agility: Capacity to swiftly learn and master proprietary tools with little supervision.

• Communication: Outstanding verbal and written communication skills.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote work options.

• Collaborative and innovative work environment.