Senior Prompt Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Employ Automatic Prompt Generation (APG) tools to develop baseline prompts for intricate parent-child template clusters.

• Operate and oversee the Automated Prompt Optimization (APO) tool, assess the outputs, and identify when the APO encounters deadlocks or plateaus.

• Craft, test, and enhance prompts manually to navigate complex template architectures, address anti-patterns, and manage edge cases where tools are insufficient or malfunctioning. Resolve edge-case scenarios by designing and improving manual prompts.

• Supervise shadowbot runs to confirm that sufficient disagreements (between human and LLM ratings) are recorded, generated, and monitored.

• Execute prompt versions against established gold data to consistently assess autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.

• Prepare technical launch readiness justifications (Launch Certification Documentation) for final approval.

⛳️ Requirements

• Native proficiency in German and fluent in English.

• Must reside in Germany.

• Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical discipline.

• Minimum of 4 years’ experience as a Prompt Engineer, with demonstrated expertise in fine-tuning Large Language Models (LLMs) for precise, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning techniques.

• Strong capability in identifying error patterns, analyzing model performance, and utilizing SQL or other data analytics tools.

• Ability to rapidly learn and master proprietary tools with minimal oversight.

• Exceptional verbal and written communication skills.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote working options.

• Comprehensive health insurance and wellness programs.