Senior Prompt Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Employ Automatic Prompt Generation (APG) tools to establish foundational prompts for intricate parent-child template clusters.

• Operate and oversee the Automated Prompt Optimization (APO) tool, evaluate the results, and identify when the APO encounters deadlocks or plateaus.

• Manually create, test, and enhance prompts to navigate complex template structures, address anti-patterns, and manage edge cases where tools may be insufficient or malfunctioning. Resolve edge-case situations by developing and refining manual prompts.

• Oversee shadowbot operations to affirm adequate discrepancies (between human and LLM ratings) are logged, produced, and monitored.

• Execute prompt versions against predefined gold data to perpetually assess autorater quality against the human crowd baseline, calculating accuracy metrics including F1 scores, precision, and recall.

• Prepare technical launch readiness justifications (Launch Certification Documentation) for completion.

⛳️ Requirements

• Native proficiency in Spanish and fluent in English.

• Must reside in Spain.

• Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical discipline.

• Minimum of 4 years' experience as a Prompt Engineer. Demonstrated experience in fine-tuning Large Language Models (LLMs) for precise, structured outputs, complex classification tasks, and knowledge of chain-of-thought and few-shot learning methodologies.

• Strong ability to identify error patterns, analyze model performance, and utilize SQL or other data analytics tools effectively.

• Capable of rapidly learning and mastering proprietary tools with limited supervision.

• Exceptional verbal and written communication skills.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional development and training.

• Flexible working hours and remote work options.

• A collaborative and inclusive work environment.