Lead Prompt Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead and oversee a team throughout the entire technical migration process.

• Transition templates to LLM autorating systems.

• Utilize advanced prompt engineering methods and internal tools to enhance model performance.

• Formulate strategies, mentor junior engineers, and influence the development of AI-driven solutions.

• Employ Automatic Prompt Generation (APG) tools to develop baseline prompts.

• Operate and manage the Automated Prompt Optimization (APO) tool, review its outputs, and address any deadlocks or plateaus.

• Manually create, test, and refine prompts for intricate template structures.

• Monitor shadowbot executions to ensure that substantial discrepancies between human and LLM evaluations are recorded and tracked.

• Execute prompt versions against validated gold data to assess autorater quality.

⛳️ Requirements

• Native proficiency in English.

• Must reside in the United States.

• Master’s or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical discipline.

• Minimum of 7 years' experience as a Prompt Engineer. Demonstrated expertise in fine-tuning Large Language Models (LLMs) for precise, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning methodologies.

• Strong capability in detecting error patterns, analyzing model performance, and utilizing SQL or other data analytics tools.

• Ability to swiftly learn and master proprietary tools with minimal oversight.

• Exceptional verbal and written communication abilities.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and training.

• Collaborative and innovative work environment.