Head of Agent Architecture

This is a fully remote position, open to applicants in Europe.

📋 Description

• Define Pencil’s technical vision and roadmap for agent architecture, encompassing multi-agent workflows, task decomposition, state management, and tool utilization.

• Recruit, mentor, and oversee a small team of Agent Architects.

• Establish technical standards, offer real-time feedback, and facilitate development discussions.

• Implement and advocate for evaluation frameworks to assess agent performance.

• Manage reusable agents and prompt libraries catering to over 1,000 brands with distinct voices.

• Determine what functionalities should be developed as reusable platform features versus custom projects.

• Collaborate with AI Engineering, Product, and Sales/Client leadership on prompting, RAG, and fine-tuning strategies.

• Act as the ultimate technical escalation point for intricate client deployments.

• Lead discovery efforts for high-stakes projects and convert vague client challenges into actionable agent workflows.

• Communicate cost, latency, and reliability trade-offs to senior non-technical stakeholders.

• Represent Pencil’s agent technology to brand and agency stakeholders.

• Set standards for breaking down client challenges and articulating complex technical decisions in layman's terms.

• Promote system reliability, architectural efficiency, brand alignment, large-scale adoption, successful client deployments, stakeholder trust, and team development.

⛳️ Requirements

• 8+ years of hands-on GenAI experience.

• 2+ years in a leadership role or managing a function.

• Profound technical knowledge with LLMs including GPT-4, Claude, and Gemini.

• Experience with multimodal models such as Stable Diffusion, Midjourney, and video generation.

• Proven history of managing engineers or architects, or leading a function’s roadmap and outcomes.

• Systems thinking capabilities spanning latent space, context windows, and multi-agent inputs and outputs.

• Proficient in Python, JSON structures, and API documentation.

• Familiarity with agent orchestration patterns including task decomposition, tool utilization, and state management.

• Experience in building or overseeing benchmarking and A/B testing methodologies.

• Background in hiring and developing technical talent, or managing a roadmap under stakeholder scrutiny.

• Ability to articulate a strategic vision, secure senior leadership endorsement, and hold a team accountable.

• Demonstrated experience leading discovery sessions with senior customers or stakeholders.

• Capability to transform ambiguous briefs into well-defined technical solutions.

• Background in solutions architecture leadership, forward-deployed engineering, or technical consulting is advantageous.

• Skill in explaining agent failure modes, evaluation outcomes, and architectural trade-offs to non-technical stakeholders in a clear manner.

• Proficiency in translating creative direction into specific system modifications.

• Comfortable representing technology during client engagements.

🏝️ Benefits

• 25 days of PTO in addition to public holidays, with a Flexible Time Off scheme in place.

• Health insurance / private medical coverage.

• Monthly stipend for wellness, fitness, and professional development.

• Remote work options available, allowing you to work from anywhere in your home country.

• Enhanced parental leave policies for those becoming parents through birth, adoption, or surrogacy.

• Access to our Pencil office located in The Shard, London for employees in the UK.

• Flexible working hours.