Agent Architect

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create and execute multi-agent workflows, focusing on task decomposition, state management, and utilizing tools such as RAG and API integration.

• Establish comprehensive evaluation frameworks leveraging methods like LLM-as-a-judge, promptfoo, or DSPy to assess and enhance agent performance at scale.

• Build reusable agents and prompt libraries that cater to over 1,000 brands, each with their distinct voice.

• Collaborate with AI Engineering and Product teams to identify which behaviors should be addressed through prompting, RAG, or fine-tuning.

• Serve as the technical lead for intricate client deployments, transforming creative briefs into deterministic AI workflows.

• Develop the agent logic, tool-calling frameworks, and evaluation processes that drive Pencil’s core creative engine and tailored client solutions.

• Assist in the foundational agents for the Pencil SaaS platform and custom workflows for various brands.

• Lower workflow failure rates, reduce token consumption and latency, enhance output quality, assess brand alignment, and deploy core agents throughout the Pencil user community.

⛳️ Requirements

• Minimum of 3 years of direct experience in GenAI.

• Profound, intuitive, and technical knowledge of LLMs, including GPT-4, Claude, and Gemini.

• Familiarity with multimodal models such as Stable Diffusion, Midjourney, and Video Gen.

• Systems thinking regarding latent space, context windows, and the chaining of agent outputs as inputs.

• Proficient in Python, JSON structures, and API documentation.

• Knowledge of benchmarking and A/B testing of AI outputs.

• Capability to convert creative direction into technical prompting strategies.

• Experience with orchestration frameworks like LangChain, CrewAI, or AutoGen is a significant advantage.

• Ability to work remotely from anywhere within your home country.

• Legal eligibility to work and reside in the country from which you plan to work.

🏝️ Benefits

• 25 days of PTO in addition to public holidays, with a Flexible Time Off scheme in place.

• Health insurance and private medical coverage.

• Monthly stipend for wellness, fitness, and learning and development.

• Remote work opportunities from anywhere in your home country.

• Enhanced parental leave policies for all parents, whether through birth, adoption, or surrogacy.

• Access to our Pencil office located in The Shard, London for employees based in the UK.

• Flexible working hours.