Agent Architect

Posted Aug 6

This is a fully remote position, open to applicants in Latin America.

📋 Description

• Create and execute multi-agent workflows, encompassing task decomposition, state management, and tool utilization such as RAG and API integration.

• Establish comprehensive evaluation frameworks utilizing methodologies and tools like LLM-as-a-judge, promptfoo, or DSPy.

• Build reusable agents and prompt libraries to cater to over 1,000 brands, each with distinct voices simultaneously.

• Collaborate with AI Engineering and Product teams to identify which behaviors should be managed through prompting, RAG, or fine-tuning.

• Serve as the technical lead for intricate client deployments, converting creative briefs into deterministic AI workflows.

• Design and scale foundational agents that drive the Pencil SaaS platform.

• Develop tailored workflows for brands that necessitate specific brand DNA and complex creative logic.

• Decrease failure rates in complex agent workflows.

• Reduce token utilization and latency while enhancing output quality.

• Evaluate agent output alignment with brand guidelines through automated assessment tools.

• Deploy core agents to the Pencil user community.


⛳️ Requirements

• Over 3 years of direct experience in GenAI.

• Profound, intuitive, and technical knowledge of LLMs, including GPT-4, Claude, and Gemini.

• Familiarity with multimodal models such as Stable Diffusion, Midjourney, and Video Gen.

• Systems thinking regarding latent space, context windows, and multi-agent input/output flows.

• Proficient in Python, JSON structures, and API documentation.

• Knowledge of benchmarking and A/B testing for AI outputs.

• Capability to translate creative direction into technical prompting strategies.

• Experience with orchestration frameworks like LangChain, CrewAI, or AutoGen is a significant advantage.

• Ability to work from the candidate’s home country.

• Legal authorization to work and remain in the location from which the candidate intends to work.


🏝️ Benefits

• 25 days of PTO in addition to public holidays, with a Flexible Time Off scheme in place.

• Health insurance / private medical coverage.

• Monthly allowance for wellness, fitness, and professional development.

• Remote work - the flexibility to work from anywhere within your home country.

• Enhanced parental leave policies for all parental pathways, including birth, adoption, or surrogacy.

• Access to our Pencil office located in The Shard, London for employees based in the UK.

• Flexible working hours.

People also viewed

Assist World15 hours ago

Architectural Drafting Assistant

PH flagPhilippines, +1 more countryPart-timeArchitect$700 – $900/month
ApplyView job
Clayton20 hours ago

Data Domain Architect III

US flagTennessee OnlyFull-timeArchitect
ApplyView job
Khan Academy Türkçe20 hours ago

Principal Experience Architect

US flagUnited States, +2 more locationsFull-timeArchitect$181.7k – $204.4k/year
ApplyView job
TaskUs21 hours ago

Learning Management System Architect

US flagTexas OnlyFull-timeArchitect$60k – $90k/year
ApplyView job
Endeavor21 hours ago

Global Messaging Architect

US flagNew York OnlyFull-timeArchitect$135k – $180k/year
ApplyView job
PODS21 hours ago

Architect II – Application

US flagFlorida OnlyFull-timeArchitect
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers