
Agent Architect
Posted Aug 6

Posted Aug 6
This is a fully remote position, open to applicants in Latin America.
• Create and execute multi-agent workflows, encompassing task decomposition, state management, and tool utilization such as RAG and API integration.
• Establish comprehensive evaluation frameworks utilizing methodologies and tools like LLM-as-a-judge, promptfoo, or DSPy.
• Build reusable agents and prompt libraries to cater to over 1,000 brands, each with distinct voices simultaneously.
• Collaborate with AI Engineering and Product teams to identify which behaviors should be managed through prompting, RAG, or fine-tuning.
• Serve as the technical lead for intricate client deployments, converting creative briefs into deterministic AI workflows.
• Design and scale foundational agents that drive the Pencil SaaS platform.
• Develop tailored workflows for brands that necessitate specific brand DNA and complex creative logic.
• Decrease failure rates in complex agent workflows.
• Reduce token utilization and latency while enhancing output quality.
• Evaluate agent output alignment with brand guidelines through automated assessment tools.
• Deploy core agents to the Pencil user community.
• Over 3 years of direct experience in GenAI.
• Profound, intuitive, and technical knowledge of LLMs, including GPT-4, Claude, and Gemini.
• Familiarity with multimodal models such as Stable Diffusion, Midjourney, and Video Gen.
• Systems thinking regarding latent space, context windows, and multi-agent input/output flows.
• Proficient in Python, JSON structures, and API documentation.
• Knowledge of benchmarking and A/B testing for AI outputs.
• Capability to translate creative direction into technical prompting strategies.
• Experience with orchestration frameworks like LangChain, CrewAI, or AutoGen is a significant advantage.
• Ability to work from the candidate’s home country.
• Legal authorization to work and remain in the location from which the candidate intends to work.
• 25 days of PTO in addition to public holidays, with a Flexible Time Off scheme in place.
• Health insurance / private medical coverage.
• Monthly allowance for wellness, fitness, and professional development.
• Remote work - the flexibility to work from anywhere within your home country.
• Enhanced parental leave policies for all parental pathways, including birth, adoption, or surrogacy.
• Access to our Pencil office located in The Shard, London for employees based in the UK.
• Flexible working hours.
Weekday (YC W21)
Bart & Associates, Inc.
OCHIN, Inc.
Get handpicked remote jobs straight to your inbox weekly.