
Senior AI Automation Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Colombia.
• Design and develop agent orchestration layers, which encompass workflow states, event-driven agent execution, and next-best-action logic.
• Integrate LLMs through provider-agnostic layers utilizing platforms such as Anthropic, OpenAI, and Writer.ai.
• Implement structured outputs, tool-calling, retries, guardrails, and model-routing strategies.
• Convert unstructured inputs—including documents, transcripts, and business records—into dependable, actionable data.
• Create human-in-the-loop approval workflows for significant decision-making processes.
• Establish evaluation and tuning loops to assess agent quality and enhance system behavior.
• Identify and mitigate non-deterministic failure modes through rigorous testing, observability, and guardrails.
• Collaborate with frontend, product, client, and domain stakeholders to deliver comprehensive solutions.
• Utilize AI coding agents such as Claude Code and Codex within the software development workflow.
• Clearly communicate technical concepts to both executive and non-technical audiences.
• Perform additional duties as assigned.
• Over 5 years of experience in delivering production software.
• Practical experience in constructing LLM-powered or agentic applications using tool-calling, structured outputs, RAG, and prompt iteration.
• Strong proficiency in TypeScript and Node.js, or substantial software engineering expertise in another ecosystem such as Python.
• Familiarity with orchestration frameworks like LangGraph.js, Vercel AI SDK, or Mastra.
• Experience working with provider SDKs such as Anthropic, OpenAI, or Writer.ai.
• Proven experience in designing scalable systems on AWS.
• Demonstrated capability to parse, extract, validate, and structure unstructured data.
• An evaluation-driven mindset for measuring and enhancing agent performance.
• Ability to work independently in ambiguous environments and convert undefined problems into actionable solutions.
• A product-oriented approach that links architecture and model decisions to measurable user value.
• Excellent communication skills for explaining agent pipelines to both technical and non-technical stakeholders.
• B2+ English proficiency.
• Comfort in a fast-paced, agile consulting environment.
• Experience in delivering AI solutions within regulated or high-stakes industries such as legal, healthcare, or fintech is a plus.
• Familiarity with building automated evaluation harnesses for LLM systems is a plus.
• Experience with voice, transcript, or document-intensive workflows is a plus.
• Knowledge of Next.js, open-source agent projects, or Writer.ai is a plus.
• No specific benefits or compensation extras are mentioned in the posting.
• Remote work opportunity from Colombia.
General Dynamics Information Technology
Precisely
Tenstorrent Inc.
Horizon3.ai
Get handpicked remote jobs straight to your inbox weekly.