Senior AI Automation Engineer

Posted 1 day ago

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Design and develop agent orchestration layers, which encompass workflow states, event-driven agent execution, and next-best-action logic.

• Integrate LLMs through provider-agnostic layers utilizing platforms such as Anthropic, OpenAI, and Writer.ai.

• Implement structured outputs, tool-calling, retries, guardrails, and model-routing strategies.

• Convert unstructured inputs—including documents, transcripts, and business records—into dependable, actionable data.

• Create human-in-the-loop approval workflows for significant decision-making processes.

• Establish evaluation and tuning loops to assess agent quality and enhance system behavior.

• Identify and mitigate non-deterministic failure modes through rigorous testing, observability, and guardrails.

• Collaborate with frontend, product, client, and domain stakeholders to deliver comprehensive solutions.

• Utilize AI coding agents such as Claude Code and Codex within the software development workflow.

• Clearly communicate technical concepts to both executive and non-technical audiences.

• Perform additional duties as assigned.


⛳️ Requirements

• Over 5 years of experience in delivering production software.

• Practical experience in constructing LLM-powered or agentic applications using tool-calling, structured outputs, RAG, and prompt iteration.

• Strong proficiency in TypeScript and Node.js, or substantial software engineering expertise in another ecosystem such as Python.

• Familiarity with orchestration frameworks like LangGraph.js, Vercel AI SDK, or Mastra.

• Experience working with provider SDKs such as Anthropic, OpenAI, or Writer.ai.

• Proven experience in designing scalable systems on AWS.

• Demonstrated capability to parse, extract, validate, and structure unstructured data.

• An evaluation-driven mindset for measuring and enhancing agent performance.

• Ability to work independently in ambiguous environments and convert undefined problems into actionable solutions.

• A product-oriented approach that links architecture and model decisions to measurable user value.

• Excellent communication skills for explaining agent pipelines to both technical and non-technical stakeholders.

• B2+ English proficiency.

• Comfort in a fast-paced, agile consulting environment.

• Experience in delivering AI solutions within regulated or high-stakes industries such as legal, healthcare, or fintech is a plus.

• Familiarity with building automated evaluation harnesses for LLM systems is a plus.

• Experience with voice, transcript, or document-intensive workflows is a plus.

• Knowledge of Next.js, open-source agent projects, or Writer.ai is a plus.


🏝️ Benefits

• No specific benefits or compensation extras are mentioned in the posting.

• Remote work opportunity from Colombia.

People also viewed

General Dynamics Information Technology1 day ago

Power Automation Developer

US flagUnited States OnlyFull-timeQA Automation Engineer$74.8k – $101.2k/year
ApplyView job
Precisely2 days ago

Senior Detection & Security Automation Engineer

US flagUnited States OnlyFull-timeQA Automation Engineer
ApplyView job
Tenstorrent Inc.2 days ago

EDA Tools, Design Automation Engineer

US flagUnited States OnlyFull-timeQA Automation Engineer$100k – $500k/year
ApplyView job
Horizon3.ai2 days ago

Senior IT Engineer, Automation

US flagUnited States OnlyFull-timeQA Automation Engineer$142.7k – $161.9k/year
ApplyView job
Addvisor Group2 days ago

Senior Test Automation Analyst

BR flagBrazil OnlyFull-timeQA Automation Engineer
ApplyView job
Edmentum2 days ago

Director – Automation Engineering

US flagUnited States OnlyFull-timeQA Automation Engineer$170k – $185k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers