AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and deploy automations and agentic workflows that interact with internal REST and GraphQL APIs to retrieve data and execute production actions.

• Provide document automation utilizing OCR, data extraction, managed services, and LLM vision technologies.

• Establish confidence thresholds, perform deterministic validation against TMS data, and manage the routing of low-confidence outcomes for human review.

• Identify and design optimal approaches for each workflow using LLMs, deterministic software, RPA, or commercially available tools.

• Conduct build-versus-buy assessments, proof of concepts (POCs), and comparative analyses focusing on total cost of ownership, integration efforts, and operational demands.

• Execute build-or-buy strategies, including the integration and deployment of purchased solutions.

• Collaborate with the UiPath RPA team to enhance or replace bots with AI and establish seamless AI/RPA transitions.

• Work with Engineering and Platform teams on necessary platform modifications and deliver the automation solutions.

• Create evaluation frameworks that include labeled datasets, LLM-as-judge pipelines, regression testing, and release gates.

• Enhance AI system reliability through validation, fallback mechanisms, idempotency, permissions, audit trails, monitoring, and capturing reviewer corrections.

• Assess and optimize Zapier automations by retaining, strengthening, consolidating, or replacing them.

• Prototype against real-world workflows and data, successfully advancing work to production.

• Document every automation, detailing ownership, API dependencies, and maintaining a runbook.

⛳️ Requirements

• Minimum of 5 years in software engineering, with direct experience in deploying LLM-based or automation systems to production environments.

• Practical experience with LLM APIs (Anthropic, OpenAI) and agentic patterns, including tool invocation, structured outputs, exception handling, and human-in-the-loop processes.

• Strong decision-making skills regarding the application of LLMs, deterministic software, or RPA.

• Experience in developing evaluation frameworks for non-deterministic systems, including golden datasets, LLM-as-judge calibrated against human labels, and regression testing for changes in prompts or models.

• Proven experience in assessing and integrating third-party AI or automation solutions, balancing cost, effort, and risk against in-house development.

• Proficient in backend engineering and REST/GraphQL API integration on AWS, preferably using Node.js/TypeScript.

• Ability to communicate effectively with non-technical stakeholders: translating operational workflows into system designs and articulating trade-offs to leadership.

• Demonstrated history of delivering functional systems that extend beyond mere demonstrations or prototypes.

• Background in freight or logistics (TMS, EDI, drayage, or carrier/shipper operations) is a plus.

• Experience with Document AI or OCR, including confidence calibration and human review processes is advantageous.

• Familiarity with RPA platforms (UiPath preferred) and enhancing or modernizing existing bots with AI is desirable.

• Knowledge of low-code automation (Zapier) and workflow orchestration is advantageous.

• Experience with SQL and dbt; familiarity with Redshift, MongoDB, PostgreSQL, or Firestore is a plus.

• Proficiency in React for developing lightweight internal tools is preferable.

• Active participation in GitHub or contributions to open-source projects is a bonus.

🏝️ Benefits

• Competitive salary package.

• Comprehensive medical, dental, and vision insurance.

• 401K matching program.

• Flexible paid time off (PTO) and designated holidays.