Applied ML Engineer, Agents & Automation

Posted 4 days ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, construct, and implement AI agents that automate authorized workflows across Bask Health's telehealth platform.

• Develop agent architectures that integrate large language models, tools, APIs, and application logic.

• Create multi-step automation systems that coordinate tasks across various services.

• Implement dependable tool-calling and function-execution capabilities.

• Formulate orchestration logic for task planning, execution, and completion.

• Develop reusable components for managing agent states, handling context, and executing workflows.

• Integrate agents with internal APIs, databases, and approved external services.

• Develop retrieval capabilities that provide relevant information and application context.

• Design structured outputs and validation systems for actions generated by agents.

• Implement permission checks and authorization controls for automated tool execution.

• Establish human approval and confirmation steps for sensitive or consequential actions.

• Develop safeguards against prompt injection, unauthorized activities, and unreliable model behavior.

• Implement retry logic, error recovery, timeouts, and fallback mechanisms.

• Build monitoring and tracing systems for observable and debuggable agent behavior.

• Create automated tests for tool selection, workflow execution, and task completion.

• Develop evaluation datasets and benchmarks to assess agent accuracy and reliability.

• Measure agent success rates, task completion, latency, and operational costs.

• Investigate agent failures and enhance prompts, tools, models, and orchestration logic.

• Evaluate model adaptation, fine-tuning, or alternative machine learning approaches for task performance.

• Collaborate with product teams to identify repetitive workflows that are suitable for automation.

• Develop AI-driven automation for merchant configuration and operational tasks.

• Support authorized administrative workflows involving patient and pharmacy coordination.

• Collaborate with backend engineers to integrate agent systems into the production infrastructure.

• Design event-driven automation triggered by authorized application events.

• Optimize agent performance, infrastructure usage, and model inference costs.

• Create internal tools for inspecting, testing, and troubleshooting agent workflows.

• Participate in architecture discussions, code reviews, and engineering planning.

• Take ownership of assigned automation initiatives from technical design through deployment and ongoing improvement.


⛳️ Requirements

• A minimum of 3 years of professional experience in software engineering, machine learning engineering, or a closely related technical field.

• Proven experience in building and deploying production software applications.

• Strong programming abilities in Python, TypeScript, or similar languages.

• Practical experience in developing AI-powered applications or intelligent automation systems.

• Familiarity with large language models and contemporary generative AI development techniques.

• Experience in integrating model APIs into production software.

• Understanding of tool calling, function calling, and AI application orchestration.

• Experience in building backend services and application APIs.

• Familiarity with asynchronous programming and distributed application workflows.

• Understanding of workflow state management and multi-step process execution.

• Experience in integrating internal services, databases, and third-party APIs.

• Familiarity with structured model outputs and schema validation.

• Understanding of prompt engineering and evaluation of model behavior.

• Ability to identify and troubleshoot unreliable AI-generated outputs.

• Experience designing automated tests for production software.

• Familiarity with logging, monitoring, and troubleshooting in production environments.

• Understanding of authentication, authorization, and secure API design principles.

• Ability to implement error handling, retries, and recovery mechanisms.

• Familiarity with cloud-based application deployment.

• Understanding of data pipelines and structured application data.

• Ability to assess technical trade-offs between AI-driven automation and deterministic software.

• Experience working with Git, engaging in code reviews, and practicing collaborative engineering methods.

• Capacity to translate operational requirements into reliable technical solutions.

• Strong analytical thinking and problem-solving capabilities.

• Ability to autonomously manage engineering projects and communicate effectively with cross-functional teams.

• Nice to have: Experience in creating production AI agents or agent-based automation systems.

• Nice to have: Familiarity with LangGraph, LangChain, Semantic Kernel, or similar agent orchestration frameworks.

• Nice to have: Experience with OpenAI, Anthropic, or comparable model APIs.

• Nice to have: Experience in implementing multi-agent workflows or coordinated agent execution.

• Nice to have: Familiarity with retrieval-augmented generation and vector search methodologies.

• Nice to have: Experience in developing AI applications with persistent state or long-running workflows.

• Nice to have: Experience with event-driven architectures and workflow engines.

• Nice to have: Familiarity with AWS Lambda, SQS, EventBridge, or similar cloud services.

• Nice to have: Experience using Temporal or similar durable workflow orchestration platforms.

• Nice to have: Experience with model fine-tuning, supervised learning, or task-specific model adaptation.

• Nice to have: Familiarity with machine learning evaluation methodologies and experiment tracking techniques.

• Nice to have: Experience in developing benchmarks for agent task completion and tool-use accuracy.

• Nice to have: Experience with agent observability and tracing tools.

• Nice to have: Familiarity with human-in-the-loop approval systems.

• Nice to have: Experience in implementing sandboxed tool execution or restricted automation environments.

• Nice to have: Understanding of prompt injection risks and best practices for agent security.

• Nice to have: Experience in building automation for SaaS platforms or e-commerce operations.

• Nice to have: Familiarity with healthcare, telehealth, or pharmacy-related workflows.

• Nice to have: Understanding of HIPAA and considerations for healthcare data privacy.

• Nice to have: Experience using AI-assisted development tools such as Cursor or Claude Code.


🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and career advancement.

• Supportive and inclusive company culture.

People also viewed

Memory Bridge10 hours ago

Senior Applied ML Engineer

US flagUnited States OnlyFull-timeMachine Learning Engineer
ApplyView job
Entrada11 hours ago

Senior Machine Learning Engineer, Databricks

PL flagPoland, +2 more countriesFull-timeMachine Learning Engineer
ApplyView job
Find Your Talent (FYT)13 hours ago

Senior Machine Learning Engineer

US flagUnited States OnlyFull-timeMachine Learning Engineer
ApplyView job
Inmetrics13 hours ago

Machine Learning Engineer

BR flagBrazil OnlyFull-timeMachine Learning Engineer
ApplyView job
SandboxAQ15 hours ago

Staff Machine Learning Engineer – Medical Devices

CA flagCanada OnlyFull-timeMachine Learning EngineerC$146k – C$258k/year
ApplyView job
StackAdapt15 hours ago

Staff Applied Machine Learning Scientist – Identity

US flagUnited States, +1 more countryFull-timeMachine Learning Engineer$182.4k – $250.8k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers