
Applied ML Engineer, Agents & Automation
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in United States.
• Design, construct, and implement AI agents that automate authorized workflows across Bask Health's telehealth platform.
• Develop agent architectures that integrate large language models, tools, APIs, and application logic.
• Create multi-step automation systems that coordinate tasks across various services.
• Implement dependable tool-calling and function-execution capabilities.
• Formulate orchestration logic for task planning, execution, and completion.
• Develop reusable components for managing agent states, handling context, and executing workflows.
• Integrate agents with internal APIs, databases, and approved external services.
• Develop retrieval capabilities that provide relevant information and application context.
• Design structured outputs and validation systems for actions generated by agents.
• Implement permission checks and authorization controls for automated tool execution.
• Establish human approval and confirmation steps for sensitive or consequential actions.
• Develop safeguards against prompt injection, unauthorized activities, and unreliable model behavior.
• Implement retry logic, error recovery, timeouts, and fallback mechanisms.
• Build monitoring and tracing systems for observable and debuggable agent behavior.
• Create automated tests for tool selection, workflow execution, and task completion.
• Develop evaluation datasets and benchmarks to assess agent accuracy and reliability.
• Measure agent success rates, task completion, latency, and operational costs.
• Investigate agent failures and enhance prompts, tools, models, and orchestration logic.
• Evaluate model adaptation, fine-tuning, or alternative machine learning approaches for task performance.
• Collaborate with product teams to identify repetitive workflows that are suitable for automation.
• Develop AI-driven automation for merchant configuration and operational tasks.
• Support authorized administrative workflows involving patient and pharmacy coordination.
• Collaborate with backend engineers to integrate agent systems into the production infrastructure.
• Design event-driven automation triggered by authorized application events.
• Optimize agent performance, infrastructure usage, and model inference costs.
• Create internal tools for inspecting, testing, and troubleshooting agent workflows.
• Participate in architecture discussions, code reviews, and engineering planning.
• Take ownership of assigned automation initiatives from technical design through deployment and ongoing improvement.
• A minimum of 3 years of professional experience in software engineering, machine learning engineering, or a closely related technical field.
• Proven experience in building and deploying production software applications.
• Strong programming abilities in Python, TypeScript, or similar languages.
• Practical experience in developing AI-powered applications or intelligent automation systems.
• Familiarity with large language models and contemporary generative AI development techniques.
• Experience in integrating model APIs into production software.
• Understanding of tool calling, function calling, and AI application orchestration.
• Experience in building backend services and application APIs.
• Familiarity with asynchronous programming and distributed application workflows.
• Understanding of workflow state management and multi-step process execution.
• Experience in integrating internal services, databases, and third-party APIs.
• Familiarity with structured model outputs and schema validation.
• Understanding of prompt engineering and evaluation of model behavior.
• Ability to identify and troubleshoot unreliable AI-generated outputs.
• Experience designing automated tests for production software.
• Familiarity with logging, monitoring, and troubleshooting in production environments.
• Understanding of authentication, authorization, and secure API design principles.
• Ability to implement error handling, retries, and recovery mechanisms.
• Familiarity with cloud-based application deployment.
• Understanding of data pipelines and structured application data.
• Ability to assess technical trade-offs between AI-driven automation and deterministic software.
• Experience working with Git, engaging in code reviews, and practicing collaborative engineering methods.
• Capacity to translate operational requirements into reliable technical solutions.
• Strong analytical thinking and problem-solving capabilities.
• Ability to autonomously manage engineering projects and communicate effectively with cross-functional teams.
• Nice to have: Experience in creating production AI agents or agent-based automation systems.
• Nice to have: Familiarity with LangGraph, LangChain, Semantic Kernel, or similar agent orchestration frameworks.
• Nice to have: Experience with OpenAI, Anthropic, or comparable model APIs.
• Nice to have: Experience in implementing multi-agent workflows or coordinated agent execution.
• Nice to have: Familiarity with retrieval-augmented generation and vector search methodologies.
• Nice to have: Experience in developing AI applications with persistent state or long-running workflows.
• Nice to have: Experience with event-driven architectures and workflow engines.
• Nice to have: Familiarity with AWS Lambda, SQS, EventBridge, or similar cloud services.
• Nice to have: Experience using Temporal or similar durable workflow orchestration platforms.
• Nice to have: Experience with model fine-tuning, supervised learning, or task-specific model adaptation.
• Nice to have: Familiarity with machine learning evaluation methodologies and experiment tracking techniques.
• Nice to have: Experience in developing benchmarks for agent task completion and tool-use accuracy.
• Nice to have: Experience with agent observability and tracing tools.
• Nice to have: Familiarity with human-in-the-loop approval systems.
• Nice to have: Experience in implementing sandboxed tool execution or restricted automation environments.
• Nice to have: Understanding of prompt injection risks and best practices for agent security.
• Nice to have: Experience in building automation for SaaS platforms or e-commerce operations.
• Nice to have: Familiarity with healthcare, telehealth, or pharmacy-related workflows.
• Nice to have: Understanding of HIPAA and considerations for healthcare data privacy.
• Nice to have: Experience using AI-assisted development tools such as Cursor or Claude Code.
• Competitive salary and performance-based incentives.
• Comprehensive health, dental, and vision insurance.
• Flexible work hours and remote work options.
• Opportunities for professional development and career advancement.
• Supportive and inclusive company culture.
Memory Bridge
Entrada
Find Your Talent (FYT)
Inmetrics
Get handpicked remote jobs straight to your inbox weekly.