Applied AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and deploy AI agents that cater to real users, incorporating tool-calling LLM systems with structured outputs, parallel API orchestration, and streaming responses.

• Create evaluation harnesses and quality scoring systems using Langfuse and rubrics that assess safety, effectiveness, and personalization.

• Manage the entire lifecycle from prototyping agent functionalities to evaluation, staging, production deployment, trace monitoring, and iterative improvements.

• Enhance reliability, latency, and cost-efficiency through prompt caching, token budgets, retry logic, and comprehensive observability.

• Construct agent tools that include API integrations with Pydantic validation, facilitate search over local databases, and enable structured workout submissions.

• Collaborate with product, mobile, and backend engineers to discover opportunities and iterate based on data insights.

⛳️ Requirements

• Proficient in Python with experience in building and deploying services on large-scale production systems.

• Familiarity with LangChain/LangGraph or comparable agent frameworks.

• Practical experience with LLMs, prompt engineering, tool/function calling, structured outputs, and evaluation.

• Comfortable with asynchronous Python, HTTP APIs, and streaming protocols such as SSE and webhooks.

• Experience with data validation and schema design utilizing Pydantic and JSON Schema.

• Ability to troubleshoot issues across application and infrastructure layers, including Terraform resources.

• Strong communication skills and the capability to collaborate directly with product, mobile, and backend engineers.

• Nice to have: familiarity with AWS services, including Bedrock, ECR, CloudFront, S3, and Cognito, or other cloud agent hosting solutions.

• Nice to have: knowledge of observability and tracing tools such as Langfuse, OpenTelemetry, and Datadog.

• Nice to have: experience with evaluation frameworks like LLM-as-a-judge, automated scoring, and dataset management.

• Nice to have: infrastructure-as-code experience with Terraform or CDK.

🏝️ Benefits

• Equity participation provided alongside base salary.

• Comprehensive medical, vision, dental, and disability insurance coverage.

• Tax-saving accounts available for eligible employees.

• 401(k) plan featuring tax-advantaged savings options.

• Remote-first work environment for employees located anywhere within the continental US.

• No travel obligations required.

• Monthly health and fitness stipend.

• Access to a mental health platform and therapy support services.

• Reimbursement for medical-related travel expenses.

• Annual budget for learning and development, including courses, conferences, coaching, and tools.

• Flexible paid time off (PTO).

• Complimentary membership to the Future platform.

• Significant equity package offered.