
AI Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Florida.
• Develop agent harnesses utilizing Python with LangChain and LangGraph, incorporating tool-calling, structured outputs (Pydantic/JSON schema), retries, streaming, and memory management.
• Package agent harnesses for the AgentCore Runtime, ensuring they contain the right context, tools, skills, and subagents that integrate seamlessly into production workflows and scenarios.
• Create the tools and skills utilized by agents: API integrations, SQL queries for Snowflake, and retrieval of Snowflake-backed knowledge with clear contracts and Pydantic validation.
• Construct evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore Evaluations and integrate them into CI processes.
• Implement safeguard measures around tool execution: including authorization scoping, input/output validation, protections against PII and prompt injection, and mitigation of hallucinations.
• Take full responsibility for what you deliver: prototype, deploy via Amazon AgentCore, monitor traces, and address issues as they arise.
• Collaborate with data engineers on retrieval patterns backed by Snowflake (Cortex Analyst and Cortex Search Services).
• Contribute to the enhancement of our internal engineering practices as the technology stack evolves.
• A minimum of 3 years of professional experience in Python, with hands-on experience in building and managing services in production.
• At least 1 year of practical experience with LLMs in production settings, including prompt/context engineering, tool/function calling, structured outputs, and RAG.
• Familiarity with LangChain/LangGraph or a similar framework such as AgentCore Strands, CrewAI, or Semantic Kernel.
• Experience with LLM observability tools like Amazon CloudWatch, LangSmith, Langfuse, MLflow, or OpenTelemetry.
• Proficiency in designing evaluation frameworks (MLFlow, DeepEval, LLM-as-judge, multi-turn regression).
• Strong skills in Git, Docker, and contemporary API frameworks.
• Excellent written communication skills and the ability to discern when something is ready for deployment.
• A bachelor’s degree is not mandatory; equivalent practical experience, including bootcamps, self-directed learning, career transitions, or non-CS technical degrees, is acceptable.
• Flexible Time Off to rejuvenate when necessary.
• Nine Company-Wide Holidays.
• An extensive array of benefits focusing on your growth, development, and personal well-being.
Omada Health
NineTwoThree Studio
Stride, Inc.
KeyBank
Get handpicked remote jobs straight to your inbox weekly.