Remotery

AI Engineer

Posted 1 hour ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop features, workflows, and agentic systems powered by LLMs that address genuine customer challenges.

• Design and execute evaluation frameworks to assess agent quality, reliability, and business impact.

• Create automated benchmarks, regression tests, and datasets for the evaluation of AI behavior.

• Analyze agent failures and formulate systematic strategies to enhance performance.

• Experiment with prompting techniques, tool usage, retrieval, memory, planning, and reasoning strategies.

• Construct infrastructure that facilitates rapid experimentation, evaluation, deployment, and monitoring.

• Collaborate closely with customers and internal teams to comprehend workflows and pinpoint opportunities for AI automation.

• Contribute to engineering best practices regarding testing, observability, and production reliability.

• Remain up-to-date with developments in LLMs, agents, evaluation methodologies, and AI engineering.


⛳️ Requirements

• Proficient programming skills, ideally in Python.

• Strong foundation in software engineering, including testing, debugging, and system design.

• Experience in developing applications, projects, or products utilizing LLMs and contemporary AI tools.

• Capability to design experiments, analyze results, and make data-informed decisions.

• Excellent communication skills with a willingness to work collaboratively across various disciplines.

• A sense of curiosity, ownership, and a keen desire to learn swiftly.

• Experience in creating AI agents, copilots, or workflow automation systems.

• Background in designing evaluations, benchmarks, or testing frameworks for AI systems.

• Familiarity with OpenAI, Anthropic, Gemini, or open-source LLM ecosystems.

• Experience with retrieval systems, vector databases, and RAG architectures.

• Knowledge of LangGraph, OpenAI Agents SDK, MCP, or similar agent frameworks.

• Experience with observability, tracing, and production monitoring for AI systems.

• Exposure to cybersecurity, security operations, or developer tooling.

• Contributions to open-source projects, research initiatives, or personal AI products.


🏝️ Benefits

• Engage with some of the most complex challenges in applied AI.

• Play a key role in defining the evaluation and deployment of agentic systems in a production environment.

• Join a small, highly collaborative team where you can make a significant impact and enjoy substantial ownership.

• Accelerate your learning while working alongside seasoned engineers, researchers, and security professionals.

• Help shape the future of AI-driven security operations.

People also viewed

OneQrew1 hour ago

AI Product Engineer

DE flagGermany OnlyFull-timeAI Engineer
ApplyView job
NVIDIA1 hour ago

Senior Technical Marketing Engineer, Enterprise AI Software

US flagCalifornia OnlyFull-timeAI Engineer$200k – $322k/year
ApplyView job
The Home Depot1 hour ago

Senior AI Engineer

US flagColorado OnlyFull-timeAI Engineer$100k – $180k/year
ApplyView job
BJAK1 hour ago

Applied AI Engineer – AI Neobank App

PL flagPoland OnlyFull-timeAI Engineer
ApplyView job
BJAK1 hour ago

iOS Software Engineer – AI Neobank App

DE flagGermany OnlyFull-timeAI Engineer
ApplyView job
SRM Technologies1 hour ago

Senior Full Stack AI Engineer

IN flagIndia OnlyFull-timeAI Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers