AI Backend Engineer, Artificial Intelligence

atParallel PartnersRemoteUS flagIllinoisFull-timeAI EngineerMid-levelSenior$140k – $200k/year

Posted Sep 22

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Develop and maintain backend systems that support AI-driven insurance workflows in a production environment.

• Create and implement AI orchestration layers that connect models, APIs, workflows, and business logic.

• Construct inference pipelines for large language model (LLM)-based and AI-assisted automation systems.

• Enhance latency, throughput, and cost efficiency across AI services through techniques such as caching, batching, streaming, and routing.

• Establish reliable service boundaries between backend systems, machine learning components, and product APIs.

• Implement observability features through logging, metrics, tracing, alerting, and incident response processes.

• Troubleshoot production issues across distributed AI systems and identify root causes.

• Collaborate with frontend, product, operations, and machine learning teams to deliver comprehensive end-to-end features.

• Continuously enhance system reliability, scalability, and performance.

• Provide dependable, low-latency, and highly available AI backend systems at scale.

• Ensure AI workflows are robust, observable, and ready for production across various products.

• Refine system performance through real-world feedback and optimization efforts.

• Quickly identify, diagnose, and resolve production incidents.

• Incorporate AI capabilities into both global customer and internal workflows.


⛳️ Requirements

• Extensive backend engineering experience in production environments.

• Required experience in Artificial Intelligence (AI).

• Proven track record in building or managing high-throughput, low-latency services.

• Familiarity with AI Systems, including LLMs, Embeddings, or AI Workflows.

• Experience with distributed systems and production-level debugging.

• Strong understanding of APIs, data flows, and principles of system design.

• Proficient with observability tools, including logging, monitoring, and tracing.

• Strong sense of ownership and a commitment to delivering results.

• Ability to work effectively in fast-paced, globally distributed teams.

• Willingness to complete a 60-minute coding assessment.

• Familiarity with technologies such as Anthropic, Claude, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, OpenAI, open-source models, Python, SQL, and observability tools.


🏝️ Benefits

• Medical insurance

• Dental insurance

• Vision insurance

• Savings Plan Options

• PTO

People also viewed

Equiplano23 hours ago

Mid-Level Artificial Intelligence Engineer

BR flagBrazil OnlyFull-timeAI Engineer
ApplyView job
G2i Inc.23 hours ago

Senior Software Engineer, AI Training

IE flagIreland OnlyFreelanceAI Engineer$100 – $200/hour
ApplyView job
Stefanini LATAM23 hours ago

Líder Técnico de IA

PE flagPeru OnlyFull-timeAI Engineer
ApplyView job
MeridianLink23 hours ago

Senior Software Engineer – AI

US flagUnited States OnlyFull-timeAI Engineer$104.1k – $177.6k/year
ApplyView job
Cashea23 hours ago

AI Engineer

Latin AmericaFull-timeAI Engineer
ApplyView job
Laminar Projects23 hours ago

AI Engineer

PT flagPortugal, +1 more countryFull-timeAI Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers