Principal Harness Engineer

Posted 23 hours ago

This is a fully remote position, open to applicants in Bulgaria.

πŸ“‹ Description

β€’ Design, develop, deploy, and maintain core harness elements, which include guides, feedback loops, guardrails, and shared context.

β€’ Take ownership and enhance feedforward guides, agent instruction files, reusable skills, architectural guidelines, reference documentation, and codemods.

β€’ Drive standardization across the team to ensure agents generate accurate output on the initial attempt.

β€’ Create feedback mechanisms such as custom linters, static analysis tools, architecture fitness tests, verification loops, and LLM-as-judge reviewers.

β€’ Manage quality gating and establish release criteria for work produced by agents.

β€’ Define authority boundaries for unaided agent merges and set escalation protocols for human review.

β€’ Develop LLM testing infrastructure and evaluation methodologies for AI-generated outputs.

β€’ Implement consumer/contract testing in scenarios where service integration reliability is crucial.

β€’ Operate the steering loop and uphold repository knowledge as the definitive source of information.

β€’ Determine the placement of controls in the production pathway.

β€’ Enhance visibility into agent tasks and monitor engineering and agent-PR metrics.

β€’ Collaborate with product and platform teams to translate specifications and acceptance criteria into enforceable controls.

β€’ Act as a technical expert and mentor to engineers across teams in harness practices and responsible AI tool usage.


⛳️ Requirements

β€’ Bachelor's or Master's degree in Computer Science or a related field, or equivalent commercial experience in software architecture, design, development, and testing.

β€’ Experienced software engineer with a background in large, intricate codebases and a solid foundation in architecture and design.

β€’ Practical experience with AI coding agents (e.g., Claude Code, Codex, or similar technologies).

β€’ Experience in developing engineering tools across a modern stack, which includes linters and static analysis, CI/CD pipelines, containerized build/test environments, and instrumentation/observability.

β€’ Familiarity with agent instruction conventions such as AGENTS.md.

β€’ Knowledge of spec-driven development, context engineering, agent orchestration, fitness functions, and developer-platform integration.

β€’ Capability to encode quality standards into systematic, repeatable rules.

β€’ Sound judgment regarding deterministic computational controls compared to inferential LLM-based controls, considering trade-offs in cost, speed, and reliability.

β€’ Experience in managing quality-gating processes and defining release criteria.

β€’ Working knowledge of autonomous-agent security, including prompt injection, tool/permission scoping, sandboxed execution, audit trails, and least-privilege guardrails.

β€’ Familiarity with consumer/contract testing methodologies such as Pact.

β€’ Strong communication skills with the ability to articulate design concepts to architects and promote standards across teams.


🏝️ Benefits

β€’ Highly competitive compensation, benefits, and rewards programs.

β€’ Emphasis on work/life balance.

β€’ Employee resource groups.

β€’ Social events.

β€’ Opportunities for learning experiences and professional development.

β€’ An inclusive, people-first work environment.

People also viewed

Knorr-Bremse AG9 hours ago

Engineer 2-3, Resident

US flagWashington OnlyFull-timeEngineer$75.9k – $113.9k/year
ApplyView job
Rising Edge Group9 hours ago

Project Engineer

US flagColorado, +1 more stateFull-timeEngineer
ApplyView job
RetailNext10 hours ago

ML Vision Engineer

TW flagTaiwan OnlyFull-timeEngineer
ApplyView job
SHI International Corp.10 hours ago

Managed Services Engineer

US flagUnited States OnlyFull-timeEngineer$70k – $110k/year
ApplyView job
BizFirst LLC12 hours ago

Endpoint Management Engineer – MECM, BigFix

US flagUnited States OnlyFreelanceEngineer
ApplyView job
Greif12 hours ago

Mechanical Project Engineer II

US flagUnited States OnlyFull-timeEngineer$103.9k – $176.8k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers