AI Developer

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Design, prototype, develop, test, and launch AI applications and agents into production.

• Determine the suitable Copilot Studio, workflow, agent, custom-service, vendor, or non-AI methods following Build-vs-Buy guidelines.

• Create retrieval-augmented generation (RAG) solutions, which encompass document ingestion, chunking, indexing, metadata, retrieval tuning, and providing grounded responses with source citations.

• Integrate with both internal and external systems via authenticated REST and GraphQL APIs.

• Collaborate on data pipelines for both documents and structured data.

• Implement least-privilege permissions, single sign-on, secrets management, PHI/PII protections, output validation, and appropriate logging and retention measures in conjunction with IT Security.

• Develop evaluation harnesses that include golden test sets, subject-matter expert rubrics, and production sampling.

• Monitor accuracy, citation support, completeness, latency, and transaction costs, including results categorized by plan type.

• Set up telemetry for prompts, retrieval, tool calls, and outputs.

• Maintain runbooks, hand-off documentation, cost controls, and operational monitoring.

• Progress solutions through the CBG AI Solution Delivery Playbook decision gates and required artifacts.

• Collaborate with the AI Risk Manager, Compliance, Data Protection Officer, Security, and AI Ethics Committee as necessary.

• Share reusable components, templates, and sanctioned prompt patterns.

• Complete AI governance onboarding, deliver an enhancement via the Production Readiness Review, and establish a golden-test-set evaluation harness within the first 90 days.

• Launch a new approved AI solution, publish reusable components used by another project, and activate monitoring dashboards within the first 6 months.

• Achieve approved business KPIs, showcase reusable delivery patterns, and maintain up-to-date inventory, risk classification, evaluation, and monitoring records within the first 12 months.

⛳️ Requirements

• Bachelor's degree in Computer Science, Information Systems, a related field, or equivalent practical experience.

• 3+ years of professional experience in software development.

• Direct experience with generative AI development and evaluation, including RAG, context engineering, tool/function calling, and at least one production or production-pilot solution.

• Proficient in Python and/or C#/.NET development.

• Familiarity with production APIs, REST integration, OAuth or similar authorization, and secure secrets/configuration management.

• Capability to review, test, debug, and maintain AI-generated code.

• Working understanding of SQL, data modeling, and data pipelines.

• Experience managing HIPAA-regulated information, including PHI masking and access controls.

• Knowledge of AI regression testing, monitoring, model version management, release controls, cost optimization, and guarded multi-step agents.

• Proficient in documenting technical decisions, adhering to governance and change control, conducting business requirements sessions, and recommending the postponement or cessation of solutions that do not meet evaluation thresholds.

• Preferred: Experience with Microsoft Copilot Studio, Power Automate, Power Platform, Azure OpenAI, and Azure AI Search.

• Preferred: Demonstrable improvement in retrieval or extraction systems using before-and-after evaluation results.

• Preferred: Familiarity with AI coding agents and Model Context Protocol (MCP).

• Preferred: Knowledge of healthcare, third-party administration, employee benefits, claims, eligibility, plan documents, or EDI.

• A collaborative communicator capable of transforming business processes into technical specifications and partnering with business, engineering, security, and compliance teams.

• An analytical, detail-oriented problem solver who prioritizes measurable quality, documentation, and continuous improvement.

• Sound judgment and accountability in areas concerning privacy, fairness, human oversight, and responsible AI delivery.

• Adaptable, hands-on builder comfortable with choosing between low-code and custom engineering methods.

• Cobalt Benefits Group participates in E-Verify to confirm the employment eligibility of all new hires.

🏝️ Benefits

• Excellent medical, dental, and vision insurance.

• Biannual employer HSA contributions, covering 50% of the HDHP plan’s annual deductible.

• Company-provided Basic Life and AD&D insurance.

• Company-paid Short-Term and Long-Term Disability coverage.

• Flexible Spending Accounts.

• 401(k) Retirement Plan with up to a 6% employer match.

• Over 10 paid holidays.

• Fully paid half-day Summer Fridays.

• Generous paid vacation and sick leave.

• Annual Paid Volunteer Day.

• Annual Tuition Reimbursement.

• Annual Health and Wellness Reimbursement.

• Numerous enjoyable company events.