AI Developer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, prototype, construct, test, and deploy AI applications and agents into production.

• Choose the appropriate Copilot Studio, workflow, agent, custom service, vendor, or non-AI approaches guided by Build-vs-Buy principles.

• Develop retrieval-augmented generation solutions, which encompass document ingestion, chunking, indexing, metadata, retrieval tuning, and grounded responses with source citations.

• Integrate with both internal and third-party systems via authenticated REST and GraphQL APIs.

• Collaborate on data pipelines for both documents and structured data.

• Implement least-privilege permissions, single sign-on, secrets management, PHI/PII protection, output validation, and logging and retention controls in conjunction with IT Security.

• Create evaluation harnesses using golden test sets, subject-matter expert rubrics, and production sampling.

• Monitor accuracy, citation support, completeness, latency, and transaction costs, including results by plan type.

• Implement telemetry for prompts, retrievals, tool calls, and outputs.

• Maintain runbooks, hand-off documentation, cost controls, and operational monitoring.

• Propel solutions through the CBG AI Solution Delivery Playbook decision gates and necessary artifacts.

• Collaborate with the AI Risk Manager, Compliance, Data Protection Officer, Security, and AI Ethics Committee.

• Share reusable components, templates, and approved prompt patterns.

• Complete AI governance onboarding, deliver an enhancement through the Production Readiness Review, and set up a golden-test-set evaluation harness within the first 90 days.

• Launch a new approved AI solution, publish reusable components adopted by another project, and enable monitoring dashboards within the first 6 months.

• Meet established business KPIs, showcase reusable delivery patterns, and maintain an updated inventory, risk classification, evaluation, and monitoring records within the first 12 months.

⛳️ Requirements

• Bachelor's degree in Computer Science, Information Systems, a related field, or equivalent practical experience.

• Over 3 years of professional software development experience.

• Hands-on experience in generative AI development and evaluation, including RAG, context engineering, tool/function calling, and at least one production or production-pilot solution.

• Proficient in Python and/or C#/.NET development.

• Experience with production APIs, REST integration, OAuth or similar authorization, and secure secrets/configuration management.

• Capability to review, test, debug, and maintain AI-generated code.

• Working knowledge of SQL, data modeling, and data pipelines.

• Experience managing HIPAA-regulated information, PHI masking, and access controls.

• Familiarity with AI regression testing, monitoring, model version management, release controls, cost optimization, and guarded multi-step agents.

• Ability to document technical decisions, adhere to governance and change control, conduct business requirements sessions, and recommend delaying or halting solutions that do not meet evaluation standards.

• Preferred: Experience with Microsoft Copilot Studio, Power Automate, Power Platform, Azure OpenAI, and Azure AI Search.

• Preferred: Proven enhancement of retrieval or extraction systems using before-and-after evaluation metrics.

• Preferred: Experience with AI coding agents and Model Context Protocol (MCP).

• Preferred: Familiarity with healthcare, third-party administration, employee benefits, claims, eligibility, plan documents, or EDI.

• Collaborative communicator skilled in translating business processes into technical requirements and partnering with business, engineering, security, and compliance teams.

• Analytical, detail-oriented problem solver who prioritizes measurable quality, documentation, and continuous improvement.

• Demonstrates sound judgment and accountability in privacy, fairness, human oversight, and responsible AI delivery.

• Adaptable, hands-on builder comfortable with choosing between low-code and custom engineering solutions.

• Cobalt Benefits Group engages in E-Verify to confirm employment eligibility for all new hires.

🏝️ Benefits

• Exceptional medical, dental, and vision insurance.

• Biannual employer HSA contributions, covering 50% of the HDHP plan’s annual deductible.

• Company-provided Basic Life and AD&D insurance.

• Company-funded Short-Term and Long-Term Disability coverage.

• Flexible Spending Accounts.

• 401(k) Retirement Plan with up to a 6% employer match.

• More than 10 paid holidays.

• Fully paid half-day Summer Fridays.

• Generous paid vacation and sick leave.

• Annual Paid Volunteer Day.

• Annual Tuition Reimbursement.

• Annual Health and Wellness Reimbursement.

• Numerous enjoyable company events.