AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop, test, and maintain AI workflows and agents on an enterprise AI workflow management platform that serves the Department of the Air Force.

• Collaborate with the AI Platform Architect to transform platform designs and government use cases into tested, production-ready solutions within Azure IL-5 cloud environments, integrated with ServiceNow.

• Construct solutions using established frameworks, patterns, and tools, including Microsoft AI Foundry and third-party agentic platforms.

• Convert customer mission requirements into functional prototypes and deployed workflows.

• Create RAG pipelines encompassing document ingestion, chunking, embedding, vector search, and retrieval tuning.

• Design prompt chains, tool calls, and agent logic for document generation, summarization, and task automation.

• Integrate AI workflows with Azure OpenAI, ServiceNow APIs, and internal data sources.

• Develop reusable components, templates, and connectors for both technical and non-technical users.

• Execute workflow orchestration and automate business processes.

• Create and implement unit, integration, and user acceptance testing plans.

• Generate evaluation datasets and automated evaluation harnesses for LLM outputs.

• Establish and monitor success metrics and evaluation criteria.

• Identify, document, and prioritize defects, hallucinations, and performance issues; lead root-cause analysis and remediation efforts.

• Conduct regression testing when there are changes in models, prompts, or platform components.

• Collaborate with the AI Platform Architect to implement designs, assess tools, and provide constructive feedback.

• Prototype solutions and proofs of concept for government use cases, presenting results to customers and stakeholders.

• Diagnose integration issues across Azure, ServiceNow, and government networks, collaborating with ServiceNow developers and Azure cloud engineers.

• Participate in design reviews, establish engineering standards, and contribute to technical documentation.

• Assist in the technical screening of AI/ML talent as needed.

• Support monitoring, logging, and alerting functionalities for AI workflows and agents.

• Oversee prompt and model versioning, and facilitate CI/CD deployments of AI services.

• Assess output quality, model drift, and data integrity in production workflows, reporting findings accordingly.

• Monitor model and compute usage costs, recommending optimizations where applicable.

• Operate within DISA STIGs, IL-5 requirements, and the security policies of the Department of the Air Force.

• Implement CUI handling and data classification controls within AI workflows.

• Provide engineering evidence and documentation to cybersecurity teams for ATO and continuous monitoring processes.

⛳️ Requirements

• US Citizenship is mandatory.

• Must be able to obtain and maintain a secret clearance.

• A minimum of 15 years of relevant experience is required.

• A Bachelor’s Degree in a relevant field may replace 5 years of relevant experience.

• Practical experience in developing LLM applications, including RAG, prompt engineering, and agentic workflows.

• Proficient in Python, with experience in LangChain, LlamaIndex, or similar AI frameworks.

• Familiarity with Azure cloud services, including Azure OpenAI, AI Foundry, DevOps, and API Management.

• Experience with Docker and REST API development and integration.

• Working knowledge of vector databases and embedding techniques.

• Background in test automation and quality assurance for software or AI systems.

• Experience with ServiceNow integration or scripting, including Flow Designer, REST APIs, or development.

• Ability to convert requirements into functional solutions and effectively communicate technical results to non-technical audiences.

• Familiarity with workflow orchestration tools and business process automation.

• Active Secret clearance is preferred.

• Top Secret eligibility is desirable.

• Experience in government cloud environments, such as Azure Government or AWS GovCloud.

• Experience with Kubernetes or Azure Kubernetes Service (AKS).

• Familiarity with DoD compliance frameworks, including IL-4/IL-5, FedRAMP, NIST 800-53, and STIGs.

• Experience with MLOps tools and practices, including MLflow, CI/CD for ML, and model monitoring.

• Proficient in PostgreSQL and data modeling for AI workloads.

• Experience with ATO processes and security accreditation.

• Familiarity with ServiceNow Flow Designer or hold a ServiceNow development certification.

• Sec+ certification is required.

🏝️ Benefits

• Flexible time-off policy.

• Comprehensive learning resources.

• Healthcare coverage.

• Wellness initiatives.

• Financial benefits.

• Retirement plans.

• Family support programs.

• Continuing education opportunities.

• Competitive salary.

• Opportunities for learning and development.