
Senior Manager, IT Architecture – Generative AI & Services
Posted 16 hours ago

Posted 16 hours ago
This is a fully remote position, open to applicants in Florida.
• Lead the delivery and governance of enterprise generative AI capabilities.
• Take ownership of the enterprise AI platform stack, which includes LLM services, AI coding assistants, model gateways, and MCP integrations.
• Ensure secure deployment in compliance with ITAR, FedRAMP High, and CMMC standards.
• Convert enterprise AI strategy into actionable roadmaps encompassing priorities, milestones, resource allocation, and success metrics.
• Assess emerging models, tools, and agentic capabilities while prioritizing business use cases.
• Report on adoption, productivity, costs, and risks to executive stakeholders.
• Manage operations and lifecycle for LLM chat services, AI coding assistants, and associated infrastructure.
• Supervise model routing, access tiers, rate limits, logging, usage attribution, government-cloud deployments, data retention and residency, capacity, spending, throughput, licenses, availability, performance, patching, and incident response.
• Spearhead MCP server and enterprise integration development.
• Establish reusable architectures and security standards for AI integrations and agentic workflows.
• Review designs and code, prototype capabilities, and resolve complex technical issues.
• Maintain acceptable use policies, model and tool approvals, data classification rules, and risk assessments.
• Address ITAR/EAR, CUI, FedRAMP High, and contract requirements.
• Collaborate with Cybersecurity, Legal, Export Compliance, Privacy, and Contracts; assist with audits and authorization activities.
• Recruit, develop, and retain technical talent; set goals, conduct performance evaluations, and facilitate career growth.
• Manage workload, priorities, staffing plans, and contractors as needed.
• Act as the primary technical liaison with AI vendors and cloud service providers.
• Oversee roadmaps, escalations, and contract obligations.
• Communicate platform changes, training, and guidance.
• Contribute to budget planning and business cases for AI investments.
• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field, coupled with a minimum of 12 years of relevant experience.
• Graduate degree with at least 10 years of relevant experience.
• Alternatively, a minimum of 16 years of relevant experience in lieu of a degree.
• At least 2 years of experience in people leadership or as a technical team lead.
• Hands-on experience in deploying and operating enterprise generative AI / LLM capabilities.
• Familiarity with AWS or Azure, ideally within government cloud regions.
• Working knowledge of ITAR, CUI, FedRAMP, or CMMC security and compliance requirements.
• Proficiency in Python or TypeScript and API-based integration.
• Experience in maintaining project plans, timelines, and associated deliverables.
• Skill in creating presentations and materials to enhance understanding and adoption among a diverse user base.
• Experience in building MCP servers, agentic workflows, or retrieval-augmented generation solutions.
• Experience managing enterprise LLM gateways or proxies like LiteLLM.
• Familiarity with AWS Bedrock and/or Azure OpenAI, including capacity planning and cost management.
• Experience in writing AI governance policies and leading cross-functional review boards.
• Practical experience in deploying and operating Kubernetes environments.
• Health and disability insurance.
• 401(k) matching.
• Flexible spending accounts.
• Employee Assistance Program (EAP).
• Education assistance.
• Parental leave.
• Paid time off.
• Company-paid holidays.
• 9/80 work schedule, providing every other Friday off.
Helm Operations
Sunbelt Rentals, Inc.
Trucordia
Get handpicked remote jobs straight to your inbox weekly.