
Principal AI Platform Engineer
Posted Nov 10

Posted Nov 10
This is a fully remote position, open to applicants in United States.
• Develop a cohesive agentic platform engineering strategy that includes shared tool interfaces, reusable skills/workflows, coding standards, evaluation frameworks, telemetry, and adoption patterns.
• Create agents and tools that integrate with Terraform, Kubernetes, Argo CD/GitOps, cloud APIs, CI/CD, API gateways, Kafka, Redis, databases, observability, and change management systems.
• Enhance platform development through AI-assisted module/chart creation, code review, infrastructure plan interpretation, test generation, dependency analysis, and secure pull-request workflows.
• Design day-two agents for health and drift detection, incident triage, correlated diagnostics, root-cause analysis, capacity assessments, upgrade readiness, runbook support, and recovery verification.
• Construct agentic development workflows for Kafka, Redis, relational and document databases, as well as API gateways.
• Utilize Prometheus, Grafana, Loki, Thanos, Grafana Alloy, and OpenTelemetry as sources of operational signals.
• Establish controlled operational workflows ranging from read-only diagnostics to recommended actions, gated changes, and policy-approved execution.
• Implement scoped identity, least privilege access, environment isolation, secrets safeguarding, resistance to prompt/tool injection, validation, approvals, audit trails, timeouts, budgets, kill switches, and rollback boundaries.
• Assess agent accuracy, false positives, tool behavior, failure management, security compliance, and outcome quality prior to production deployment.
• Integrate compliance requirements for FedRAMP, PCI DSS, and SOC 2 environments.
• Collaborate with security, SRE/CloudOps, and platform teams to define agent permissions, ownership responsibilities, and escalation procedures.
• Mentor engineers through pair programming, playbooks, examples, and metrics.
• Drive adoption by embedding agentic development in platform delivery and refining patterns through measurement and feedback.
• Evaluate adoption and value based on cycle time, toil reduction, diagnostic lead time, quality, safe automation rates, and reliability.
• Minimum of 7 years of experience in software/platform engineering, DevOps, or SRE, with substantial expertise in production Kubernetes, Terraform, and GitOps.
• Proficient in Python or Go programming, API design, testing, integration, and debugging.
• Hands-on experience in building agentic workflows using LLM APIs, tool/function invocation, and orchestration.
• Familiarity with Azure/GCP/AWS, identity management, Kubernetes APIs, Argo CD, CI/CD processes, observability, and change management.
• Practical expertise in Kafka, Redis, relational and document databases, API gateways, and Kubernetes networking/security.
• Experience integrating with Prometheus/Grafana, Loki, Thanos, Alloy, or similar metrics, logging, and telemetry systems.
• Strong security awareness regarding privileged tools, least privilege principles, zero trust frameworks, and data access in regulated enterprise settings.
• Capability to mentor technical peers, standardize practices, and introduce new methodologies across teams.
• Adaptability to a fast-paced environment resembling a startup, with ambiguous requirements, rapid iterations, and quantifiable engineering outcomes.
• Preferred: Knowledge of MCP and agent-tool protocols, retrieval systems, event-driven architectures, policy engines, sandboxed execution, and human-in-the-loop workflows.
• Preferred: Familiarity with FedRAMP, PCI DSS, and SOC 2 technical evidence requirements.
• Preferred: Understanding of cloud networking and platform services including Istio, Keycloak, cert-manager, API gateways, and DNS.
• Preferred: Experience in building or managing agents for diagnosis, remediation, deployment safety, or infrastructure changes at scale.
• Bachelor's degree or equivalent experience in Computer Science or Engineering.
• Must be authorized to work in the United States without the need for visa sponsorship, now or in the future.
• Benefits offered; specific benefits are not listed.
Function Health
Alkami Technology
GitLab
RTX
Get handpicked remote jobs straight to your inbox weekly.