
Staff Software Engineer, Cloud Architecture – Engineering Velocity
Posted 11 hours ago

Posted 11 hours ago
This is a fully remote position, open to applicants in United States.
• Serve as the principal architect for Arc's AWS cloud infrastructure, automation, and AI-native runtime and delivery functionalities.
• Develop and enhance standardized processes, reference architectures, reusable components, signposts, and guardrails for production deployment.
• Lead architectural decisions focusing on platform scalability, performance, resilience, cost-effectiveness, AI workloads, and edge workloads.
• Oversee production monitoring across model-level and delivery-layer metrics, including latency, drift, failures, agentic traffic, crawler activity, and abuse detection.
• Create self-service capabilities for building, deploying, and scaling, including CI/CD workflows, infrastructure-as-code frameworks, service scaffolding, and observability patterns.
• Monitor key performance indicators such as lead time for changes, deployment frequency, change failure rate, and time to restore services.
• Establish infrastructure patterns and guardrails for AI and agentic workloads, covering inference, retrieval, vector storage, routing, fallback, and caching.
• Design multi-tenant safety protocols for tenant-specific retrieval, data isolation, prompt and response auditing, and abuse prevention.
• Develop capabilities for AI gateway, governance, observability, residency, retention, privacy, and FinOps.
• Track AI and agentic traffic across edge and content APIs.
• Create defenses against aggressive crawlers, scraping, prompt injection, data exfiltration, and automated abuse.
• Structure delivery architecture to effectively manage, tier, and potentially monetize AI access.
• Collaborate with CDN and edge service providers such as Akamai, Cloudflare, and CloudFront.
• Define Arc's strategy for AI-assisted development throughout the software development lifecycle.
• Implement CI/CD guardrails and quality checks for AI-generated code and build evaluation frameworks.
• Provide guidance on cross-organizational AI initiatives and advise leadership regarding build, buy, and partnership decisions.
• Act as a technical authority for external operations partners while collaborating with internal SRE and operations teams.
• Mentor senior engineers and architects, promoting best practices in quality, testability, and security.
• More than 8 years of experience in designing and building highly scalable, distributed systems, including roles as a technical leader or architect across various teams or domains.
• Extensive expertise in AWS technologies, including Lambda, ECS, Step Functions, CloudFormation, IAM, and DynamoDB.
• Strong experience with CI/CD and infrastructure-as-code tools such as Terraform and AWS CDK.
• Proficient in server-side programming languages, preferably Python and Node.js, with familiarity in Go or Java.
• In-depth knowledge of SAML, SSO, MFA, and OAuth; experience with Okta is a plus.
• Experience working with NGINX and AWS API Gateway.
• Solid understanding of API design, event-driven systems, microservices architecture, and database technologies.
• Practical experience integrating AI and large language model functionalities into production systems, such as retrieval-augmented generation, tool utilization, and agentic workflows.
• Knowledge of inference cost and latency characteristics.
• Familiarity with AI-assisted development tools, including GitHub Copilot, Cursor, and Claude Code.
• A Bachelor's degree in computer science, engineering, or a related technical field is preferred but not mandatory; equivalent practical experience will be considered equally.
• Preferred: background in architecting AI-native platforms or AI gateway and governance layers within multi-tenant SaaS environments.
• Preferred: experience with Amazon Bedrock, SageMaker, or similar managed AI services.
• Preferred: experience in designing internal developer platforms and enhancing DORA or analogous metrics at scale.
• Preferred: experience with external or outsourced operations teams in a governed architecture framework.
• Preferred: background in content platforms, publishing systems, or digital experience solutions.
• Preferred: familiarity with Akamai, Cloudflare, CloudFront, edge intelligence, personalization, bot management, AI crawler and scraping defenses, agentic traffic monitoring, edge monetization, FinOps, and observability related to models/inference/delivery layers.
• Competitive medical, dental, and vision insurance coverage.
• Company-funded pension plan and 401(k) matching.
• Three weeks of vacation and up to three weeks of paid sick leave.
• Nine paid holidays and two personal days.
• 20 weeks of paid parental leave for any new parent.
• Comprehensive mental health resources.
• Backup care and caregiver concierge services.
• Gender-affirming services.
• Pet insurance available.
• Complimentary Post digital subscription.
• Leadership and career development programs.
• Bonus or incentive programs may be accessible.
Guild Mortgage
Vultr
Hudson IT and Manpower
VALCE Talent Solutions
Get handpicked remote jobs straight to your inbox weekly.