Staff Software Engineer – AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Construct and maintain shared infrastructure that enables Aledade applications and AI agents to securely and efficiently access foundation models.

• Enhance platform functionalities, including model gateways, cloud AI services, provider integrations, routing and fallback mechanisms, usage controls, observability, reliability, and governance of models.

• Account for the comprehensive lifecycle of production platform systems, covering architecture, scalability, failure modes, security, operational readiness, cost, and developer experience.

• Advance the platform in response to increasing AI adoption, developing reusable and self-service capabilities instead of isolated solutions.

• Identify and create scalable, high-performance solutions.

• Collaborate across various disciplines to influence product strategy and execution.

• Establish foundational code architecture and uphold quality standards.

• Provide mentorship and guidance to engineers.

• Define and maintain engineering process standards that promote high-quality engineering practices.

• Partner with engineers, product stakeholders, security teams, infrastructure teams, and AI application and agent teams.

⛳️ Requirements

• A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field is required.

• Over 8 years of hands-on experience as an engineer in building highly scalable production systems.

• At least 4 years of experience serving as a reliable technical decision-maker in a team environment, addressing both short-term and long-term business objectives.

• A minimum of 4 years of experience working with SQL or other database querying languages on large, multi-table datasets.

• Proven experience in architecting, developing, and deploying large-scale distributed systems.

• Proficiency in cloud technologies, such as AWS, Azure, or GCP.

• Experience in establishing continuous integration and continuous development (CI/CD) pipelines.

• Strong knowledge of server-side web technologies, including Java, Python, Scala, C#, C++, or Go.

• Background in building or managing production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services.

• Familiarity with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms like AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies.

• Substantial experience with cloud infrastructure, preferably AWS, along with technologies such as Kubernetes, containers, and infrastructure as code.

• Expertise in designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards, and failure management.

• Experience in designing APIs and self-service platform capabilities utilized by other engineering teams.

• Knowledge of identity, access control, secrets management, security, and governance for shared infrastructure.

• Experience in cost management, usage attribution, quotas, budgets, or capacity management for shared platforms.

• Background in operating systems that manage sensitive or regulated data.

• Ability to assess architectural tradeoffs concerning reliability, performance, security, cost, scalability, and developer experience.

• Capability to sit for extended periods.

• Frequent use of computers and keyboards.

• Occasional walking and lifting may be necessary.

🏝️ Benefits

• Comprehensive health and wellness benefits.

• Opportunities for professional development and growth.

• Flexible work arrangements.

• Engaging and inclusive company culture.