Senior Software Engineer II – AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and execute scalable and high-performance solutions.

• Collaborate as an equal with Engineering Managers, Product Managers, and stakeholders across Aledade to develop and implement technical roadmaps utilizing Agile methodologies.

• Guide and mentor junior engineers through comprehensive pull request reviews and maintain openness to constructive criticism.

• Construct and manage shared infrastructure that allows Aledade applications and AI agents to securely and reliably access foundational models.

• Design model gateways, integrate cloud AI services, implement provider integrations, establish routing and fallback mechanisms, usage controls, observability, reliability, and model governance.

• Enhance reusable, self-service platform capabilities as the adoption of AI increases throughout Aledade.

• Work in conjunction with engineers, product partners, security teams, infrastructure teams, and AI application and agent teams.

• Make practical technical choices and develop secure, maintainable, observable, and resilient systems.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related discipline (BS/BTech or higher).

• Over 6 years of experience as an engineer developing full-stack web applications within a cross-functional team.

• More than 3 years of experience using SQL or other database querying languages on extensive multi-table data sets.

• At least 3 years of experience serving as a trusted technical decision-maker in team environments, focusing on both short-term and long-term business value.

• Over 3 years of experience in mentoring fellow engineers.

• Proven experience in building or managing production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services.

• Familiarity with LLM infrastructure, model gateways, foundational model APIs, or managed AI platforms like AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies.

• Strong background in cloud infrastructure, ideally AWS, and technologies such as Kubernetes, containers, and infrastructure as code.

• Experience in designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards, and failure management.

• Experience in designing APIs and self-service platform features utilized by other engineering teams.

• Knowledge of identity, access control, secrets management, security, and governance for shared infrastructure.

• Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms.

• Familiarity with operating systems that manage sensitive or regulated data.

• Capability to assess architectural trade-offs concerning reliability, performance, security, cost, scalability, and developer experience.

• Ability to sit for extended periods.

• Frequent utilization of computers and keyboards.

• Occasional walking and lifting may be necessary.

🏝️ Benefits

• Competitive salary and performance incentives.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work opportunities.

• Professional development and continuous learning opportunities.

• Collaborative and innovative work environment.