Staff Site Reliability Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and manage the infrastructure that supports Bluesky and the AT Protocol.

• Collaborate on bare-metal systems, cloud services, data infrastructure, observability, incident response, capacity planning, and reliability engineering for systems catering to millions of users.

• Take ownership of reliability, availability, and operational excellence for production systems, which includes observability, incident response, deployment, and rollback mechanisms.

• Enhance production readiness for services, migrations, and changes in infrastructure.

• Create software focused on performance, automation, observability, and related domains.

• Scale systems operating on high-density, state-of-the-art bare-metal servers in the company’s colocation facilities.

• Minimize toil through automation, tooling, and deliberate engineering practices.

• Collaborate with engineers across various teams to design services with robust operational characteristics.

• Lead incident reviews and translate contributing factors into engineering enhancements.

• Conduct capacity planning and cost management across computing, storage, database, and networking workloads.

• Manage vendor relationships to ensure high-quality services while maintaining a reasonable total cost of ownership.

• Mentor engineers on reliability, operability, debugging, and best practices in distributed systems.

• Help establish a culture of operational excellence throughout the organization.

⛳️ Requirements

• Over 10 years of experience in operating high-scale production systems, including bare metal.

• Solid understanding of Linux, networking, storage, databases, and distributed systems.

• Proven experience in building and managing high-scale systems where correctness, latency, throughput, and availability are vital.

• Proficiency in writing production-quality software in Go.

• Comfortable debugging across application code, operating systems, databases, networks, and hardware.

• Familiarity with observability systems, alert design, incident response, capacity planning, Kubernetes, and production automation.

• Enthusiasm for working in small, agile teams within a startup environment.

• Read the AT Protocol documentation, align with the mission, and have a desire to contribute.

• Availability to overlap working hours with PST is required.

• Willingness to travel to team meetups approximately every 3-4 months.

• On-site participation may be required for interviews.

🏝️ Benefits

• Equity will be factored into the total compensation package.

• Health, dental, and vision insurance provided.

• Fully remote team structure.

• Willingness to travel to team meetups once every 3-4 months.