Senior Chaos Engineer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Take ownership of the chaos engineering strategy for the Solace platform.

• Grasp customer use cases and translate them into expectations regarding system behavior during failures.

• Design, implement, and conduct chaos experiments alongside cloud-provider fault injection tests.

• Address faults and combinations across infrastructure, network, storage, and applications.

• Validate system behavior under failure conditions, extending beyond mere availability.

• Diagnose intricate, multi-system failures and determine their root causes.

• Leverage AI to enhance experiment design, automate analyses, and expedite root cause investigations.

• Collaborate with engineering teams and product across R&D to facilitate remediation and influence design decisions.

• Establish reliability metrics and communicate results in terms of customer impact.

• Transform findings into actionable recommendations and priorities.

• Mentor engineers to enhance the team's understanding of failure, risk, and quality.

⛳️ Requirements

• Over 7 years of experience in software engineering, system-level engineering, or chaos engineering.

• Extensive experience in testing or managing distributed systems in production environments.

• Strong systems thinking with the ability to reason about end-to-end failure combinations and cascades.

• A customer-first approach.

• Proven experience in designing and leading chaos engineering initiatives utilizing Chaos Mesh and/or cloud-provider fault injection services such as AWS Fault Injection Service, Azure Chaos Studio, or GCP fault injection testing.

• Profound understanding of distributed systems concepts and failure modes, particularly in event-driven architectures.

• Outstanding debugging and root cause analysis capabilities.

• Proficiency in AWS, Azure, or GCP, Kubernetes, and observability tools including metrics, logs, and traces.

• Capability to develop and enhance experiment tooling, workload generators, and verification harnesses.

• Passion for incorporating AI into work processes.

• Ability to influence teams without direct authority, communicate risks effectively, and mentor fellow engineers.

• Experience with messaging systems or event streaming technologies such as Solace, Kafka, MQTT, AMQP, or JMS is highly desirable.

🏝️ Benefits

• Hybrid-first: Flexibility is integrated into our working approach.

• Training programs aimed at helping you advance your skills.

• An inclusive and empowering workplace environment.

• A culture driven by our core values.

• Opportunities for social activities and a vibrant workplace culture.

• Accommodations provided during the hiring process.