Senior Chaos Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead the chaos engineering strategy for the Solace platform.

• Identify the critical failure modes based on customer deployments and dependencies.

• Gain insights into customer use cases and establish expected system behavior during failures.

• Design, implement, and conduct chaos experiments along with cloud-provider fault injection services.

• Evaluate infrastructure, network, storage, and application faults, including combinations of these failures.

• Ensure correct system behavior during failures, extending beyond mere availability.

• Diagnose complex multi-system failures and determine root causes.

• Leverage AI to enhance experiment design, automate analyses, and expedite root cause investigations.

• Collaborate with engineering squads and product teams across R&D to facilitate remediation and influence design decisions.

• Establish reliability metrics and report outcomes in relation to customer impact.

• Transform findings into actionable recommendations and priorities.

• Mentor engineers and enhance the team’s understanding of failure, risk, and quality.

⛳️ Requirements

• A minimum of 7 years of experience in software engineering, system-level engineering, or chaos engineering.

• Extensive experience in testing or operating distributed systems in a production environment.

• Strong systems thinking capability and the ability to analyze end-to-end failure combinations and cascades.

• A customer-first mindset.

• Proven experience in designing and leading chaos engineering initiatives.

• Familiarity with Chaos Mesh and/or AWS Fault Injection Service, Azure Chaos Studio, or GCP fault injection testing.

• In-depth knowledge of distributed systems concepts and failure modes, especially in event-driven architectures.

• Exceptional skills in debugging and root cause analysis.

• Expertise in AWS, Azure, or GCP, Kubernetes, and observability tools including metrics, logs, and traces.

• Capability to develop and refine experiment tooling, workload generators, and verification harnesses.

• A passion for AI-native work methodologies.

• Ability to influence across teams without direct authority, clearly communicate risks, and mentor engineers.

• Experience with messaging systems or event streaming technologies such as Solace, Kafka, MQTT, AMQP, or JMS is highly desirable.

🏝️ Benefits

• Hybrid-first: Flexibility is embedded in our work culture.

• Training programs tailored to facilitate your professional growth.

• An inclusive and empowering work environment.

• A culture driven by our core values.

• Opportunities for social activities and a vibrant workplace.

• Support for accommodations during the hiring process.

• Human-led interviews and final hiring decisions made after initial AI screening.