Senior QA Engineer, Agent Security

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of release testing and ensure quality for Runlayer Endpoint

• Establish and manage a lab for both physical and virtual devices

• Develop a scalable testing strategy that spans various platforms, configurations, clients, and product states

• Automate the processes of installation, enrollment, configuration, upgrades, rollbacks, and removals

• Conduct deployment tests using enterprise device management platforms

• Validate integrations with leading AI coding clients

• Create agent-driven tools that enhance coverage, collect evidence, and expedite failure analysis

• Incorporate automated quality signals into continuous integration and release workflows

• Replicate customer issues and convert confirmed incidents into permanent regression tests

• Collaborate with engineers to enhance product diagnostics, observability, and testability

• Establish standards for testability and coverage for new platforms, clients, and features

⛳️ Requirements

• Extensive experience in owning QA automation or test infrastructure at a senior level

• Proficient engineering skills in Python and system scripting languages such as Bash and PowerShell

• Practical experience in testing software across macOS, Windows, and Linux environments

• Familiarity with endpoint management, MDM, device labs, or similar fleet orchestration

• Experience in testing native installations, upgrades, background services, permissions, credentials, and OS configurations

• In-depth knowledge of integration, end-to-end, stateful, and combinatorial testing methods

• Ability to differentiate between product defects and infrastructure failures or flaky tests

• Proven track record in building reliable CI-driven systems equipped with useful diagnostics and test artifacts

• Strong technical judgment and exceptional bug reporting skills

• Bonus: Experience with Intune, Jamf Pro, Kandji, SimpleMDM, Mosyle, or Workspace ONE

• Bonus: Experience in testing endpoint-security or fleet-management products

• Bonus: Familiarity with MCP and AI coding clients

• Bonus: Experience in creating testing tools for AI agents

• Bonus: Experience with native packaging and signing on macOS, Windows, or Linux

• Bonus: Experience in fault injection, change-impact analysis, or combinatorial test generation

🏝️ Benefits

• Competitive salary and equity

• Paid vacation

• Paid sick leave

• Paid parental leave

• Budget allocated for conferences, courses, and certifications in AI, enterprise software, and customer success

• Choice of laptop and accessories

• Comprehensive health, dental, and vision coverage

• Opportunities for customer interaction with innovative companies