QA Engineer, Integrations, AI Agents

This is a fully remote position, open to applicants in California, +1 more state.

📋 Description

• At Composio, we are developing infrastructure that enables agents to interact with the tools you rely on for work, such as Github, Gmail, Notion, Salesforce, and more.

• We successfully secured a $25M Series A funding round from Lightspeed, with contributions from prominent investors like Guillermo Rauch (CEO of Vercel), Dharmesh Shah (CTO of Hubspot), and Gokul Rajaram.

• This year, we have tripled our ARR, with customers including your peers from the YC batch, as well as companies like Wabi, Glean, Zoom, and many others.

• We are seeking a QA Engineer who will take charge of hands-on product quality across Composio's integrations, APIs, dashboards, and AI-agent workflows.

• You will be responsible for testing new features prior to their release, identifying edge cases that automated checks may overlook, enhancing regression coverage, and collaborating closely with engineers to resolve issues.

• This role is practical and execution-oriented, ideal for someone who enjoys dissecting complex systems, thoroughly documenting failures, and ensuring that customers receive a dependable product.

• This position is globally remote, but you will need to maintain a full schedule aligned with the Pacific Time team.

⛳️ Requirements

• Take ownership of feature validation: Create test plans and confirm new features from initial requirements through to production release.

• Test integrations and APIs: Ensure proper functionality of authentication, API behavior, permissions, webhooks, retries, pagination, rate limits, error handling, and third-party dependencies.

• Validate end-to-end workflows: Assess complete customer journeys across the dashboard, SDKs, APIs, connectors, and agent workflows.

• Conduct exploratory testing: Identify edge cases, unexpected interactions, and usability concerns not addressed by standard test cases.

• Maintain regression coverage: Develop and execute reliable regression suites for high-risk and frequently utilized product areas.

• Test AI-native experiences: Analyze tool-calling agents and other non-deterministic workflows where outputs may differ between executions.

• Enhance automation: Automate repetitive API, integration, and UI test cases where automation adds substantial confidence for releases.

• Investigate production issues: Replicate customer-reported problems using logs, network traces, API responses, and production signals.

• Drive defects to resolution: Create clear bug reports that include reproduction steps, evidence, impact, severity, and expected behavior. Verify fixes and prevent regressions.

• Improve release quality: Collaborate with engineers and product managers to identify risks, define acceptance criteria, and make informed release decisions.

🏝️ Benefits

• Strong hands-on experience in testing modern web applications, APIs, or developer products.

• Excellent skills in exploratory testing and debugging.

• Ability to convert product requirements into structured test plans and high-value test cases.

• Experience with functional, integration, API, end-to-end, and regression testing.

• Strong understanding of defect severity, prioritization, release risk, and quality signoff.

• Experience testing REST APIs using tools such as Postman, Bruno, Insomnia, or similar.

• Ability to understand authentication, permissions, retries, webhooks, pagination, rate limits, asynchronous workflows, and eventual consistency.

• Comfort with using browser developer tools, logs, API payloads, and network traces for failure investigation.

• Working knowledge of SQL and the ability to validate data during issue debugging.

• Capability to write or maintain automated tests using JavaScript, TypeScript, Python, or a comparable language.

• Familiarity with tools like Playwright, Cypress, pytest, or equivalent frameworks.

• Understanding of CI/CD pipelines, automated quality gates, flaky-test management, and regression coverage.

• A proactive approach to quality issues, ensuring they are driven to resolution.

• Ability to produce precise, reproducible bug reports and communicate risks effectively.

• Capability to work independently in a fast-paced and ambiguous startup environment.

• Effective collaboration with engineers, product managers, support teams, and other stakeholders.

• Consistent availability and responsiveness during Pacific Time working hours.

• Experience in testing developer tools, SDKs, workflow automation products, or integration platforms.

• Familiarity with OAuth, API keys, webhooks, and third-party application integrations.

• Understanding of AI agents, LLM evaluation, MCP, or tool-calling systems.

• Experience testing across various browsers, devices, and operating systems.

• Exposure to observability tools and production incident investigations.

• Experience in establishing QA practices or enhancing quality processes at an early-stage company.