
Director of AI Automation
Posted Sep 11

Posted Sep 11
This is a fully remote position, open to applicants in Texas.
• Define and drive the enterprise Test Automation and Quality Engineering strategy across various products, platforms, and delivery teams.
• Establish testing standards, governance frameworks, quality metrics, and best practices to ensure consistent software quality throughout the organization.
• Create key quality indicators (KQIs), KPIs, dashboards, and executive reporting to assess software quality, test effectiveness, release readiness, and operational risk.
• Align quality engineering roadmaps with product, technology, and business goals.
• Act as the executive escalation point for critical quality issues, facilitating root-cause analysis, risk mitigation, and corrective actions across programs.
• Lead and mentor QA managers, test leads, automation engineers, and quality engineering teams, promoting a culture of continuous improvement and innovation.
• Collaborate with executive leadership, product management, engineering, and business stakeholders to align quality objectives with organizational aims.
• Work alongside enterprise architects and engineering leaders to enhance testability, observability, and quality throughout the software development lifecycle.
• Oversee the design, implementation, and evolution of scalable test automation frameworks supporting web, API, middleware, data, cloud, and AI-enabled applications.
• Propel the integration of automated testing, quality gates, and AI evaluation capabilities within CI/CD and DevSecOps pipelines.
• Provide strategic oversight for functional, integration, performance, accessibility, security, and regression testing initiatives.
• Guide the adoption of cloud-native testing practices for AWS-based solutions and enterprise integrations.
• Develop quality strategies for AI-powered solutions, including automated evaluation frameworks, model validation, human-in-the-loop review processes, and AI risk mitigation.
• Champion continuous improvement initiatives through quality engineering innovation, process optimization, AI-assisted testing, and emerging automation technologies.
• Direct quality planning and resource allocation across multiple programs/projects, ensuring successful delivery in line with project timelines and organizational priorities.
• Ensure compliance with regulatory, accessibility, healthcare, and government quality requirements, including Section 508 standards and VA-specific expectations as applicable.
• Oversee audit readiness, quality controls, and remediation activities across programs.
• Bachelor's degree in Computer Science, Software Engineering, Information Systems, Engineering, or a related technical field.
• A Master’s degree in Computer Science, Engineering, Information Technology, Business Administration (MBA), or a related area is preferred.
• Professional certifications such as ISTQB Advanced/Test Manager, Certified Software Quality Engineer (CSQE), AWS certifications, SAFe Agilist, or PMP are preferred.
• Over 15 years of progressive experience in software quality assurance, quality engineering, test automation, and software delivery.
• More than 7 years of experience leading enterprise QA organizations, test automation programs, or quality engineering teams.
• Experience collaborating with executive leadership, product management, engineering, and business stakeholders to drive quality outcomes.
• Experience in establishing executive dashboards, KPIs, release readiness metrics, and risk-based quality reporting.
• Proven experience in defining and implementing enterprise-wide quality strategies, governance models, testing standards, and quality metrics.
• Demonstrated success in leading multiple QA managers, test leads, automation architects, and distributed quality engineering teams.
• Experience overseeing quality engineering practices across cloud-native, web, API, middleware, data, and AI-enabled platforms.
• Experience implementing automated testing and quality gates within CI/CD and DevSecOps environments.
• Experience managing quality initiatives in regulated industries such as healthcare, government, financial services, or other compliance-driven environments.
• Experience with large-scale digital transformation, cloud migration, and enterprise modernization programs.
• Expertise in enterprise test automation architecture and framework design for web, API, mobile, data, middleware, and cloud applications.
• Strong knowledge of Selenium, Playwright, TestNG, Postman, REST Assured, ReadyAPI/SoapUI, Groovy, and other modern automation technologies.
• Strong proficiency in Java and Python-based automation solutions.
• Deep understanding of GitHub / Jenkins CI/CD pipeline and modern DevSecOps test orchestration and quality engineering practices.
• Experience with AWS cloud services, including Lambda, CloudWatch, Step Functions, and cloud-native testing strategies.
• Knowledge of AI testing methodologies, model validation, automated evaluation frameworks, and AI quality metrics.
• Expertise in accessibility testing, Section 508 compliance, and tools such as JAWS and ANDI.
• Strong executive presence with the capability to communicate quality strategy and risk to senior leadership.
• Strong stakeholder management and cross-functional leadership skills.
• Experience in resource planning and organizational priorities.
• Strong strategic planning, risk management, and organizational change leadership capabilities.
• Ability to establish data-driven decision-making through quality KPIs, scorecards, and executive reporting.
• Ability to drive innovation through AI-assisted testing, automation, and continuous improvement initiatives.
• Proven ability to build, mentor, and scale high-performing quality engineering organizations.
• Experience working with the Department of Veterans Affairs (VA) or other health-related organizations is desired.
• U.S. Citizenship is mandatory.
• All selected candidates must successfully complete a background check.
• Ability to obtain and maintain a Government/Public Trust clearance, including required fingerprinting when needed for the position.
• Sponsorship is not available.
• Medical, Dental, and Vision insurance.
• 401(k) with Employer Match.
• PTO and Federal Holidays.
• Corporate-provided Laptop.
• Training and Professional Development Opportunities.
• Fully Remote Role.
The College Board
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.