Senior QA Engineer (AI & Test Automation)

Job Description

About the Job 

AOA is seeking a collaborative and detail-oriented Senior QA Engineer to guide our QA processes and champion the integration of AI into our quality assurance practices. You’ll play a key role in delivering exceptionally high-quality and performant applications while working closely with stakeholders to understand and align on business requirements and product specifications.

In this role, you’ll guide the full QA lifecycle for AOA’s projects - partnering closely with our engineering, UX/UI, product, and project management teams. You’ll manage QA across multiple concurrent client projects, moving comfortably between eCommerce builds, SaaS platforms, and AI-native apps. Adaptability, clear prioritization, and a team-first approach will be essential to your success.

The ideal candidate is organized, detail-oriented, and a strong communicator. You’ll enjoy deeply understanding applications, spotting edge cases, and catching issues before they reach production, all while developing and maintaining automated tests that uphold our high standards of quality.

About Us 

AOA is a digital design and development agency that builds high-impact websites, AI-Native apps, and eCommerce experiences for forward-thinking brands. We partner with teams across eCommerce and SaaS to deliver work that’s thoughtful, performant, and built to scale.

Every team member has a direct, meaningful impact on our success and enjoys plenty of opportunities for growth and career development. We’re looking for people who love to create, take ownership, and care deeply about doing great work that drives results for our clients - while thriving in a supportive, collaborative environment.

Responsibilities

• Key Outcome: Help shape a QA organization recognized for its high standards of quality, efficiency, and predictability - by blending your deep human expertise with AI-augmented and agentic testing practices.
• Leverage generative AI, agentic testing, and self-healing automation to accelerate test creation, maintenance, and coverage.
• Research, pilot, and implement AI-powered QA tools and methodologies to improve quality and reduce manual effort.
• Collaborate with engineering and product teams to integrate AI-driven quality gates into delivery pipelines, positioning QA as a proactive strategic partner.
• Develop and implement test plans, test cases, and test scripts for both automated and manual testing.
• Design, build, and maintain automated test frameworks to streamline testing processes and improve efficiency.
• Execute manual tests to identify bugs, defects, and usability issues, ensuring comprehensive test coverage.
• Collaborate closely with development teams to understand project requirements and verify software functionality.
• Perform regression testing, load testing, and performance testing to assess product quality and performance.
• Analyze test results, troubleshoot issues, and communicate findings to relevant stakeholders.
• Participate in Agile development processes, including sprint planning, daily stand-ups, and retrospectives.
• Continuously evaluate and enhance QA processes, tools, and methodologies to optimize testing efforts.
• Manage QA workstreams across multiple simultaneous client projects, coordinating timelines and priorities with project managers.

Qualifications 

• Bachelor's degree in Computer Science, Engineering, or related field.
• Proven experience in QA engineering, with a focus on both automation and manual testing.
• Strong proficiency in one of the test automation tools/frameworks such as Cypress, Playwright, Selenium, Appium, Jest, or similar.
• Solid understanding of software development lifecycle (SDLC) and Agile methodologies.
• Excellent analytical and problem-solving skills, with meticulous attention to detail.
• Effective communication skills, with the ability to collaborate across teams and articulate technical concepts.
• Experience with version control systems (e.g., Git) and issue tracking tools (e.g., JIRA, Clickup).
• Experience with programming languages such as JavaScript, Typescript.
  

Preferred Qualifications 

• Experience in a client-focused environment, preferably within an agency.
• Experience supporting eCommerce and/or SaaS brands.
• Demonstrated enthusiasm and hands-on experience using AI tools in QA workflows
• Experience building client success processes/playbooks in a growing team.
• Familiarity with website/platform builds (Shopify Plus, headless builds, or complex CMS implementations).
  

If you’re passionate about quality and excited to be the AI evangelist who transforms how an agency delivers digital experiences, we’d love to hear from you!