Quality Engineer - AI

Job Description

About your role

We are looking for a quality advocate who is passionate about delivering delightful and reliable customer experiences powered by AI/LLM. In 2024, Rocket Lawyer launched the Rocket Lawyer Copilot, a conversational AI interface to our services. This is just the beginning. The company is embarking on the goal of combining legal services with AI in novel and innovative ways. Join this team to shape the direction of AI in LegalTech!

How you will make a difference day to day

• Participate in requirements analysis, identifying gaps.
• Participate in design review, lead test planning, and make suggestions to improve testability, performance, reliability, and usability.
• Design test scripts and testable user journeys that developers can use to test their own code.
• Create and contribute to tools that enable developers to test their own code.
• Review code to determine what features need better test coverage.
• Coordinate crowd-sourced exploratory testing and bug bashes.
• Establish production monitoring for product.
• Support quality assessment with documented test results and metrics.
• Facilitate successful releases by communicating with stakeholders and supporting functions when necessary.
• Investigate issues in production, participate in root cause analysis, and ensure that additional tests are added to prevent recurrences.

What you’ll need

• Bachelor's degree in software engineering, computer science, STEM, or related field.
• 2+ years of experience as a test engineer in an agile environment.
• 1+ years of programming experience as a software engineer, software automation engineer, technical quality engineer, or related field preferred.
• Experience in testing AI/ML-based products is a bonus. Otherwise, the candidate must have worked on side projects involving the training and evaluation of an AI application.
• Understanding of the functional aspects of web and RESTful applications, e.g., browser cookies, URLs, and HTTP methods.
• Working knowledge of basic SQL to fetch and verify data from the database.
• Hands-on experience with test tools, frameworks, and platforms such as Selenium, Cucumber, Rest Assured, Cypress/TestCafe/Playwright, Appium, Cross Browser Testing, SauceLabs, BrowserStack, JMeter, Blazemeter, Flood.io, etc.
• Hands-on experience with API testing tools such as Postman, Insomnia, and Swagger.
• Hands-on experience with CI tools (e.g., Jenkins, CircleCI, TravisCI), bug tracking tools (e.g. JIRA), git-based source control (e.g. GitHub, Gitlab, Bitbucket), IDEs (e.g. IntelliJ, Eclipse, VSCode), and test case management tools (e.g. QTP, TestRail).

Benefits & Perks