Back to all jobs
AI-translated

QA Analyst/Product Owner (AI-Powered SaaS)

Technology
Kanguru Digital AgencyMontréal, QC, CARemotePosted 2026-07-28
Temps plein

Description

About the Role

At Kanguru Digital, we help businesses grow through custom digital solutions—from high-performing websites to complex web applications, ERP systems, and AI-driven tools. With over 20 years of experience, we partner with clients to design and build scalable products that solve real business challenges and deliver measurable results.

We're building a new AI-powered SaaS platform and are looking for someone who owns quality while helping shape the product. This hybrid role combines QA and product ownership. Your primary focus is QA—establishing testing standards for a fast-moving AI product. Your second is product ownership: helping prioritize the backlog, refine acceptance criteria, and turn insights from testing and customers into better product decisions.

You'll know this product better than almost anyone and use that knowledge to protect quality and help steer what we build next. You'll work with developers, designers, and leadership while providing valuable insights to marketing and sales—what resonates, where users get stuck, and what deserves to be front and center.

This role is ideal for a QA professional who wants more than closing tickets: someone with strong product instincts, commercial curiosity, and a desire to help shape product direction.

What You'll Do

  • *Quality (your primary focus)*
  • Define and implement our QA strategy from the ground up
  • Design, develop, and execute test plans, cases, and scripts for new features and releases
  • Perform manual testing (functional, regression, integration, API)
  • Build and maintain test automation (e.g., Cypress, Playwright, Selenium)
  • Conduct API testing (Postman or similar REST clients) and backend validation
  • Identify, document, and track bugs (Jira, Linear, or similar)
  • Establish QA best practices and embed quality across the whole team
  • *Testing an AI product (what makes this role different)*
  • Define what "a bug" even means when outputs are AI-generated and non-deterministic — distinguishing real defects from acceptable variation
  • Build lightweight evaluation ("evals") approaches to measure AI answer quality, accuracy, and safety over time
  • Test conversational quality across text, voice, and phone channels — including latency, interruptions, and hand-offs to a human
  • Validate retrieval quality (RAG): is the assistant answering from the right knowledge, in the right language?
  • Test multi-language behavior — the product operates in many languages at once
  • *Product (secondary, and growing)*
  • Help own and prioritize the backlog; write and refine acceptance criteria alongside developers
  • Translate customer pain, test findings, and usage data into clear product recommendations
  • Participate in Agile ceremonies (sprint planning, standups, retrospectives)
  • Feed insight to marketing and sales — what works, what confuses users, what to highlight — as a contributor to go-to-market, partnering with the marketing team

What We're Looking For

  • 3+ years of QA experience in a SaaS or software company (required)
  • Strong understanding of the software development lifecycle (SDLC) and Agile methodologies
  • Hands-on experience with test automation tools/frameworks
  • Experience with API testing and backend validation
  • Familiarity with bug tracking tools (e.g., Jira, Linear)
  • Basic programming/scripting skills (JavaScript, Python, or similar)
  • Product instincts: you think about *why* a feature exists and *who* it's for, not just whether it works
  • A clear communicator who can talk to developers, leadership, and non-technical stakeholders alike
  • Comfortable with ambiguity and change — this is an evolving, early-stage AI product

Nice to Have

  • Experience testing AI/LLM products, chatbots, or voice applications
  • Familiarity with prompt evaluation, LLM evals, or measuring AI output quality
  • Product owner / product management exposure (backlog ownership, roadmap input)
  • Experience with CI/CD pipelines
  • Performance or load testing
  • Familiarity with cloud environments (AWS, GCP, Azure)
  • Knowledge of accessibility or security testing
  • Commercial or marketing awareness — you see how quality and product decisions connect to sales
  • Bilingual (English / French)

Why Join Us

You'll join a collaborative team where quality is everyone's responsibility—not just QA's. This is a rare role with real breadth: you'll own quality *and* influence product direction on an AI platform that's still taking shape. Your work will directly impact product reliability, customer experience, and company growth.

About the Role

At Kanguru Digital, we help businesses grow through custom digital solutions—from high-performing websites to complex web applications, ERP systems, and AI-driven tools. With over 20 years of experience, we partner with clients to design and build scalable products that solve real business challenges and deliver measurable results.

We're building a new AI-powered SaaS platform and are looking for someone who owns quality while helping shape the product. This hybrid role combines QA and product ownership. Your primary focus is QA—establishing testing standards for a fast-moving AI product. Your second is product ownership: helping prioritize the backlog, refine acceptance criteria, and turn insights from testing and customers into better product decisions.

You'll know this product better than almost anyone and use that knowledge to protect quality and help steer what we build next. You'll work with developers, designers, and leadership while providing valuable insights to marketing and sales—what resonates, where users get stuck, and what deserves to be front and center.

This role is ideal for a QA professional who wants more than closing tickets: someone with strong product instincts, commercial curiosity, and a desire to help shape product direction.

What You'll Do

  • *Quality (your primary focus)*
  • Define and implement our QA strategy from the ground up
  • Design, develop, and execute test plans, cases, and scripts for new features and releases
  • Perform manual testing (functional, regression, integration, API)
  • Build and maintain test automation (e.g., Cypress, Playwright, Selenium)
  • Conduct API testing (Postman or similar REST clients) and backend validation
  • Identify, document, and track bugs (Jira, Linear, or similar)
  • Establish QA best practices and embed quality across the whole team
  • *Testing an AI product (what makes this role different)*
  • Define what "a bug" even means when outputs are AI-generated and non-deterministic — distinguishing real defects from acceptable variation
  • Build lightweight evaluation ("evals") approaches to measure AI answer quality, accuracy, and safety over time
  • Test conversational quality across text, voice, and phone channels — including latency, interruptions, and hand-offs to a human
  • Validate retrieval quality (RAG): is the assistant answering from the right knowledge, in the right language?
  • Test multi-language behavior — the product operates in many languages at once
  • *Product (secondary, and growing)*
  • Help own and prioritize the backlog; write and refine acceptance criteria alongside developers
  • Translate customer pain, test findings, and usage data into clear product recommendations
  • Participate in Agile ceremonies (sprint planning, standups, retrospectives)
  • Feed insight to marketing and sales — what works, what confuses users, what to highlight — as a contributor to go-to-market, partnering with the marketing team

What We're Looking For

  • Minimum of 3 years of QA experience in a SaaS or software company (required)
  • Good understanding of the software development lifecycle (SDLC) and Agile methodologies
  • Hands-on experience with test automation tools/frameworks
  • Experience with API testing and backend validation
  • Familiarity with bug tracking tools (e.g., Jira, Linear)
  • Basic programming/scripting skills (JavaScript, Python, or similar)
  • Product instincts: you think about *why* a feature exists and *who* it's for, not just whether it works
  • A clear communicator who can talk to developers, leadership, and non-technical stakeholders alike
  • Comfortable with ambiguity and change — this is an evolving, early-stage AI product

Nice to Have

  • Experience testing AI/LLM products, chatbots, or voice applications
  • Familiarity with prompt evaluation, LLM evals, or measuring AI output quality
  • Product owner / product management exposure (backlog ownership, roadmap input)
  • Experience with CI/CD pipelines
  • Performance or load testing
  • Familiarity with cloud environments (AWS, GCP, Azure)
  • Knowledge of accessibility or security testing
  • Commercial or marketing awareness — you see how quality and product decisions connect to sales
  • Bilingual (English / French)

Why Join Us

You'll join a collaborative team where quality is everyone's responsibility—not just QA's. This is a rare role with real breadth: you'll own quality *and* influence product direction on an AI platform that's still taking shape. Your work will directly impact product reliability, customer experience, and company growth.

This posting was aggregated from indeed. Groupe Sentinella is not the employer; applying takes you to the original site. The full text belongs to the original poster.

Want us in your corner?

Join the Sentinella talent bench. We'll reach out when a mandate matches your profile — including roles like this one.

Join the talent bench