Skip to main content

Navigation

  • Client impact
  • Writing

AI Solutions

  • AI Systems
  • AI Development

Software teams

  • Design Systems
  • Product Design & Engineering
  • API Platforms
  • View all services for software teams
Get in touch
  • AI Systems

    Model-agnostic AI systems and agents that do real work

    AI Development

    Custom apps and tools built with AI-enabled engineering

  • Design Systems

    Depth of experience that few can match

    Product Design & Engineering

    Experts in cross-functional collaboration

    API Platforms

    Node.js, React, & GraphQL at scale


    View all services for software teams
  • Client impact
  • Writing
  • Contact

Writing · Jul 14th, 2026 · 3 min read

Max Khedri avatarMax Khedri avatar
Max Khedri

Where AI Actually Helps Quality Engineering

AI-assisted QA is not just about generating tests faster. By carrying product context through planning, development, review and release, AI can shorten feedback loops, surface risks earlier and help teams make better decisions, provided its output is supported by clear specifications, guardrails and human judgement.

Services discussed

  • Applied AI,
  • Product Design & Engineering

AI can produce convincing work quickly, but confidence in its output has to be earned. The value of AI-assisted QA goes beyond faster test generation: it helps teams build and carry context from planning through to release, using checks and guardrails to validate the work along the way. This article takes a high-level view of how AI can support quality throughout that process.

On a recent project, we used AI to explore a codebase that had evolved over several years to uncover undocumented variations in fields and business rules. Surfacing them early gave us concrete behaviour to review and turn into testable requirements before those gaps became costly to fix. That understanding then carried into testing, review and release.

Making behaviour testable

Findings and decisions can be captured in many forms. In my experience, BDD scenarios make specifications easier for both the team and AI to understand and use because they describe what the product should do without prescribing how it should be built.

That shared language allows product, design, engineering and QA to work from the same expectations. The scenarios also document product behaviour, giving AI clearer constraints and a reliable source of context when it starts work on a new ticket.

They can become end-to-end tests and guide unit, integration and manual testing. Paired with Test-Driven Development (TDD), they create a continuous feedback loop for checking AI-assisted implementation against the intended behaviour. This increases confidence in the output, while human judgement remains essential for filtering out low-value or irrelevant tests that can make the coverage appear stronger than it is.

Shortening feedback loops

As those specifications move into implementation, AI can also help check the work against approved designs, accessibility requirements and acceptance criteria. Many of these checks are traditionally deferred until review or QA, but an AI agent with access to the relevant artefacts can perform an earlier first pass.

It can flag potential accessibility issues, design drift, missed requirements, likely bugs and code that no longer matches the intended behaviour before a pull request is opened or a task is marked complete. These findings are leads, not decisions; reviewers still determine whether they are valid and what action to take.

This shifts human attention away from routine checks and towards decisions that require experience, product knowledge and context. Running that first pass earlier and more often shortens feedback loops and gives the next stage fewer avoidable issues to resolve.

Carrying context into release and beyond

Once specifications and BDD scenarios are in place, AI can reuse them to generate smoke tests, release checklists and release criteria. Instead of starting from a generic template, these checks can reflect the behaviour, risks and edge cases already identified during planning and development.

AI can also help prioritise critical workflows, so the most important paths are validated first and release decisions are based on agreed behaviour rather than memory or assumptions.

After release, the same specifications provide a clear baseline during an incident. AI can compare the expected behaviour with logs, recent changes and production behaviour to help identify where the system diverged and narrow the investigation before detailed debugging begins. Human review remains essential: teams still need to validate the generated release checks, assess the incident findings and decide what action to take.

AI as a force multiplier

AI works best as a force multiplier, not a replacement for human judgement. With the right context, checks and guardrails, it can surface problems earlier and give teams greater confidence in their work. Used well, it helps teams anticipate risks, make better decisions and deliver higher-quality software.

Services discussed

  • Applied AI,
  • Product Design & Engineering
Max Khedri avatarMax Khedri avatar
Max Khedri

Software engineer passionate about testing, scalability, and solving complex problems.

Related content

  • Your agent believes that docs folder

    article

    September 2026·8 min read
  • Are your AI agents making progress or producing work?

    article

    September 2026·5 min read
  • What AI use looks like in five enterprise design teams

    article

    September 2026·9 min read
  • From Vibes to Durable Context

    article

    August 2026·4 min read
  • Is Your Design System Ready for AI?

    article

    August 2026·6 min read
  • Build vs buy: AI code review for teams that have opinions

    article

    July 2026·6 min read

Have an idea to explore?

Get in touch

Footer

Thinkmill is a member of the Tech Council of Australia(opens in new tab).

AI Solutions

  • AI Systems
  • AI Development

Software teams

  • Design Systems
  • Product Design & Engineering
  • API Platforms
  • View all software teams

Client impact

  • ELMO
  • Tiimely
  • Atlassian
  • Reckon
  • AnywhereWorks
  • View all client impact

Open Source

  • Keystone (opens in new tab)
  • Keystatic (opens in new tab)
  • React Select (opens in new tab)
  • Classnames (opens in new tab)
  • Manypkg (opens in new tab)
  • Changesets (opens in new tab)