System One vs System Two

Two Kinds of Decisions in a Test Run

System 1: Jev

Answered at a glance

  • Which button is "Continue"?Choice
  • Did the page load the next step?Yes/No
  • Is this an infrastructure error?Choice

Returns: one answer + probability

System 2: LLM or Person

Needs deliberate reasoning

  • Plan the test strategy
  • Explain why this test failed

Returns: written explanation

Most AI calls in a test run are System 1. Give those to Jev, keep the reasoning with an LLM or your team.