Skip to content
SQA Cockpit
← All runslive api
The contract
Snappy’s promise: crawl and structure the web into a reliable, high-quality corpus — complete, fresh, and on-target for what was asked.
The claim SQA tests: The jobs the metaintro-chat search engine returned, in the chat thread, are relevant to what the user asked for. (claim C0).
This run tested the system against its contract, clause by clause. A single run can only witness some clauses; the rest stay UNKNOWN — never a faked pass.
0 pass · 0 fail · 8 unknown
  • C0 MUST
    Headline promise
    could-not-evaluate — no relevancy score in this run
    UNKNOWN
  • C1 MUST
    User can sign in
    no 'login' step in this run
    UNKNOWN
  • C2 MUST
    User can open a new thread
    no 'open-thread' step in this run
    UNKNOWN
  • C3 SHOULD
    Onboarding gate completes
    no 'onboarding' step in this run
    UNKNOWN
  • C4 SHOULD
    Filters from onboarding don't bias the query
    no 'clear-filters' step in this run
    UNKNOWN
  • C5 MUST
    User-typed query is what the engine sees
    no 'submit-query' step in this run
    UNKNOWN
  • C10 SHOULD
    Score holds across reruns
    needs a sweep — a single run cannot witness this clause — needs a sweep
    UNKNOWN
  • C12 MAY
    Run completes within budget
    needs a sweep — a single run cannot witness this clause — needs a sweep
    UNKNOWN
TL;DR · 30-second primer
  • ·Snappy (SUT) ran 1 run on profile P1.
  • ·Result: Corpus Quality Index 79/100. Strong— see “Why this verdict” (each gap maps to a claim in the Contract).

1 ·THE VERDICT

the answer in one number
30-day CQI history
SNAPPY · JSI · RUN #1

Strong.

Run #1 of snappy on profile P1 for the query "senior react engineer remote". Corpus Quality Index 79/100.

2 ·WHY THIS VERDICT

ranked by severity
No gaps reported for this run.

3 ·THE STORY

what went in, what came out

Input

what the probe sent in
Query
Skills
React.js, JavaScript
ESCO S6.0.2
Industry
Software Publishers
NAICS 511210
Location
Remote · United States
ISO US · remote=true
Education
Bachelor or equivalent
ISCED ISCED 6

5 ·SESSION RECORDING

watch what the probe saw

Session recording

watch what the probe actually saw
No recording available for Metaintro.

6 ·RUN MECHANICS

provenance & reproducibility
Duration
53.26s
Steps
—
Judges
—
Commit
e2e-mock
Started
2026-05-28 12:50 UTC
Trace

Evidence by step

every artifact, link, excerpt, row, metric & recording — grouped by the step that produced it

No evidence recorded for this run.

Evidence integrity

each artifact is SHA-256 hashed at capture — proof it is unmodified

No integrity manifest recorded for this run.

7 ·SYSTEM ANATOMY

which component drove the verdict

This run carries no per-component probe data, so only system is shown. When a run exercises external components (Chat Engine, MongoDB, OpenRouter…), each appears here with its own health and the verdict driver is highlighted.

Press ⌘K to search