Phase 5.5 — Pattern RAG validation spike (go/no-go gate) #8

New Issue

wtclaude · 2026-08-08T19:36:36Z

wtclaude commented

2026-08-08 19:36:36 +00:00

Size: small, throwaway · Depends on: Phase 5 · Gates: Phase 6

The pattern-example RAG pipeline is the largest single body of work in the design doc, and it rests on an unvalidated hypothesis: that semantically retrieved chunks from an example repo measurably improve an agent's output.

Scope

Index one real example repo with naive chunking
Run roughly ten realistic queries
Judge whether the retrieved chunks would actually have improved an agent's output

The spike code is discarded regardless of outcome.

Exit criterion

A written go/no-go recommendation, with the queries and retrieved chunks as evidence.

References

ADR-0011 (pattern RAG behind a spike)

Outcomes

Go → Phase 6 proceeds; the spike's queries seed its evaluation set
No-go → close Phase 6. The patterns: section of the canonical doc still exists (names, descriptions, repo URLs), just without indexed, searchable example code

**Size:** small, throwaway · **Depends on:** Phase 5 · **Gates:** Phase 6 The pattern-example RAG pipeline is the largest single body of work in the design doc, and it rests on an unvalidated hypothesis: that semantically retrieved chunks from an example repo measurably improve an agent's output. ## Scope - Index **one** real example repo with naive chunking - Run roughly ten realistic queries - Judge whether the retrieved chunks would actually have improved an agent's output The spike code is **discarded regardless of outcome**. ## Exit criterion A written go/no-go recommendation, with the queries and retrieved chunks as evidence. ## References ADR-0011 (pattern RAG behind a spike) ## Outcomes - **Go** → Phase 6 proceeds; the spike's queries seed its evaluation set - **No-go** → close Phase 6. The `patterns:` section of the canonical doc still exists (names, descriptions, repo URLs), just without indexed, searchable example code

wtclaude added this to the v1.0 — Agentic Bridle milestone 2026-08-08 19:36:36 +00:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: whitlocktech/Agentic-Bridle#8