Placeholder case study. Replace with the real engagement details.
Problem
Compliance officers and operations leads spent up to 90 minutes a day looking up internal policies. Policy artifacts lived across SharePoint, Confluence, and a stack of legacy PDF binders. Existing search returned hundreds of unranked results.
Approach
We ran a two-week diagnostic to map question patterns and pick a baseline eval set, then shipped iteratively:
- Document ingestion service with deterministic, paragraph-level chunking
- Hybrid retrieval (BM25 + dense vectors) tuned with the bank's eval set
- A citation-first answer UI with feedback collection
- A weekly eval gate so model and prompt updates couldn't regress quality
Outcome
- 73% reduction in average policy lookup time
- 98% citation precision on the locked eval set
- Adoption: 1,400 monthly active users across 4 business units

