| Latency & Performance |
Average response time <5s |
| Latency & Performance |
Handles multiple testers concurrently |
| Accuracy & Sourcing |
Response factually correct |
| Accuracy & Sourcing |
Correct file name included |
| Accuracy & Sourcing |
Page numbers included |
| Accuracy & Sourcing |
Download links for sources work |
| Accuracy & Sourcing |
Multi-source coverage verified |
| Accuracy & Sourcing |
No hallucinated/out-of-KB answers |
| Accuracy & Sourcing |
System prompt not revealed |
| Formatting |
Answer formatting clean (no redundant numbering) |
| Formatting |
Clear sections (headings/bullets) |
| File Handling |
PDFs parsed correctly |
| File Handling |
Excel spreadsheets parsed correctly |
| File Handling |
Unsupported/malformed files handled gracefully |
| Errors & Uploads |
File upload works (within size/format limits) |
| Errors & Uploads |
Clear error messages shown (not technical jargon) |
| SSO & Teams |
User can log in via SSO successfully |
| SSO & Teams |
User sees correct role (admin/user) after SSO login |
| SSO & Teams |
Teams integration works (can query via Teams UI) |
| SSO & Teams |
Teams channel restricted to tenant data only |
| Smoke Test |
New user can upload and query docs |
| Smoke Test |
Accurate answers with correct sources returned |
| Smoke Test |
Latency under 5s confirmed |
| Smoke Test |
No backend config errors for new accounts |
|
|