Repository navigation
Degrade retrieval to test CI gate - #7
NaveenBuidl wants to merge 1 commit into
Conversation
There was a problem hiding this comment.
Pull request overview
This PR intentionally degrades retrieval quality by lowering the configured number of retrieved chunks to validate that the eval CI gate blocks regressions.
Changes:
- Commented out the prior
retrieval_k: 4value. - Set
retrieval_k: 1inconfig.yamlto force lower retrieval quality and trigger the CI eval gate.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| # retrieval_k: 4 | ||
| retrieval_k: 1 |
There was a problem hiding this comment.
This PR changes the committed default retrieval_k to a degraded value. Since the CI workflow already supports overriding retrieval_k via workflow_dispatch (see .github/workflows/eval-gate.yml), consider keeping config.yaml at the normal default and exercising the gate by running the workflow with an override or by introducing a separate CI-only config. This avoids accidentally merging a low-quality default into mainline usage.
Intentional degradation PR to verify the eval CI gate blocks lower retrieval quality.
Change:
Expected: