Repository navigation
Commit 68e4bbd
[Feat] Reorganize the evaluation pipeline (#7)
* fix white space
* try fixing CI errors
* types: mypy clean across repo
* style: apply ruff/ruff-format fixes
* ci: retrigger checks
* chore: sync README.md, pyproject.toml, uv.lock, .python-version with main; apply pre-commit fixes
* Update the pipeline to reflect the changes in HF datasets.
* ci: retrigger pre-commit
* [Major update] Easier new router evaluation pipeline;
Updates on README.md
* chore: fixed some typo
* remove type ignore
* restore local python version for pre-commit
---------
Co-authored-by: yl231 <yifan21lu@gmail.com>1 parent aa09708 commit 68e4bbd
42 files changed
Lines changed: 3290 additions & 185945 deletions
File tree
- cached_results
- images
- llm_evaluation
- llm_inference
- datasets
- model_cost
- router_evaluation
- router_inference
- config
- predictions
- scripts/process_datasets
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
9 | | - | |
10 | | - | |
11 | 8 | | |
12 | 9 | | |
13 | 10 | | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | 11 | | |
18 | 12 | | |
19 | 13 | | |
| |||
35 | 29 | | |
36 | 30 | | |
37 | 31 | | |
38 | | - | |
39 | | - | |
40 | | - | |
41 | 32 | | |
42 | 33 | | |
43 | 34 | | |
| |||
46 | 37 | | |
47 | 38 | | |
48 | 39 | | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
10 | 13 | | |
11 | 14 | | |
12 | 15 | | |
| |||
Large diffs are not rendered by default.
Large diffs are not rendered by default.
Large diffs are not rendered by default.
Large diffs are not rendered by default.
This file was deleted.
Large diffs are not rendered by default.
Loading
Loading
0 commit comments