fischer
/
fischer-agentkit
1
0
Fork 0
Code Issues Pull Requests Actions 87 Packages Projects Releases Wiki Activity
fischer-agentkit/tests/e2e
History
chiguyong fa2a6dece2 feat(router): enable SemanticRouter + upgrade benchmark to L3/L5 
- Enable SemanticRouter in agentkit.yaml (router.semantic.enabled: true)
- Integrate SemanticRouter into e2e backtest (_build_real_components)
- Add 8 new semantic test cases: 5 colloquial + 3 mixed-lang expressions
- Add L3 output quality evaluation framework (LLM-as-Judge, 1-5 score)
- Add L5 adaptive capability metrics (consistency rate from overfitting data)
- Add OutputQualityObservation model and evaluate_output_quality() method
- Report now includes L3 and L5 sections

Results: 52 tests pass, description_match F1=66.67%, L5 adaptive rate=100%
 		2026-06-15 23:02:47 +08:00
..
__init__.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
benchmark_dataset.py feat(router): enable SemanticRouter + upgrade benchmark to L3/L5 2026-06-15 23:02:47 +08:00
benchmark_generator.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
capability_metrics.py feat(router): enable SemanticRouter + upgrade benchmark to L3/L5 2026-06-15 23:02:47 +08:00
conftest.py feat(router): enable SemanticRouter + upgrade benchmark to L3/L5 2026-06-15 23:02:47 +08:00
test_basic_api.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
test_basic_cli.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
test_basic_websocket.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
test_capability_alignment.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
test_capability_react.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
test_capability_router_direct.py feat(router): enable SemanticRouter + upgrade benchmark to L3/L5 2026-06-15 23:02:47 +08:00
test_capability_routing.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00
test_capability_team.py feat(router): optimize routing intelligence — ExecutionMode expansion, multi-candidate scoring, quality gate skill match 2026-06-15 22:43:13 +08:00