fischer-agentkit

Commit Graph

Author	SHA1	Message	Date
chiguyong	3a05c4d1e6	fix(review): CJK pre-truncate budget + simplify estimate_tokens + test gaps Test / backend-test (pull_request) Has been cancelled Details Test / frontend-unit (pull_request) Has been cancelled Details Test / api-e2e (pull_request) Has been cancelled Details Test / frontend-e2e (pull_request) Has been cancelled Details Apply 4 ce-code-review findings: - P1: _summarize() max_chars = max_input_tokens (was * 4, allowed 4x CJK budget) - P1: add test_summarize_cjk_pre_truncation (CJK truncation coverage) - P2: add test_should_compress_cjk_fallback_path (react.py fallback coverage) - P3: strengthen truncate test assertion (verify marker, not just length) Also apply ce-simplify-code: estimate_tokens() -> sum() generator one-liner. Tests: 99 passed. Ruff: clean.	2026-07-03 08:03:06 +08:00
chiguyong	be45fe42c5	feat(compressor): CJK-aware token estimation + linear compress flow U1: Add estimate_text_tokens() module-level function with CJK 1:1 / ASCII 4:1 heuristic. Update estimate_tokens(), _summarize() pre-truncation, and react.py _should_compress() fallback to use it. Fixes 4x token underestimation for Chinese/Japanese/Korean conversations. U3: Rewrite compress() from recursive _compression_depth to linear flow (summarize -> aggressive -> truncate). Add _log_compression() structured logging with tokens_before/after/ratio/strategy. Remove _compression_depth parameter from compress() and _compress_aggressive(). Per plan: docs/plans/2026-07-02-003-feat-context-compressor-cjk-prefix-enhancement-plan.md	2026-07-03 07:32:57 +08:00
chiguyong	f858d279f3	feat(agentkit): Phase 3 upgrade - persistence, memory, evolution, observability 10 Implementation Units across 3 phases: Phase A - Infrastructure: - U1: RedisTaskStore with Redis/memory backend + factory function - U2: TraceRecorder for execution trace recording - U3: PersistentEvolutionStore with SQLite backend Phase B - Core Capabilities: - U4: MemoryRetriever integration into ReAct engine - U5: Embedder abstraction + EpisodicMemory vector search - U6: LLMReflector for LLM-in-the-loop reflection - U7: SkillPipeline for multi-skill orchestration Phase C - Enhancement: - U8: SKILL.md format + progressive disclosure levels - U9: ContextCompressor + prompt cache rendering - U10: Structured logging + metrics endpoint + enhanced health check Tests: 924 passed, 18 skipped, 0 failed	2026-06-06 17:17:45 +08:00

Author

SHA1

Message

Date

chiguyong

3a05c4d1e6

fix(review): CJK pre-truncate budget + simplify estimate_tokens + test gaps

Test / backend-test (pull_request) Has been cancelled Details

Test / frontend-unit (pull_request) Has been cancelled Details

Test / api-e2e (pull_request) Has been cancelled Details

Test / frontend-e2e (pull_request) Has been cancelled Details

Apply 4 ce-code-review findings:
- P1: _summarize() max_chars = max_input_tokens (was * 4, allowed 4x CJK budget)
- P1: add test_summarize_cjk_pre_truncation (CJK truncation coverage)
- P2: add test_should_compress_cjk_fallback_path (react.py fallback coverage)
- P3: strengthen truncate test assertion (verify marker, not just length)

Also apply ce-simplify-code: estimate_tokens() -> sum() generator one-liner.

Tests: 99 passed. Ruff: clean.

2026-07-03 08:03:06 +08:00

chiguyong

be45fe42c5

feat(compressor): CJK-aware token estimation + linear compress flow

U1: Add estimate_text_tokens() module-level function with CJK 1:1 / ASCII
4:1 heuristic. Update estimate_tokens(), _summarize() pre-truncation, and
react.py _should_compress() fallback to use it. Fixes 4x token
underestimation for Chinese/Japanese/Korean conversations.

U3: Rewrite compress() from recursive _compression_depth to linear flow
(summarize -> aggressive -> truncate). Add _log_compression() structured
logging with tokens_before/after/ratio/strategy. Remove _compression_depth
parameter from compress() and _compress_aggressive().

Per plan: docs/plans/2026-07-02-003-feat-context-compressor-cjk-prefix-enhancement-plan.md

2026-07-03 07:32:57 +08:00

chiguyong

f858d279f3

feat(agentkit): Phase 3 upgrade - persistence, memory, evolution, observability

10 Implementation Units across 3 phases:

Phase A - Infrastructure:
- U1: RedisTaskStore with Redis/memory backend + factory function
- U2: TraceRecorder for execution trace recording
- U3: PersistentEvolutionStore with SQLite backend

Phase B - Core Capabilities:
- U4: MemoryRetriever integration into ReAct engine
- U5: Embedder abstraction + EpisodicMemory vector search
- U6: LLMReflector for LLM-in-the-loop reflection
- U7: SkillPipeline for multi-skill orchestration

Phase C - Enhancement:
- U8: SKILL.md format + progressive disclosure levels
- U9: ContextCompressor + prompt cache rendering
- U10: Structured logging + metrics endpoint + enhanced health check

Tests: 924 passed, 18 skipped, 0 failed

2026-06-06 17:17:45 +08:00

3 Commits