fischer-agentkit

Commit Graph

Author	SHA1	Message	Date
chiguyong	793476cafa	feat(llm): U17 — LiteLLM 语义缓存替换 + per-user/ACL scope 安全隔离 - 新增 LitellmCacheManager：配置 litellm.cache 全局，三级后端 fallback (RedisSemanticCache -> RedisCache -> InMemoryCache)，redisvl lazy import - cache_key 扩展 user_id + kb_acl_hash 参数（安全要求 a/b/e） - gateway 集成：读取 KB caching_disabled flag（安全要求 c），构建带 scope 的 cache_key，命中时 cost=0 - LLMResponse 新增 cache_hit 字段；LLMRequest 新增 cache 参数 - litellm_provider 透传 cache 参数 + 检测 _hidden_params 缓存命中 - 33 个新测试覆盖 13 场景（含 User A != User B 缓存隔离） - 旧 InMemoryLLMCache/RedisLLMCache 保留向后兼容	2026-06-25 22:49:59 +08:00
chiguyong	0ccef7be5c	feat: P0 production hardening — LLM cache, semantic routing, state persistence U1: LLM Cache Core (exact + semantic match, InMemory + Redis backends) U2: Cache integration into LLMGateway with CacheConfig U3: Semantic Router as Layer 1.5 in CostAwareRouter U4: UsageStore persistence (Redis Hash + InMemory fallback) U5: CascadeStateStore persistence (Redis INCR + InMemory TTL) U6: EvolutionStore interface unification (Protocol + PostgreSQL backend) U7: Configuration integration + E2E tests Code review fixes: - P0: date iteration bug (day>=28), semantic router index never built, Redis connection leak (per-call → persistent pool) - P1: cache degradation recovery, semantic_search degradation, double miss counting, asyncio.Lock for PG init, LIMIT on queries, __import__ anti-pattern → _utcnow() - P2: InMemory TTL cleanup, embedding preservation on put(), data TTL = max(exact_ttl, semantic_ttl)	2026-06-14 15:16:00 +08:00

Author

SHA1

Message

Date

chiguyong

793476cafa

feat(llm): U17 — LiteLLM 语义缓存替换 + per-user/ACL scope 安全隔离

- 新增 LitellmCacheManager：配置 litellm.cache 全局，三级后端 fallback
  (RedisSemanticCache -> RedisCache -> InMemoryCache)，redisvl lazy import
- cache_key 扩展 user_id + kb_acl_hash 参数（安全要求 a/b/e）
- gateway 集成：读取 KB caching_disabled flag（安全要求 c），构建带 scope
  的 cache_key，命中时 cost=0
- LLMResponse 新增 cache_hit 字段；LLMRequest 新增 cache 参数
- litellm_provider 透传 cache 参数 + 检测 _hidden_params 缓存命中
- 33 个新测试覆盖 13 场景（含 User A != User B 缓存隔离）
- 旧 InMemoryLLMCache/RedisLLMCache 保留向后兼容

2026-06-25 22:49:59 +08:00

chiguyong

0ccef7be5c

feat: P0 production hardening — LLM cache, semantic routing, state persistence

U1: LLM Cache Core (exact + semantic match, InMemory + Redis backends)
U2: Cache integration into LLMGateway with CacheConfig
U3: Semantic Router as Layer 1.5 in CostAwareRouter
U4: UsageStore persistence (Redis Hash + InMemory fallback)
U5: CascadeStateStore persistence (Redis INCR + InMemory TTL)
U6: EvolutionStore interface unification (Protocol + PostgreSQL backend)
U7: Configuration integration + E2E tests

Code review fixes:
- P0: date iteration bug (day>=28), semantic router index never built,
      Redis connection leak (per-call → persistent pool)
- P1: cache degradation recovery, semantic_search degradation,
      double miss counting, asyncio.Lock for PG init, LIMIT on queries,
      __import__ anti-pattern → _utcnow()
- P2: InMemory TTL cleanup, embedding preservation on put(),
      data TTL = max(exact_ttl, semantic_ttl)

2026-06-14 15:16:00 +08:00

2 Commits