santiago / deepseek_user_id_with_session_name
0 Lajky
0 Forky
1 Soubory
Naposledy aktivní
plugin to make pi.dev / pi.gui send the session as user.id to avoid sharing KV_cache
| 1 | /** |
| 2 | * DeepSeek `user_id` — ONE ID PER SESSION, never one shared value. |
| 3 | * |
| 4 | * DeepSeek's Chat Completions API accepts a custom `user_id` body parameter |
| 5 | * (https://api-docs.deepseek.com/quick_start/rate_limit) used for: |
| 6 | * - content-safety review isolation |
| 7 | * - KV-cache isolation |
| 8 | * - scheduling/concurrency isolation |
| 9 | * |
| 10 | * WHY PER SESSION. Those are ISOLATION keys: a single fixed value puts every session that uses it |
Novější
Starší