ManySpace
English Giriş yap Kayıt ol

Yapay ZekâÖnerilenAIML-SYS-006

Caching and Reuse

Never compute twice: the KV cache, shared prompt prefixes, and result reuse at inference.

Bu konunun henüz Türkçe çevirisi yok, bu yüzden İngilizce gösteriliyor.

Zorluk
3 / 5
Önem
4 / 5
Çalışma süresi
1–2 sa
Çalışma türü
Karma

Neden önemli

The learner can explain what the per-sequence KV cache stores, how shared prompt prefixes reuse it across requests, and when caching repeated results is safe.

Bu konuya giden rota

Rota AIML-SYS-006
What Is a Model? Tasks: Regression, Classification, and Beyond Features and Targets Classification Framing Linear Regression I: Prediction and Residuals Embeddings Tokens and Tokenization Scores and Logits Loss and Fitting: Squared Error Similarity in Vector Space Multiclass Scores and Softmax The Artificial Neuron Autoregression Objective Functions and Empirical Risk Query, Key, Value Activation Functions Next-Token Prediction Training vs Serving Similarity Scores The Multilayer Perceptron Weighted Aggregation Forward Propagation Self-Attention The Attention Block Context and Conditioning Memory and Model Size The Causal Transformer Context Windows Caching and Reuse