Yapay Zekâ
Değerlendirme
Evaluation & Trust alanının bir parçası, seviye 8. Aşağıdaki konular boyunca yaklaşık 16 saatlik çalışma.
Discipline
- Offline EvaluationHeld-out discipline and proxies: what offline numbers claim, and what they cannot.1–2 sa
- Statistical Significance and Confidence Intervals for EvaluationIs the improvement real? Bootstrap intervals, paired tests, and test-set size.1–2 sa
- Online Experiments and A/B TestingMeasuring real impact in production: randomised experiments, guardrail metrics, and peeking.1–2 sa
- Baselines and AblationsWhat a result is compared against: trivial baselines, strong baselines, and ablations that isolate each component's contribution.1–2 sa
Supervised Metrics
- Regression MetricsMAE, MSE, R-squared: reading what each regression number rewards.1–2 sa
- Classification MetricsAccuracy, precision, recall, F1: the trade behind the single number.1–2 sa
- Confusion MatricesError structure, tabulated: reading where the model confuses what.1–2 sa
- ROC and Precision-Recall CurvesSweeping the decision threshold: every threshold is a confusion matrix, every curve is all of them at once.1–2 sa
- Ranking MetricsEvaluating ordered results: precision@k, recall@k, MRR, and NDCG.1–2 sa
Generation Eval
- Generation MetricsBLEU, ROUGE, and their limits: overlap scores for generated text.1–2 sa
- LLM EvaluationBenchmarks, contamination, and reading leaderboard numbers honestly.1–2 sa
- Human EvaluationProtocols, agreement, and cost: when only people can judge.1–2 sa
- Benchmark Contamination and ValidityWhen benchmarks stop measuring: test data in the training set, saturation, and construct validity.1–2 sa
- LLM-as-a-JudgeUsing models to grade model outputs, and measuring the judge's agreement with humans and its biases.1–2 sa
Trust
- Robustness EvaluationPerturbations, slices, and stress tests: eval that fights back.1–2 sa
- Error Analysis and SlicingReliability plus autopsy: confidence honesty and systematic error reading.1–2 sa