ManySpace
Türkçe Sign in Sign up

AI & MLRecommendedAIML-RL-017

Actor-Critic Methods

A learned value function (the critic) supplies the baseline and advantage for the policy (the actor).

Difficulty
3 / 5
Importance
4 / 5
Study time
1–2 h
Kind of work
Mixed

Why it matters

The learner can compute an advantage estimate from a critic and explain how the critic reduces policy-gradient variance.

The route to this topic

Route AIML-RL-017
What Is a Model? Rational Agents and Task Environments Features and Targets Agent and Environment Linear Regression I: Prediction and Residuals Return and Discounting Policies Loss and Fitting: Squared Error Markov Decision Processes Objective Functions and Empirical Risk Value Functions Policy Optimization Gradient Descent in Machine Learning Bellman Intuition Monte Carlo Prediction and Control Stochastic and Mini-batch Optimization Temporal-Difference Learning Policy Gradients: REINFORCE Actor-Critic Methods