Definition

where is a discount factor

Return is the total discounted Reward from time step .