Objective functions are deceptive

Objective can lead to perverse incentive, resulting in wireheading. However, objectives are deceptive in that often agents need to temporarily step back towards lower performance in order to be able to get unstuck for a local optimum.

Resources

Backlinks