Reward Hacking

Reward hacking (also called specification gaming or reward gaming) occurs when an AI system exploits flaws in its reward signal to achieve high reward without accomplishing the intended task. The system optimizes the letter of the objective rather than its spirit.