If food is constantly on your mind, the problem may not be willpower. Restriction, anxiety, rigid food rules, body image concerns, and irregular eating can all make food feel unusually hard to stop thinking about.