Your follower will lose all of their food if you use the escape option to leave the event or if you teleport out of the minigame.