We had one campaign where the GM insisted, and we had to keep track of food. Inevitably, we forgot once or twice, and it didn't add to the fun in any appreciable way - "Hey guys, it's a new day, tick off one of your food rations", "What? Oh yeah, whatever".
If I'm GMing, anyone with a hunting/fishing/gathering skill is assumed to succeed in an familiar environment (following the "don't roll the simple stuff" rule of thumb). When the party is about to head into territory where they don't have normal access to food or an unusual environment, they must either get supplies before departing - in which case they have ample food for the journey - or they must make skill checks or start to get hungry.