Just as an example, I buy pasture raised, grass fed organic milk for $3 per half gallon. Good local butter for $4/lb (though it's not nicely packaged - you buy it by weight), great prime aged steak at $8/lb for sirloin, $13 for shell or ribeye at an old italian butchers in the Village. You want good reasonably priced fresh fish, go to Chinatown or some of the greenmarkets. My local greenmarket also has very nicely priced good veal.

I'm food obsessed with a limited budget so I've put a fair amount of effort into figuring out where to buy.