I think you're selling quite a few people short. I wholeheartedly believe that I, personally, could survive with nothing but a crude knife and some clothing that's from the climate I'm in. I would lose some weight, to be sure, but the basics are out there. You just have to know where to look. Bread and wheat, while nice, are not needed. Most plants I eat would grow practically anywhere as well. I've even been known to dig up cat-tail roots in a pinch. Meat, while nice to have, can be replaced by fish.
You don't even need pots and pans if you can find a flat rock to place over your heat source (fire).
It's not as hard as you think. You just got used to the idea of your 'stuff' being what you need, instead of what you want.