Exactly. But if you look at the options I want, and okay with 20,000 miles on the dial makes me save about $4-5k.
That's a nice hypothetical deal, but I'm afraid to say one that doesn't present itself too often in a post-cash-for-clunkers era where people are holding onto their cars longer (recession.)
Fifteen months I was in the same position as you; I'm a cheap bastard who never believed he would EVER be a first-time owner. Then I gazed at lots where MkV's with 50k were hovering between 1500-3000 off the price of new models.
CPO or not, when you factor in dealer financing advantages on new rides, unless you're paying cash, the value proposition is not there. Hell, for all the situations I saw, even paying cash, the value proposition was not there.
If you can find a model with 20-30k on the dial for $4k less, jump all over it, but you will need to be patient.
My suggestion is to use the internet and scour dealer inventories. Even when I resigned my situation and decided to buy new, everything within a 4 hour drive had 2 doors and/or was missing a third pedal. In my situation, I found a car in NJ, bought a plane ticket for $300, and saved a couple thousand compared to the DSG/autobahns/xenons in my neighborhood.