This is obviously a huge question, and you've already gotten some excellent expert advice.
I agree that the Victorinox are excellent knives, and an amazing value. You really can't go wrong starting with them. If I were starting from scratch, I'd start with a few of their knives, but I'd invest in a quality Japanese water stone for sharpening-- a 1000/4000 stone should be perfect. You probably already have a 'steel' for aligning the blade periodically.
I am a *huge* fan of the Japanese-style knives, with a single bevel. They are light, thin, durable, and have amazing balance. Tricky to learn how to sharpen, but definitely doable.
No surprise to hear this from a WKCer, but it's really fun to find knives second-hand. I've never had any luck at thrift stores, but have found some amazing German knives at estate sales for like a buck apiece. Some of my favorite blades, because they came with a story and a history.
Bottom line: the single most important aspect of a knife is *sharpness*. With that in mind, I'd recommend you start with cheaper knives (like, say, the Victorinox) and spend a bit more on a quality water stone and practice your skills there. Then you'll have a better idea of the dream knives you'd like to have, and you'll know how to care for them when they come to you.