Hi Little fella,
I'm in the same boat as in not a lot of money spare. With this in mind, for 2m/70cm if you go hand-held you can get a Baofeng for £30 or less. Some people love them some hate them but for the money you can't go wrong.
I got a mobile rig but use it as a base station - CRT Micron. Or the Retevis/Anytone, they are the same rig, just Re badged. Well pleased with it, cracking little rig.
HF Set, for the price you won't beat the Yaesu FT-450D, it's got all the filters to learn and master as well as a built-in ATU which comes in handy. It's a great starter rig to cut your teeth on.
Yes, I'm sure if we could afford we would all like the top of the range shack in a box complete with the waterfall but if you're on a budget have a look and check the reviews on YouTube ect. If you go for the Yaesu you'll have to have it opened for general coverage to use on 27.555Mhz ect, allow /add an extra £30 to have this done at the shop if your buying new. I'm sure someone else will be able to offer other recommendations. And of course there is always second hand.
Hope this helps.