Do you suppose the Doctor’s vacations ever go to plan?
There have been a few times here and there where we’ve witnessed him taking his various Companions off to some particular (intended) place and time for the sole purpose of relaxation and recreation. Most often, the results are less than ideal, as the TARDIS crew gets pulled into some brand of local trouble.
For example, in the eponymous tale, the Fourth Doctor took Romana II to the Leisure Hive to make use of its famous facilities. Of course, they find themselves smack in middle of serious political machinations instead. More recently, Ten took Rose off to New15 York in New Earth, only to discover something seriously wrong with the medical research facility. Even when he merely takes a moment out of his otherwise full schedule to fish (see, e.g., The Androids of Tara or The Two Doctors), things soon go all wahooney-shaped.