Rubber Soul is one of my very favorite Beatles albums, and I agree with Brian's reasons, too. Interesting that his other favorite is Let it Be, one that's not too often mentioned as a favorite of Beatle fans because of Phil Spector's often inappropriate production (like on The Long & Winding Road). Oh, wait, it's probably BECAUSE Phil Spector produced it
Seriously, I do recall reading interviews where Brian mentions really liking the title song a lot.