It goes without saying..." is a phrase we throw around to introduce information that we believe to be obvious... but then we always go on and SAY whatever it was we implied didn't need to be said! It's one of many idiomatic phrases that exist on the fringe of contradiction. Oh, English.

But there is such a thing as information that really doesn't need to be shared publicly, simply because it's nobody's damned business but your own.