It's meant to be used to point up a statement, delivered as ordinary, but which the speaker suddenly realises is not really ordinary: "I went swimming the other day; cross- channel, as you do.."
Unfunny people have decided that it can be used in all cases, though what they describe is ordinary , because it raises a smile when properly used.