Tillyfloss, I understand the point you're making, but a couple of points;
1) By stopping believing in religion there's no compulsion to believe anything else in common with other atheists. It's like saying 'Hey, we both don't believe in Odin, therefore we should set up home together...'
2) If you are comparing two things and one of those things has a wealth of evidence to support it that bears repeated testing and the other does not, you are not comparing like with like. If I said, 'there's a dragon in the room, but you can't see it, smell it, touch it, hear it, or in any other way detect that it is in the room, but it is there because it says so on this piece of paper' that is not the same as saying, 'there is a table in this room - that's it there - go put your glass on it,' which statement would you say is credible and worthy of your belief?