My own two were both christened but their mother is, at least nominally Christian but with guilt (she went to a Catholic boarding school, but the children were C of E christened; there are limits !LOL). I saw no harm in it. Both were confirmed in the C of E too, but that was pragmatic (both went to schools that expected it) as much as faith, though one has become a regular churchgoer.
If you believe in God, whether or not you have 'religious inclination', there's no harm and if you are both atheist parents you probably won't , but if you do, there may be practical benefits with schooling and, anyway, you are likely to answer their questions truthfully later, as you see it, and leave them to decide. What harm does it do when they are just babies?