I concur with Teddio that oxidation of CO to CO2 does not occur at room temperature.
For this oxidation to occur, normally catalysts have to be present. Cobalt oxide is a typical one, but even then specific temperatures and/or pressures are required. The exception might be the natural oxidation that occurs in the upper atmosphere although a meteorologist told me some time ago that this can take years to happen.
As Teddio says, CO penetration depends on the porosity of the material. Brick, concrete and similar materials are very porous. As far as glass is concerned, it depends on the thickness of the glass involved. It might never diffuse through a suitably sealed glass brick cube yet if one of my students told me they wanted to fill a cube of cover slip glass with CO to see what happened, I'd soon show them the door.
Polymers and metals in general are impervious to carbon monoxide and other gases even under pressure. I've had a specially constructed unused cylinder of carbon monoxide at an extremely high pressure in my lab for about eight years and the lab technicians periodically check the gas volume and pressure. The figures are about the same as when the cylinder was checked following delivery.