Double glazed windows are usually sealed and sometimes filled with a gas or vacuum to lessen heat transfer. I'd check to see if they are sealed before you consider trying to clean them. Although, if they are dirty, then there may be a leak somewhere.
Some are simply two pieces of unsealed glass mounted in the frame, in which case, there may or may not be a way to get in between the panes. It would depend on the manufacturer.