Yes it does.
My friend is a vision scientist.
He arrived at work and forgot his glasses.
He went for 2 days without finding them, noticed improved vision.
He ran experiments and came up with a theory of how this should occur.
It is very hard to digest.
It is related to contrasts and spatial frequencies.
Much of the visual system occurs not within the eye or even the optic nerve, but the brain itself, in the visual cortex, V1, V2, V3 etc, in a set of pathways.
The habitual use of corrective glasses or contacts causes changes in this part of the brain. The promotion of certain ranges of apatial frequencies over others occurs when you stop wearing glasses again, and this would improve your 'natural' vision.
I have links if you like.
I think visual sciences are the most interesting of all science, but can be hard to digest, takes no prisoners. Vision is crazy man. Wait til you see the auditory system.