How about Madeira. Has good weather all year round, and is quite reserved, no lager louts etc. Few children either as no beaches to speak of. It is a beautiful island with lovely walks up in the mountains along the levadas. Can be as gentle or strenuous as you fancy. Only 4 hours by air. Would suggest staying in Funchal unless you really want it very quiet.
Take a look at Strawberry World Madeira website, has quite a lot of info, pictures and live webcams.
Can recommend Villa Vicencia about 1 km west of main Funchal, walkable or bus to centre but enough around the area anyway (known as the Monumental Lido area)
Guess you are mid 40's / 50's, perfect age for this wonderful island.