no its a really good time from one point of view as they will be in flower in their pots in the garden centres and you can see what you are getting. You need to look for what will do well in your garden, sun/shade, acid/neutral/chalky soil, wet/damp/dry and also consider such things as thorns or toxicity if you have children or pets. When you have got all those things sorted, go and ask at the garden centre and if they look at you blankly, go and find another one!
and enjoy!!