Yes you can....they are grown as biennials not annuals. However, wallflowers are really short lived perennials and will happily survive a harsh winter.
The only problem is, they will sit there in your tubs for 11 months of the year with nothing going on. Personally, i'd throw away and buy some in the autumn ready for next april/may