Yes, I think you can. Many package holidays to cyprus from the UK have these sorts of cruises/trips built into the options that the reps tout you at the welcome meetings. With the distances involved, they are often overnighters. I cannot see them being too expensive, as they are not car feries. Purely a guess, but I imagine no more than �30 per person return. I am sure you could find the tours on the internet before you go, alternatively, look for the tourist options in the big ports such as paphos, ayia napa etc.