Some covenants are widely ignored. For example, I live on a 1970s housing estate where every house has a covenant prohibiting the erection of external TV aerials. But we live in a very poor TV reception area, without any cable services, so every single house a large TV aerial on it!
So you might simply be able to ignore the covenant but, as Buildersmate points out, there's always the risk of later problems if you do so.
A convenant always has to be to someone. It's a legal promise to abide by certain restrictions, which is binding upon successive owners of the property. The person to whom that promise is made (or his heirs and successors) can lift that obligation at any time. It might be worth a bit of research, at your local Record Office, to try to find out who is now entitled to lift your obligation to abide by the covenant.
Chris