It will depend on the terms agreed with your employer.
There is no statutory right to holiday, with or without pay, on bank or public holidays. However, many workers are entitled either to paid leave or to overtime rates of pay on bank and public holidays either under customary arrangements, which may be implied terms of contract or express contract provisions.