If you have any Debit Card,you should really aprroach the bank your Debit Card is with and ask them,
I don't think you will have much luck with the travel company.
One,they don't have any cotrol over the airline,they have not cancelled the flight themselves.
Two.You are expecting the holiday company to refund your fees,this is much the same as expecting them to refund the interest payments on Credit Cards in the same circumstances.I don't think it's on.
Try the bank first,and then if not try putting pressure on either the airline,or the holiday company,OR check your holiday insurance and see if this is covered.They may (but I am doubtful) refund the whole amount (including fees)
Having read this again,I am confused.When you pay by debit card it come straight out of your account,so (unless you were overdrawn) there should be no fees.
If there are,what are they,and how much are you hoping to regain?