Have to say I may not be the best person to respond because of never being in such a position, but that said, were I a dad I think I'd consider only 2 nights and 1 day a week somewhat less than the 5 nights and 6 days the child was with their mother. OK I guess you could be looking at the ratio of quality time as opposed to total time, but even so you seem to be affected more than seems appropriate to me. I suspect the financial problems are tinting your experience of it all.
But are these times not agreed anyway ? If you were not happy then how is it that it is the present arrangement ?
Personally I think £36 a week is paltry, but I guess I do not know the circumstances. As for what he says, well different folk have different viewpoints. I'd say probably best to ignore what you don't agree with. It's not as if what other hear from him matters much. If you are asked you can put your side of things to them.
No, I think your main concern if the lack of financial support. The issue of the bed for example. IT sounds bad considering he seems to want to be a part of his kids life, yet apparently not take on the responsibilities. Can you not see a solicitor, or even Citizen's Advice and check what can be done via the courts, or whatever ? Better than just letting thigns go, or having a personal blazing row.
Meanwhile try not to worry about a village taking just one person's word for something. They surely must be more intelligent than that. And getting yourself down over it will makes things seem a thousand times worse than they are.