you are well within your rights. actually it is quite permissable to film/photograph in ANY public space, or from any public space, all this "thing" about photograpging children is absolutely redicolous becase current ;laws are: you may film / photography anywhere public. if you in a private location you must ask the owners permission, if you film/photograph a private space from a public one you are still technically within your rights to do so although morality and judgment should be used its when people are unreasonable that extra restrictive and over the top rules are brought in.
the common conception of what you can/can't film/photograph seems to be VERY wrong.
(in case you never guessed I'm a photographer and while I neber intrude on anyones privacy I feel more uneasy when I carry a camera in public than the public, thanks to this countries idea of equality for all)