Let's get 'parental responsibility' dealt with first:
1. If you were married to his father at the time of your son's birth he will automatically have parental responsibility.
2. If you were not married at the time of your son's birth, his father will only have automatic responsibility if your son was born in England, Wales or Northern Ireland and you also jointly registered the birth with his father. (i.e. the father's name appears on your son's birth certificate).
3. If neither of the above are true, your son's father will only have parental responsibility if you've entered into a formal agreement with him, or if a court has granted a relevant order.
Assuming that the father has parental responsibility, the following statements are true:
1. If you hold a residence order for your son, you can take him out of the country for up to one month at a time without his father's consent. If you attempt to take him out of the country for any longer you will be committing a serious criminal offence.
2. If you do not hold a residence order you will be committing a serious criminal offence if you try to take your son out of country at all (even for a day trip).
http://www.direct.gov...ildpassport/DG_174106
Chris