It is instructive, however to read Mark 6: 1 to 4... "He departed from there and came to his native place, (1) accompanied by his disciples.
(2) When the sabbath came he began to teach in the synagogue, and many who heard him were astonished. They said, "Where did this man get all this? What kind of wisdom has been given him? What mighty deeds are wrought by his hands!
Is he not the carpenter, (3) the son of Mary, and the brother of James and Joses and Judas and Simon? And are not his sisters here with us?" And they took offense at him.
(4)Jesus said to them, "A prophet is not without honor except in his native place and among his own kin and in his own house."
This (also in Matthew 13:55) indicates all the neighbors knew Yeshua since his youth, and were "astonished" at his abilities, especially in the area of Scriptural knowledge and teaching...