I don't know so this is just a pure guess but it may have originated with something like American travelling salesmen. Their territory was the area they would cover to try to make sales, it would be given to them by their company and it might have good or bad things that 'went with the territory' like bad roads or a lot of farmers' daughters.