No, bcause as soon as you delete the 2 lines at the bottom of the first column the computer will move two lines from the second column to replace them, so you're back where you started.
I guess (because I don't use newspaper columns it's only a guess) that you can "block" an address, then go into format > paragraph and "keep lines together", just like you can to stop it splitting a normal paragraph over two pages. That way, if an address is going to start in one column and finish in the next, the whole address will appear in the second column. Compare it to adding the word in the middle of a line in normal typing - the whole of the word at the end of the line will be moved onto the next line, which may cause the last word on the second line to be moved etc. Blocking a few lines and telling the computer to "keep lines together" is the equivalent of making them one entity which can't be split.