i have to agree with the previous comment, i think you should count yourself lucky that they have granted you the succession of tenancy.
Also, you have to remember that although it may be filled with memories, it is not actually your house, so you don't have any claim over this particular building. Sorry, i know it sounds harsh but its true. Plus, it is just bricks & mortar, your memories are in your head and your photos, possessions etc, and no-one can take them away from you.
Imagine if there was a family who were currently living in a grotty B&B, just waiting for a nice 2 bed house to become available, but they were denied it because you were insisting on staying there. Don't you agree that it makes sense to move on and let someone else create their own family memories there?
It will also allow you to start a new chapter in your own life.