When I was in my early teens, I read a fascinating book about a man who entered a old Victorian house. As he looked out of the windows, he was fascinated by the fact, that as each day passed, the days went by quicker and quicker, until it was a blur of day light and night time, winter, spring, and summer and autumn came and went in seconds. I can't remember how the book ended, and my description of the book is based on 40 years of memory !
Could it be 'The Time Machine' by HG Wells? He had a Time Machine in a sort of conservatory and he watched the days go by as you described and it started in 1899, which fits the Victorian era.