This looks hacky but it worked suprisingly well for me.
I am not sure you will agree with this, because it takes time to load but I believe that it's better than constantly fetching timelines user doesn't see.
Yes I am really not sure. I personally like it that timelines load in the background, but I can understand that not everybody wants that. I think we need a complete rework of this together with timeline caching.