Oh my god, yes. FIVE TIMES in Vol'dun I thought "I'll just finish that hub over there so I can keep my log tidy" only for it to lead to another hub, and then to two others, while I was trying to focus on the core story.
I ended up rage-quitting Questvar(Drustvar) because of that and decided to do Kul Tiras instead. Still haven't re-touched Drustvar neither do I want to.