Yeah imo if you do everything you're gonna feel disconnected from your team mates because you get so busy rescuing cats from trees you don't get time to talk to them. I did a whole bunch of side quests but tended to stay away from boring fetch quests if they weren't related to my team or yielded any good loot.