I had the same issue with Xillia 2 to a lesser extent. It did some nice things mechanically and it was nice to see Milla and Jude again. What really infuriated me was how Ludger had a really interesting story but then they ruined it by making him a silent protagonist!
Same issue but even more so? Xenoblade Chronicles X. Probably my biggest letdown of the past 5 years other than FFXV. Just so much worse than the original Xenoblade Chronicles in every way (once again, Silent Protagonists are the worst).