It's not a "feeling", it's a fact. No one I know who owns a Vita, whether it's someone I know in person, or someone I know online, believes that the Vita has a good lineup, or can name a reasonable amount of quality titles for it. If you eliminate titles that aren't exclusive to it, such as most of the PSN library and the PS4 native play, and the ports from previous systems, like the HD collections, the list shrinks even more.
It's not that I'm hating on the Vita. I adore it. I think it is incredibly well crafted system (except for the rear touchscreen, because WHY?! [Tearaway is thus far the only answer to that]), and it has some great games. I would love to see more for it. I would also like to see ports of more PS2 era games to the console, as both Persona 4 Golden and Final Fantasy X/X-2 HD are really good. Tearaway is incredibly fun, and Gravity Rush is quite solid. Dragon's Crown is a fun reminder of Golden Axe style gameplay. But what else is there?
This is a serious question. I don't know that many more PS Vita titles that would be worth owning. Suggest them. Build a list. I welcome it. I would love more games on my Vita.
However, for the purposes of this thread, or deciding which system is better, I will be comparing your list to the 3DS library. Just keep that in mind.