Kinda depends on the genre of RPG for me. Overall I'd say, roughly in order:

1. Gameplay - is it fun to play?

2. Character creation/customization

3. Good lore/world that I can play around in and get lost in, and that I care about

4. Gotta be available on PC - BIG plus if it's on Steam, GOG or Battle.net

5. Good soundtrack