Visual novel and video game are two different things. However, they are not mutually exclusive. So just because two different things are both visual novels doesn't mean you have to blanket them both into either Video Games or Not Video Games.