Rune Factory is more of a spin-off of Harvest Moon. It still has the farming aspects of HM and probably the 'romance' (haven't gotten too far myself), but the core harvest moon games never had any combat.

HM series has its fans, but I could never get into them. Combat makes this game a little more interesting to me.