I guess if Lord Bolton is the one who has given you the land and not Lord Stark you're loyal to Lord Bolton.