I usually say something like "Gotta go (eat dinner/sleep/watch TV,) sorry. Nice talking to you, bye."