The standard social convention is to bring your new neighbors some sort of baked delicacy.