No, the Ultima weapons get lost even in NG+. The Ultimatus garb does transfer into NG+, however.