That doesn't really matter, you can take him down in about 5 minutes no matter what level the party is. The only crappy thing I've found about the timer is if you're trying to steal the Demon's Mail it makes things reeeally difficult, or if you end up getting caught at every turn by Alexandrian soldiers it can be a problem.