There is a time and/or a level after which it will go away. For the life of me I can't remember either. If you want it gone go to

Help Desk (in your second set of menus)
Config
Cancel New Adventurer Status