semi-deploy mode for Pier...

I'm working on a website using Pier but I need to continue to use the development tools after I deploy. However, I can't seem to get rid of the button bar at the bottom that gives me access to halos and whatnot, even if I'm not logged in as a super user/admin type. I know there's been a lot of discussion about this, but I have a hard time following it. I *really* need to have the site live, but still be able to work on it without that "halo" back door showing on every page. There are likely other security issues with this "semi-deployment" mode and if someone could list them or point me to a discussion of them, I'd be thankful.. Thanks. Lawson