I just figured this out myself. In your backend, go to Modules->Site Modules, and click your CB Login module to open up its configuration (you have to be using CB Login, not Joomla Login). Towards the bottom is a dropdown to select your PM component and your notification preference (don't show, show if there are emssages, always show).