My device keeps telling me my controller is connected, even though I exited the Pivot app.

This feature has now been removed from the Pivot app. If you are still experiencing this issue this means you have an old version of Pivot installed on your device. Please go to the Google Play Store, or the App Store and update Pivot. Once updated your device will no longer prompt you with this message even after exiting