Some applications, like banking apps, may not work if you're using them while connected to a VPN. Instead of shutting off your VPN, you can exclude them from the VPN tunnel. Alternatively, you can tunnel only the applications you want, and exclude everything else.