I just had this issue where I was unable to connect to some publicly accessible hosts while connected to a VPN. I was unable to access a website and upon pinging it, “General Failure” was returned. It didn’t matter whether I checked “Use default gateway on remote network” or not.

I found the solution was to set the metric to a larger value than everything else. I set it to 5000.

You can set the appropriate metric in the following location:

VPNMetric1