Sorry this isn't help. I had the same experience with an upgrade AND a clean installation both! Everything appeared ok in each case, until I clicked the "Click here to access your portal" button, when the same error appeared.
Hope you/we find some help with this. Luckily in my case, this happened on my dev server. Until help arrives I won't even attempt upgrading to 3.2 or 4 in production.