It looks like it's the WDP that's causing this problem. I changed the website to NOT build as part of the solution and it doesn't add these files in.
I've removed the System dll's from the site and put it on the test server and everything runs as it should.

It's a strange one though as I've already upgraded some other sites without this happening..

 I'll try creating a fresh WDP and see if that fixes this...