Error 1310 or Error 2203 and unable to write to c:\Config.Msi

I've tried tons of solutions you find on the web for this problem. Most software says it is unable to write to that directory and you can 'retry'. Usually hitting retry works. But some software doesn't give you that option (iTunes, HP Scanning Software) and they just fail.