TFS issue: "[file]not be found in your workspace, or you do not have permission to access it"

[zhili1208]

Repro Step:

1. open a console app and add a nuget.config which contains disableSourceControlIntegration to the solution folder.
2. bound the solution to TFS
3. reopen the solution and install newtonsoft.json
4. delete nuget.config and reopen the solution.
5. uninstall newtonsoft.json

Expect: works well
Actual: got tfs error: "[file]not be found in your workspace, or you do not have permission to access it"