The test for detecting binaries is executed for both Microsoft and source-only builds. But the publishing of the report to be made available as a pipeline artifact is only done for source-only builds: https://github.com/dotnet/dotnet/blob/52ea5b7695e7a1b6e960ba1faa0ef316f2b3f872/eng/PublishSourceBuild.props#L145-L154. This publishing should also be done for Microsoft builds.