I haven't the faintest idea what causes this.
When building, xharness fails to find the device, so I have to open the Xcode project and run it manually. However, pressing run in the project only actually runs it about half the time, and otherwise just builds and reports immediate success. There is no discernable difference between attempts, and rebuilding the test can fix or cause the issue seemingly at random.
cc: @steveisok