Fix test failures, restoring tests matrix

[OmarTawfik]

No description provided.

[enricosada]

great job @otawfik-ms !

[enricosada]

as a side node about build matrix:

fsharp suite (smoke)

Before parallelization	After parallelization
22 min	15 min

and that's because there are some test, but few test directories ( parallelization work by directory ). full suite is faster than before!

Maybe we can run full fsharp suite ONLY when the commit is in master branch not pr, what do you think @KevinRansom?

[enricosada]

btw @otawfik-ms , if you want you can do merge cambridge_suite and qa_suite in a single job

- BUILD_PROFILE: cambridge_suite,qa_suite,smoke_only

it's 7 minutes less ( the base download+compilation for a job is 7 minutes )

[OmarTawfik]

@enricosada Strangely, it took more on my private build:
https://ci.appveyor.com/project/otawfik-ms/visualfsharp/build/0.0.1.8
I'll let it run for a few builds, and then combine them if they're consistently faster.

[KevinRansom]

56 minutes for the verification --- kind of sucks.

[enricosada]

The private build is oss ( or are you pro user? ) and run on a less powerful machine, i think. My private build for sure are slower

Inviato da Outlook Mobile

On Fri, Dec 18, 2015 at 11:01 AM -0800, "Omar Tawfik" notifications@github.com wrote:

@enricosada Strangely, it took more on my private build:
https://ci.appveyor.com/project/otawfik-ms/visualfsharp/build/0.0.1.8
I'll let it run for a few builds, and then combine them if they're consistently faster.

---

Reply to this email directly or view it on GitHub:
#812 (comment)

[enricosada]

Maybe after coreclr we can use also the jenkins build servers.
Otherwise the only solution is buy another build worker = 25 min.

[enricosada]

Is really funny. Appveyor run in azure 😄

[KevinRansom]

@enrico OSS is the same as PRO just half price or at least it was at the time.

[KevinRansom]

I am beginning to suspect though that our setup is not running on dedicated hardware like it should, instead it maybe running in the cloud.

[KevinRansom]

Hmm!!!! Pro is one concurrent job, so no parallel jobs without the premium plan.

http://www.appveyor.com/pricing

Our current plan is : Pro FOSS

[OmarTawfik]

@KevinRansom, actually, running in parallel with this speed means that we will be running all the tests (in this PR) in less than 30 minutes. I'm looking into all the options now to see if there is something we are missing.

[KevinRansom]

I suppose 1 concurrent Job, could mean one job + another concurrently. It's not the way I would have read it. It would be great if we can run the jobs in parallel.

[KevinRansom]

Okay we will pull this in, and we can work with it, while you figure out how to make it faster :-)