Faster build

[kangwonlee]

Current status

• According to the conclusion of Schuchert10 min seems to be a good goal
• On a desktop, running the test takes less than 5 min
• On Travis-CI, one job on linux or osx takes less than 10 min but on windows more than 20 min

platform	without cache	with cache
linux	20 min	10 min
osx	20 min	10 min
windows	25 min	50 min

• Total 4:19:51 (1:14:47 by parallel)
• Maybe 7.5 times time saving desirable
• Also, cache size is quite big (~ 6GB)
• Is docker a practical solution?

Too many environments?

• Currently running on {linux, osx, windows} × python {3.5, 3.6, 3.7, 3.71, nightly}
• Total 15 combinations
• Reduce to a smaller number?
• Run on osx & windows only?
• Run on two last releases of Anaconda?
• Recently, the Anaconda installation included some confusions

Detailed build time analysis

	linux		osx		windows
3.5	0:06:05	2.81%	0:12:52	5.94%	0:21:52	10.09%
3.6	0:08:01	3.70%	0:11:40	5.38%	0:24:51	11.46%
3.7	0:07:37	3.51%	0:11:02	5.09%	0:24:03	11.10%
3.7.1	0:08:10	3.77%	0:11:23	5.25%	0:23:49	10.99%
nightly	0:08:16	3.81%	0:12:22	5.71%	0:24:42	11.40%
subtotal	0:38:09	17.60%	0:59:19	27.37%	1:59:17	55.03%
			total		3:36:45

os	linux	linux	windows
python	3.5	3.6	3.5
total time	0:06:05	0:08:01	0:21:52
git clone	0:00:00	0:00:00	0:00:02
gti submodule update	0:00:00	0:00:00	0:00:02
cache loading	0:00:26	0:00:32	0:00:07
openssl			0:00:55
conda install			0:02:58
conda update	0:00:05	0:00:06	0:00:31
conda info	0:00:00	0:00:00	0:00:00
env create			0:08:10
env update	0:00:06	0:00:07	0:00:06
test	0:04:28	0:06:34	0:08:10
cache update	0:00:04	0:00:05	0:00:12
sum	0:05:09	0:07:24	0:21:13
before test	0:01:33	0:01:22	0:13:30
test	0:04:28	0:06:34	0:08:10
after test	0:00:04	0:00:05	0:00:12

Docker

• Todorov describes accelerating Travis-CI using Docker
• Could be faster
• Need authentication settings or open the container

[kangwonlee]

• docker https://docs.docker.com/docker-hub/builds/
• Building a Windows image on a Linux platform seems not straightforward? https://stackoverflow.com/questions/42158596/can-windows-containers-be-hosted-on-linux
• Containers are not VMs; host OS and the container platform should be the same.

[kangwonlee]

Parallel test

• pytest-xdist [0] [1] parallelizes tests
• 89dd5d1 implements it
• However, xdist fails on Python 3.6 pytest-dev/pytest-xdist#127 talks about an issue with python 3.6

Time Breakdown Example

os	linux	linux		windows	windows
python	3.5	3.5		3.5	3.5
pytest-xdist	x	conda-forge		x	conda-forge
total time	0:06:05	0:04:39	23.56%	0:21:52	0:19:16	11.89%
git clone	0:00:00	0:00:00		0:00:02	0:00:02	0.00%
gti submodule update	0:00:00	0:00:00		0:00:02	0:00:03	-50.00%
cache loading	0:00:26	0:00:30	-15.38%	0:00:07	0:00:10	-42.86%
openssl				0:00:55	0:00:40	27.27%
conda install				0:02:58	0:02:53	2.81%
conda update	0:00:05	0:00:06	-20.00%	0:00:31	0:00:30	3.23%
conda info	0:00:00	0:00:00		0:00:00	0:00:00
env create				0:08:10	0:08:44	-6.94%
env update	0:00:06	0:00:07	-16.67%
test	0:04:28	0:03:32	20.90%	0:08:10	0:05:37	31.22%
cache update	0:00:04	0:00:04	0.00%	0:00:12	0:00:15	-25.00%
sum	0:05:09	0:04:19	16.18%	0:21:07	0:18:54	10.50%
before test	0:01:33	0:01:03	32.26%	0:13:30	0:13:24	0.74%
test	0:04:28	0:03:32	20.90%	0:08:10	0:05:37	31.22%
after test	0:00:04	0:00:04	0.00%	0:00:12	0:00:15	-25.00%