Travis CI + Flake8

[davelab6]

• Set up Travis CI with flake8

http://victorlin.me/posts/2013/09/19/fall-in-love-with-continuous-testing-and-integration-travis-ci

Eg https://github.com/edx/harprofiler/pull/52/files

https://pypi.python.org/pypi/tox might be good too

• Set 'master' branch to be a 'protected branch' in Github to prevent regressions
• Fix all errors reported by flake8

[samdroid-apps]

If you find how to do this, please post it here. I would love a simple
Flake8 CI runner for all sugarlabs repos!!!

On Mon, May 16, 2016 at 11:17 PM, Dave Crossland
notifications@github.com wrote:

Set up Travis CI with flake8

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub

[davelab6]

I got stuck with the root requirement :( https://travis-ci.org/davelab6/edit-fonts-activity

[davelab6]

https://pygobject.readthedocs.io/en/latest/testing.html is relevant

[davelab6]

https://pygobject.readthedocs.io/en/latest/memory_leaks.html suggests we could automate checking for memory leaks

[YashAgarwal]

Travis CI shows a build error after the ./osbuild shell command because there is no response after 100ms

$ ./osbuild shell
$ sudo broot run osbuild shell
= Available commands =
docs
dist
check
run
build
karma
clean
pull
See also http://developer.sugarlabs.org/dev-environment.md.html
No output has been received in the last 10m0s, this potentially indicates a stalled build or something wrong with the build itself.
The build has been terminated

This is the .travis.yml file used : https://github.com/sugarlabs/edit-fonts-activity/blob/yash-v0/.travis.yml

[YashAgarwal]

here is the complete error log for the above mentioned build https://raw.githubusercontent.com/sugarlabs/edit-fonts-activity/yash-v0/log.txt

[samdroid-apps]

Osbuild shell just runs a shell. Shells wait for user input to do commands. You might need to supply some user input. What do you want to do?

[davelab6]

@YashAgarwal Alright! You've got the same error (no response) because you're opening a shell and then not giving it valid commands as input (and initially, not giving it any commands at all :) And now @samdroid-apps has just explained how to send input to the shell - thank you Sam! :)

For the travis file, it doesn't really matter which section of the travis file you execute the commands in; the different sections are almost merely 'syntactic sugar' - if you wanted to put all the commands in the install section that would mean that if any process failed to exit cleanly the build would immediately halt as failed; whereas if a command in the script section returns with a non-zero exit code, the build will continue to subsequent commands.

So, lets walk through your travis file

sudo: required
language: python
branches:
  only:
    - yash-v0
python:
  - "2.7"

That all looks good!

before_install:
  - pip install flake8
  - "git clone git://github.com/sugarlabs/sugar-build.git"
  - "cd sugar-build"
  - "./osbuild pull"
  - "./osbuild build"

That looks okay. However, I wonder about using the git HEAD for development; its the latest current edge stuff, but perhaps we should be testing for

a. the latest stable release with a container of fedora:23 and the released RPM package (via copr, eg https://copr.fedorainfracloud.org/coprs/samtoday/sugar/)
b. the XO-1, perhaps by using a docker container with fedora:18 and the most recent packages for it (which are sadly not the latest, eg GTK+3 is a bit old), or perhaps with a container of the OLPC OS image.

https://hub.docker.com/_/fedora/ has some tips on using fedora docker images

install: 
  - "cd activities/"
  - "git clone https://github.com/YashAgarwal/testingTravis.git edit-fonts.activity"

I would like to see us move to https://github.com/sugarlabs/edit-fonts-activity master this week

script: 
  - "flake8 edit-fonts.activity"

@samdroid-apps is this default flake8 code style profile correct?

after_success:
  - "cd .."
#  - "travis_wait 30 mvn install"
  - "./osbuild shell"
  - "python setup.py dist_xo"
  - "cd ~; ls -alFR"

This is ok, but the dist_xo command is producing a .xo binary that is then discarded; the travis file should then have a deploy section where this is uploaded to a deploy target; http://activities.sugarlabs.org is currently the main activity distribution site, and deploying there involves some authenticating (possibly to obtain a cookie) and uploading the .xo file via HTTP POST requests.

@samdroid-apps is there already any python/shell scripts for automating the posting to ASLO?

(PS, please note that when you want to make a preformatted (code) section in Github comments, you should use 3 graves instead of 1 on a line on their own, to start and end the block, rather than just 1 - which is for incline code words; and you can add (without spaces) the name of the file extension relevant to the code to get syntax highlighting, eg

```yaml
something:
- sweet
```

which looks like:

something:
- sweet

[samdroid-apps]

Normal flake 8 should be fine.

I don't think there is a way to upload the bundles to ASLO automatically. Maybe mint some RPMs and put them in a CPOR?

[samdroid-apps]

@davelab6, how do you set a custom docker container? I was reading the docs and I couldn't find anything. Also the announcement said:

Can I provide my own Docker containers?

The build environments we're currently using on our Docker-based setup provide the same services, programming languages and tools offered by our legacy stack. We've been keeping them on par as much as possible.

The lack of sudo does make it hard to install custom libraries and services, running them on privileged ports, or simply using apt. The question for providing your own images is a natural one.

We're not there yet in allowing you to bring your own, but it's something we have in mind for the future.

If it is not avaliable, is there an alternate CI provider that offers that? Is there something that we can self host if needed?

[samdroid-apps]

@davelab6, maybe look at http://docs.gitlab.com/ce/ci/quick_start/README.html

GitLab is FLOSS (yay!) and with the runners you can setup your own and it runs it on a specific machine that you setup (like a fedora 23 docker, or an xo emulator, or even maybe an xo).

It also looks like very travis style config file :)

[samdroid-apps]

Forget all those proposals. here is the best one:

SL once (thanks to @dnarvaez) had an amazing buildbot that ran all the tests. But it decayed and the server got rebooted. The docs were never found and it decayed and died :(

BUT I just stumbled upon a repo for it... with tones of docs! https://github.com/sugarlabs/sugar-buildbot

Let's get that great thing back and running again!

[davelab6]

GitLab is FLOSS

Except it isn't, because the business model is making the important bits proprietary