Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#3418] Build for Ubuntu 16.04 and update Linux, OpenBSD and OSX builds to cffi. #54

Merged
merged 10 commits into from
Apr 29, 2016

Conversation

adiroiban
Copy link
Member

@adiroiban adiroiban commented Apr 21, 2016

Scope

Update build system to create package for ubuntu 16.04

Changes

Since pyopenssl 0.13 no longer works with OpenSSL available on Ubuntu 16.04 i have updated the build system to the one similar to Arch.

In the future all builds should use that system.

I have refactored a bit the windows part to re-use the common process.

src/python/chevahbs no longer installs pip, but just make sure that we have a minimal python.

I have also enable new build system for rhel 5,6,7 and sles 11,12 and generic linux, raspbian7, openbsd and solaris11

aix, freebsd and solaris10 are broken ... but since solaris 10 has a very old openssl I am not sure if we can upgrade it.

As a drive by I have added the github PR template.

How to test

reviewers: @brunogola @dumol @alibotean

check that changes make sense

thanks!

@adiroiban adiroiban changed the title [#3418] Build for Ubuntu 16.04. [#3418] Build for Ubuntu 16.04. Apr 21, 2016
@adiroiban
Copy link
Member Author

windows builder is green.

arch and ubuntu-1604 also

working to enable for all ubuntu versions ...at lease for the supported ones

later we should also enable RHEL and SLES

needs-review

@adiroiban
Copy link
Member Author

Since I was already set on this I tried to enable as many systems as possible... and OpenBSD is now updated.

but there is still work for freebsd ... and aix :)

fi
BUILD_CFFI="yes"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess the above line should come inside the else clause and before the ending fi clause. Consequently, the Solaris 10 builds are broken, eg. https://build.chevah.com/builders/python-package-solaris-10/builds/76/steps/build/logs/stdio

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hm.... in master CFFI is build for any solaris version ... so I think that this is just keeping the behavior from master

@dumol
Copy link
Contributor

dumol commented Apr 23, 2016

Some minor comments above… However, the Solaris 10 builds are broken, thus:

needs-changes

@dumol
Copy link
Contributor

dumol commented Apr 23, 2016

Also, Solaris 11 for Sparc has a mysterious issue (unrelated to the generic Solaris 10 one). For details: https://build.chevah.com/builders/python-package-solaris-11-sparc/builds/35/steps/build/logs/stdio

@adiroiban
Copy link
Member Author

the build is broken on solaris since libffi was compiled but not installed on solaris.

@dumol I am asking if is ok with you to merge this as it is and have a separate ticket to look at fixing the solaris builds.

thanks!

needs-review

@dumol
Copy link
Contributor

dumol commented Apr 26, 2016

There are least tree breakages in this:

  1. The generic Solaris 10 ../install-sh error for libffi:
    https://buildbot.chevah.com:10443/builders/python-package-solaris-10/builds/81
  2. The mysterious Solaris 11 on SPARC reallocation error:
    https://buildbot.chevah.com:10443/builders/python-package-solaris-11-sparc/builds/36
  3. A common AIX / FreeBSD problem introduced by the latest commit, namely No module named cryptography.hazmat.backends.openssl.backend:
    https://buildbot.chevah.com:10443/builders/python-package-fbsd-10/builds/10

I'm not happy with breaking six build slaves (of which five are important for our releases) for enabling the newly launched Ubuntu 16.04… But I guess this branch became something else in the process, so the title of this PR should be updated. And tickets for the breakages in master should be added and assigned. I feel this is over the top for me currently…

@adiroiban
Copy link
Member Author

You are right.

I think that AIX and FreeBSD are already left with the old build system and are green. The need to be updated in separate tickets.

I will also update the code so that solaris will use the old build system in which libffi is not installed.

I will update the ticket title to include osx and the other linux distros

Thanks!

@adiroiban adiroiban changed the title [#3418] Build for Ubuntu 16.04. [#3418] Build for Ubuntu 16.04 and update Linux and OSX builds to cffi. Apr 26, 2016
@adiroiban adiroiban changed the title [#3418] Build for Ubuntu 16.04 and update Linux and OSX builds to cffi. [#3418] Build for Ubuntu 16.04 and update Linux, OpenBSD and OSX builds to cffi. Apr 26, 2016
@adiroiban
Copy link
Member Author

ok... hope this is fixed.

needs-review

--extract $destination/Lib/site-packages/pywin32_system32/pythoncomloader27.dll.embedded \
$destination/Lib/site-packages/pywin32_system32/pythoncomloader27.dll

execute sed -e 's|version="9.0.21022.8"|version="9.00.30729.6161"|' -e 's|publicKeyToken="1fc8b3b9a1e18e3b"||' < $destination/Lib/site-packages/win32/pythonservice.exe.embedded > $destination/Lib/site-packages/win32/pythonservice.exe.manifest

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was also patching these files for service usage. I see that the new version skips them. I have doubts that this is ok.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is done... see comment below and changes in chevah_build

@alibotean
Copy link

I saw some changes to the Windows build code that I think was not tested. Please check my comments, thanks.

needs-changes

@dumol
Copy link
Contributor

dumol commented Apr 27, 2016

I can confirm all the previously-problematic UNIX builds are now green.

@adiroiban
Copy link
Member Author

I think that the code is ok.

needs-review

@dumol
Copy link
Contributor

dumol commented Apr 28, 2016

changes-approved

@bgola
Copy link
Contributor

bgola commented Apr 28, 2016

looks good and works great on my archlinux.

changes-approved

@alibotean
Copy link

I think that the code is ok.

Oki dok.

changes-approved

@adiroiban adiroiban merged commit fa77bec into master Apr 29, 2016
@dumol dumol deleted the 3418-ubuntu-16.04 branch April 23, 2017 08:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants