Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Python Support #1

Closed
achimnol opened this issue Nov 28, 2015 · 5 comments
Closed

Python Support #1

achimnol opened this issue Nov 28, 2015 · 5 comments
Labels
persistent

Comments

@achimnol
Copy link
Member

A collection of custom package inclusion requests.
@achimnol
Copy link
Member Author

REPL-related packages: pyzmq, namedlist
Current default packages: numpy, scipy, matplotlib, pandas

@achimnol achimnol changed the title Custom Packet Requests for Python Standard Containers Custom Package Requests for Python Standard Containers Nov 28, 2015
@achimnol
Copy link
Member Author

Request by @inureyes: networkx

@achimnol
Copy link
Member Author

For networkx, we decided to drop the drawing support that depends on PyGraphviz, which works only for Python <= 2.7.

achimnol added a commit that referenced this issue Nov 28, 2015
@achimnol
refs #1: Add networkx to standard python2.7/3.4 containers.
407f937
achimnol added a commit that referenced this issue Feb 24, 2016
@achimnol
refs #1: Pre-download MNIST datasets for tutorial courses.
a38d822
@achimnol achimnol changed the title Custom Package Requests for Python Standard Containers Python Support Mar 1, 2016
achimnol added a commit that referenced this issue Mar 2, 2016
@achimnol
refs #8, #1: Update Python images
0d7a080 
 * Now it runs `import matplotlib.pyplot` during image builds to remove
   font-cache related warnings when first launching kernels.

   - To avoid overriding /home/work directory, we set MPLCONFIGDIR
     to /home/sorna/.matplotlib and allow it in the jail policy.

 * Adds seaborn, scikit-learn, and scikit-images python packages.

 * Unifies Python image policies to limit the maximum number of
   child processes/threads instead of strictly limiting forks.

 * Updates Dockerfiles to use kr.archive.ubuntu.com and non-interactive
   debina frontend environments.
achimnol added a commit that referenced this issue Mar 2, 2016
@achimnol
refs #1: Fix mistakes on package installation scripts.
554f7ad
achimnol added a commit that referenced this issue May 4, 2016
@achimnol
refs #1: Rename python3-deeplearning to python3-tensorflow.
8f1b96c
achimnol added a commit that referenced this issue May 4, 2016
@achimnol
refs #1: Add caffe package to python3-tensorflow image.
a60e316
achimnol added a commit that referenced this issue Jun 27, 2016
@achimnol
refs #1: Update TensorFlow and separate Caffe image.
0728ae5 
 * Updated python3-tensorflow image to use Ubuntu 16.04.

   - Updates for other images will follow soon.

 * Caffe requires A LOT of tweaks and tricks to compile...

   - e.g., symlinking libboost_python-py35 -> libboost_python3

 * matplotlib installs an old version of python-dateutil which is
   NOT compatible with Python 3.x. We need to manually upgrade it
   afterwards.

 * Removes MNIST sample data acquisition in the TensorFlow image,
   as it is provided as a separate docker volume in the production env.

   - This saves about 800 MB from the TF image size.
@achimnol
Copy link
Member Author

0728ae5 also adds cvxpy packages to Python images.

achimnol added a commit that referenced this issue Jun 28, 2016
@achimnol
refs #1, #2, #4, #5: Rebase images onto Ubuntu 16.04
3462134 
 * And php5 is retired.
achimnol added a commit that referenced this issue Jul 16, 2016
@achimnol
refs #1: Add Sorna Media support to Python 2 as well.
85eb169 
 * Change the default background color for matplotlib plots to white.
achimnol added a commit that referenced this issue Jul 18, 2016
@achimnol
refs #1: Refactor Dockerfile for python3 kernel.
0f10d99 
 * Installing Python packages are now done by a shared script
   that handles pyenv setup for arbitrary shell commands.

   - This exposes which packages are required for each image
     to Dockerfile directly, and removes extra clutters introduced
     by copying/chmod-ing "install-xxxx.sh" files.

   - Docker better utilizes build caches when adding new packages.

 * I will apply the same to other Python kernel images soon.
achimnol added a commit that referenced this issue Jul 18, 2016
@achimnol
refs #1: Update python3-tensorflow/caffe images
7d03484 
 * Updates to Python 3.5.2

 * Add support for Sorna Media
achimnol added a commit that referenced this issue Jul 18, 2016
@achimnol
refs #1: Update python2 image.
563623b 
 * Updates to 2.7.12 from 2.7.11

 * Adds Sorna Media support.
achimnol added a commit that referenced this issue Nov 4, 2016
@achimnol
refs #1: Update tensorflow image
b856e09
achimnol added a commit that referenced this issue Nov 9, 2016
@achimnol
refs #1: Pre-install bokeh in python3 kernels.
29abbd4
achimnol added a commit that referenced this issue Nov 9, 2016
@achimnol
refs #1: Pre-install bokeh in python3 kernels.
9688646
achimnol added a commit that referenced this issue Nov 11, 2016
@achimnol
refs #1, #26: Update Python deep-learning kernels
8f4c11c 
 * Adds "io.sorna.maxcores" labels to them.

 * Changed existing "com.lablup.sorna" label prefixes to "io.sorna".

 * Reorganized Dockerfile

 * Use the release version of TensorFlow (r0.11) instead of the master branch version.
achimnol added a commit that referenced this issue Nov 11, 2016
@achimnol
refs #1: Update vanilla Python kernels
02d7928
achimnol added a commit that referenced this issue Jan 24, 2017
@achimnol
refs #1: Fix timeout when there are syntax/compile errors in Python c…
1153378 
…odes.
achimnol added a commit that referenced this issue Jan 24, 2017
@achimnol
refs #1: Update Python 2 version from 2.7.12 to 2.7.13
fbae755
achimnol added a commit that referenced this issue Jan 24, 2017
@achimnol
refs #1: Remove chdir on startup.
04c6cf2 
 * Dockerfile already specifies the working directory.

 * Having duplicate chdir only impairs testability in native
   environments (outside docker).
achimnol added a commit that referenced this issue Jan 24, 2017
@achimnol
refs #1: Clean up imports.
c51871d
achimnol added a commit that referenced this issue Jan 24, 2017
@achimnol
refs #1, #30: Prettify traceback of user-code exceptions
63a47a9 
 * Now they look like raised from nowhere (not /home/sorna/run.py)

   Example:

     Traceback (most recent call last):
       File "<input>", line 2, in <module>
     ModuleNotFoundError: No module named 'timex'
achimnol added a commit that referenced this issue Jan 26, 2017
@achimnol
refs #1, #30: Fix missing self.result with early exceptions
217d54c 
 * Also print early exceptions to stderr.
achimnol added a commit that referenced this issue Feb 6, 2017
@achimnol
refs #1, #4: Apply tzdata upgrade when building images.
86c41a0
achimnol added a commit that referenced this issue Feb 8, 2017
@achimnol
refs #1, #30: Fix outdated sorna-media package in tensorflow-gpu kernel.
f74d207
achimnol added a commit that referenced this issue Mar 4, 2017
@achimnol
refs #41, #1: Update Python kernel to use packaged OpenBLAS/LAPACK
f6b6630 
 * This reduces the image build time and Dockerfile complexity.
achimnol added a commit that referenced this issue Mar 5, 2017
@achimnol
refs #41, #1: Update python2 kernel using Alpine Linux (1.35 GB -> 60…
5d38d0c 
…0 MB)
achimnol added a commit that referenced this issue Mar 30, 2017
@achimnol
refs #3, #1: Update base test case to support interactive inputs.
4631692 
 * Remove PHP5ImageTest since PHP 5 support is deprecated.
achimnol added a commit that referenced this issue Apr 19, 2017
@achimnol
refs lablup/backend.ai-integration-jupyter#2, #1: Add support for aut…
1b3eb7b 
…o-completion
achimnol added a commit that referenced this issue Aug 30, 2017
@achimnol
refs #34, #1, #44, #45, #46: Update base runner and all descendant im…
82d680c 
…ages

 * Base runner now offers the auto-completion handler stub.

 * "python3" kernel now uses the base runner and thus support the batch
   mode with the default build command: "python setup.py develop"
   (skipped with a warning when setup.py is not uploaded together)

 * C/C++ kernels now have the make utility. Ooops.
@achimnol
Copy link
Member Author

Plain "python3" kernel now supports the batch mode.

achimnol added a commit that referenced this issue Sep 4, 2017
@achimnol
refs #1, #41: Add minideb version of Python 3 (base) kernels
a3a5a23
achimnol added a commit that referenced this issue Sep 5, 2017
@achimnol
refs #41, #1, #51: Rebuild images using Debian Jessie
fae02e0 
 * CUDA (or properietary closed source binary package) is the all source of evil....
achimnol added a commit that referenced this issue Sep 5, 2017
@achimnol
refs #1, #44, #45, #46, #48: Update kernels using the new base image
190855d
@achimnol achimnol mentioned this issue Oct 24, 2017
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
persistent
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@achimnol