ImJoy - Deep Learning Made Easy!
New: We are working actively on supporting Jupyter notebook based engines, ImJoy now comes with a
Jupyter Engine Manager, which enables running Python plugins via MyBinder.org or your own Jupyter notebook server. With the preview version, you will be able to try and test ImJoy Python plugins without additional setup. Stay tuned, more enhanced features will come soon.
ImJoy is a plugin powered hybrid computing platform for deploying deep learning applications such as advanced image analysis tools.
ImJoy runs on mobile and desktop environment cross different operating systems, plugins can run in the browser, localhost, remote and cloud servers.
With ImJoy, delivering Deep Learning tools to the end users is simple and easy thanks to its flexible plugin system and sharable plugin URL. Developer can easily add rich and interactive web interfaces to existing Python code.
Checkout the documentation for how to get started and more details for how to develop ImJoy plugins: ImJoy Docs
Key Features of ImJoy
Minimal and flexible plugin powered web application
Server-less progressive web application with offline support
Support mobile devices
Rich and interactive user interface powered by web technologies
- use any existing web design libraries
- Rendering multi-dimensional data in 3D with webGL, Three.js etc.
Easy-to-use workflow composition
Isolated workspaces for grouping plugins
Self-contained plugin prototyping and development
- Built-in code editor, no extra IDE is needed for development
Powerful and extendable computational backends for browser, local and cloud computing
- Concurrent plugin execution through asynchronous programming
- Run Python plugins in the browser with Webassembly
- Browser plugins are isolated with secured sandboxes
- Support Conda virtual environments and pip packages for Python
- Easy plugin deployment and sharing through GitHub or Gist
- Deploying your own plugin repository to Github
Native support for n-dimensional arrays and tensors
- Support ndarrays from Numpy for data exchange
ImJoy greatly accelerates the development and dissemination of new tools. You can develop plugins in ImJoy, deploy the plugin file to Github, and share the plugin URL through social networks. Users can then use it by a single click, even on a mobile phone
The easiest way to try ImJoy is to start with a plugin running directly in the browser.
For example, you can install our
Image Recognition plugin with this link.
Clicking the link will open the ImJoy Web App and show a dialog to confirm the
installation of the plugin. Once installed, you can launch the plugin by clicking
Image Recognition in the plugin menu on the left. The demo plugin
will run a trained deep neural network model (MobileNet) to perform image
classification (e.g. identifying an elephant in an image).
This plugin uses your browser as its computational backend, so all computation is done locally, no data will be sent to a remote server.
Besides running plugins in the browser, ImJoy provides the flexibility to keep the GUI locally in your browser, and perform computational tasks with Python. These computations can be performed on your computer utilising the full power of the local GPU/CPU. The computational backend can also be launched on remote servers including cloud servers on Amazon, Google Compute, or an institutional computing cluster.
Previously, running Python plugins would require installation of the Plugin Engine. However, now we have added experimental support for running Python plugins via the servers provided by MyBinder.org. You can try for example the DeepBindScan plugin without any installation.
To learn more details about ImJoy, please go to ImJoy Docs.
Currently, ImJoy consists of the following repositories:
Documentation, questions and feedback
- We provide a detailed ImJoy Docs. This includes a section with frequently asked questions.
- For further help and questions for how to use ImJoy and process data with ImJoy, you can post on image.sc.
- To report bugs or suggest enhancements for ImJoy itself, please file a GitHub issue.
This is a non-exhaustive list of the open-source tools and libraries we used in ImJoy:
- Joy.js (This is where the name
- Jailed (This helps ImJoy to isolate plugins)
- Vue.js (The main ImJoy App is written in Vue.js)
- vue-grid-layout (For window management)
- python-socketio (This how the plugin engine talk with the ImJoy app)
- pyodide (Enables web python mode with WebAssembly)
- conda (The plugin engine uses Conda for managing virtual env. and packages)
- docsify (The ImJoy documentation is created with docsify)
We thank all the authors for offering these excellent work to the open-source community.
Please star the ImJoy GitHub repository to support ImJoy.
We would like ImJoy to be a community driven framework, everyone is welcome to contribute your idea, feedback, plugins and code to the project.
We don't have a guideline for that yet, for now please feel free to use the issues and fork the project.
Ouyang, W., Mueller, F., Hjelmare, M. et al. ImJoy: an open-source computational platform for the deep learning era. Nat Methods (2019) doi:10.1038/s41592-019-0627-0
Code of Conduct
Help us keep the ImJoy community open and inclusive. Please read and follow our Code of Conduct.