Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: Google Colab support is broken #538

Closed
epinzur opened this issue Jul 20, 2023 · 3 comments
Closed

bug: Google Colab support is broken #538

epinzur opened this issue Jul 20, 2023 · 3 comments
Labels
bug Something isn't working p0 Prevents users from using Kaskada

Comments

@epinzur
Copy link
Collaborator

epinzur commented Jul 20, 2023

Description
When trying to run Kaskada in Google Colab, it no longer works.

To Reproduce
Steps to reproduce the behavior:
when I try to do this:

from kaskada.api.session import LocalBuilder
from kaskada import table as table

ksession = LocalBuilder().build()

I get:

ConnectionError: Unable to connect after 10 attempts

Actual Behavior
Local Session isn't starting

Expected Behavior
Local Session starts without issue.

Additional context
Error found on python clients: v0.5.1, v0.5.0, v0.4.1. I didn't try older versions than this. Engine/Manager were v0.9.0.

Also tried running on local jupyter notebook. This worked without issue on my Mac.

Relevant Logs / Links
Relevant stack traces, results, links, or screenshots of the issue.

From logs, it seems that the engine (sparrow) can't start due to a libssl issue:

/root/.cache/kaskada/bin/engine@v0.9.0/kaskada-engine: error while loading shared libraries: libssl.so.1.1: cannot open shared object file: No such file or directory
@epinzur epinzur added bug Something isn't working p0 Prevents users from using Kaskada labels Jul 20, 2023
@epinzur
Copy link
Collaborator Author

epinzur commented Jul 20, 2023

I was able to get kaskada working in colab by first installing libssl1.1:

!wget http://nz2.archive.ubuntu.com/ubuntu/pool/main/o/openssl/libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb
!sudo dpkg -i libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb

Make sure to do the above before starting your Kaskada LocalSession.

@epinzur
Copy link
Collaborator Author

epinzur commented Jul 20, 2023

We've found that even after doing the above fix, Kaskada keeps having issues occasionaly.

IPython.core.error.UsageError: An exception occurred: Kaskada services are not available. If this is a local session, please restart the session.

Re-running the session cell fixes the issue for a while.

@therapon
Copy link
Contributor

With regards to the libssl issue, it appears that Collab has upgraded the Ubuntu version running on their instances from 20.04 to 22.04
This upgrade to Ubuntu also upgrades the ssl library from 1.1.1 to 3.0.9.
The Kaskada binary (through a dependency) depends on libssl. Our release builds are on Ubuntu 20.04. So when our kaskada binary is executed on a Ubuntu 22.04 it cannot find the appropriate version of libssl and fails to start the sparrow process.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working p0 Prevents users from using Kaskada
Projects
None yet
Development

No branches or pull requests

2 participants