Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release 0.10 #449

Closed
antmoth opened this issue Aug 6, 2019 · 4 comments
Closed

Release 0.10 #449

antmoth opened this issue Aug 6, 2019 · 4 comments
Assignees
@antmoth
Labels
Hard High Priority

Comments

@antmoth
Copy link
Collaborator

antmoth commented Aug 6, 2019

Need to get a staging server up and running. Need to work through a full workflow on the staging server. Need to fix any bugs discovered.
@antmoth
Copy link
Collaborator Author

antmoth commented Aug 6, 2019

The current blocker is that when the staging server is up and running, livy doesn't respond to any attempts at contact. Working on this with ops.

@antmoth
Copy link
Collaborator Author

antmoth commented Aug 12, 2019

Livy was having an issue with conflicting jar files for jetty. It's possible that fixing that fixes the issue. I tried to deploy to a fresh ubuntu VM from scratch and have been running into all sorts of other problems. There's a python3/python2 issue...

@antmoth
Copy link
Collaborator Author

antmoth commented Aug 19, 2019 •
edited
Loading

Okay! I think I have a working staging deployment!

The final issue was that Livy was trying to reach Spark on an address that was equivalent to localhost but that didn't resolve to localhost. Adding the addresses it was using to the /etc/hosts file fixed the problem.

The key error here was:
19/08/19 11:21:25 INFO utils.LineBufferedStream: 2019-08-19 11:21:25 WARN RSCConf:146 - Your hostname, [redacted], resolves to a loopback address, but we couldn't find any external IP address!

@ghukill
Copy link
Contributor

ghukill commented Aug 19, 2019

Ah-ha! Good find.

@antmoth antmoth self-assigned this Aug 22, 2019
@antmoth antmoth mentioned this issue Sep 26, 2019
Closed
@antmoth antmoth closed this as completed Sep 26, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@antmoth antmoth

Labels
Hard High Priority
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ghukill @antmoth