Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NUTCH-2883 Provide means to run server and webapp as persistent services in Docker container #748

Merged
merged 3 commits into from Sep 11, 2022

Conversation

sebastian-nagel
Copy link
Contributor

This PR includes everything from #691 rebased to the recent master and sqashed into a single commit. It also includes

  • a fix to make the arg instructions (eg. --build-arg BUILD_MODE=1) working, see comment in #691
  • installation of the WebApp from the separate repository and running it via mvn jetty:run -Djetty.port=<WEBAPP_PORT>

So far, I've successfully tested this PR

  • using all BUILD_MODEs: 0 (default if not set), 1 and 2
  • running the resulting images as containers
  • for build mode 0: run some Nutch commands
  • for build mode 2 (server + webapp): configure run a small crawl
  • for build mode 1 (server): run external webapp to configure and run a crawl
  • crawls where successful with some work-arounds required (NUTCH-2965 and NUTCH-2966) and not testing indexing into Solr (NUTCH-2964)

lewismc and others added 3 commits September 11, 2022 11:37
…ces in Docker container

- move ARG instructions into FROM block they're used in (duplicate if
  necessary)
…ces in Docker container

- install Nutch WebApp from separate repository (see NUTCH-2886) and run
  it via `mvn jetty:run -Djetty.port=<WEBAPP_PORT>
- sync log paths in supervisord config files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants