NUTCH-3026 -- add statusOnly as an indexing option

[tballison]

Thanks for your contribution to Apache Nutch! Your help is appreciated!

Before opening the pull request, please verify that

• there is an open issue on the Nutch issue tracker which describes the problem or the improvement. We cannot accept pull requests without an issue because the change wouldn't be listed in the release notes.
• the issue ID (NUTCH-XXXX)
  • is referenced in the title of the pull request
  • and placed in front of your commit messages surrounded by square brackets ([NUTCH-XXXX] Issue or pull request title)
• commits are squashed into a single one (or few commits for larger changes)
• Java source code follows Nutch Eclipse Code Formatting rules
• Nutch is successfully built and unit tests pass by running ant clean runtime test
• there should be no conflicts when merging the pull request branch into the recent master branch. If there are conflicts, please try to rebase the pull request branch on top of a freshly pulled master branch.
• if new dependencies are added,
  • are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • are LICENSE-binary and NOTICE-binary updated accordingly?

We will be able to faster integrate your pull request if these conditions are met. If you have any questions how to fix your problem or about using Nutch in general, please sign up for the Nutch mailing list. Thanks!

[lewismc]

Reopening to have CI run again.

[lewismc]

Hmmm. It appears that there are problems with the protocol-http unit tests…

    [echo] Testing plugin: protocol-http
    [junit] Running org.apache.nutch.protocol.http.TestBadServerResponses
    [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.846 sec
    [junit] Running org.apache.nutch.parse.tika.TestHtmlParser
    [junit] Tests run: 9, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 3.659 sec
    [junit] Test org.apache.nutch.protocol.http.TestBadServerResponses FAILED
    [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.599 sec
    [junit] Running org.apache.nutch.protocol.http.TestProtocolHttp
    [junit] Running org.apache.nutch.parse.tika.TestImageMetadata
    [junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.074 sec
    [junit] Running org.apache.nutch.protocol.http.TestResponse
    [junit] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 1.699 sec