This repository has been archived by the owner on Jun 30, 2021. It is now read-only.

It appears Spark is running multiple times... #40

Closed

ruebot opened this issue Mar 1, 2018 · 1 comment

Assignees

Member

ruebot commented Mar 1, 2018

It appears Spark is running multiple times when the CollectionsSparkJob is fired off.

The text was updated successfully, but these errors were encountered:

ruebot self-assigned this

Member Author

ruebot commented Mar 1, 2018

I think it is running as many times as their are warcs in a collection.

facepalm

ruebot closed this as completed in

f5773b1

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.