Split the import_collection task into two tasks to reduce the amount of time the repository lock is held

[fao89]

Author: @bmbouter (bmbouter)

Redmine Issue: 6677, https://pulp.plan.io/issues/6677

---

Background

The import_collection task both analyzes a collection here and then creates content and adds it to a repository version here.

Problem

The import_collection runs long enough that to import a lot of content into a repository serializes these long tasks making the whole workload take long. It takes longer than it should because the collection analysis portion of the task runtime takes the majority of the time and the lock on repository is not needed during that. The lock is only needed when creating the RepositoryVersion itself.

Solution

1. Split import_collection into two tasks. analyze_and_create_collection and then add_collection_to_repository.
2. Have the analyze_and_create_collection task dispatch the add_collection_to_repository. The analyze_and_create_collection task requires no lock. The add_collection_to_respository should have the lock on the repository.

[fao89]

From: pulpbot (pulpbot)
Date: 2020-05-19T18:07:55Z

---

PR: pulp#314