Revert #465

[NGTmeaty]

Fixes #502

[codecov-commenter]

Codecov Report

❌ Patch coverage is 16.21622% with 31 lines in your changes missing coverage. Please review.
✅ Project coverage is 56.25%. Comparing base (051e7e2) to head (0215b8c).
⚠️ Report is 49 commits behind head on main.

Files with missing lines	Patch %	Lines
internal/pkg/source/hq/hq.go	0.00%	31 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #503      +/-   ##
==========================================
+ Coverage   56.22%   56.25%   +0.02%     
==========================================
  Files         130      130              
  Lines        8119     8096      -23     
==========================================
- Hits         4565     4554      -11     
+ Misses       3184     3175       -9     
+ Partials      370      367       -3     

Flag	Coverage Δ
e2etests	40.50% <16.21%> (-0.03%)	⬇️
unittests	29.36% <0.00%> (+0.08%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[willmhowes]

A little more context - @NGTmeaty found:

When creating the second client, we are also creating HQ consumer. It seems like this is causing it to pull URLs from both the main collection and the outlinks collection.

Therefore, this PR specifically fixes #502 by reverting #465 and removing the --hq-outlinks-project featureset from Zeno. We will look to reimplement such a feature in the seed source rather than the crawler.

[willmhowes]

Successfully compiled and testing crawling locally using this branch, good to merge on my end