allowed_domains for traversal

[rrmerugu]

Is your feature request related to a problem? Please describe.
in the traversal, there is no way for user to specifiy only specific white-listed domain only.

Describe the solution you'd like
Currently all the allowed_domains from the settings is used for this. But allowed_domains should be made specific to traversal. So that traversal link extraction will be taken care for only desired domains,

Describe alternatives you've considered
NA

Additional context
NA