crawler api docs updated.

[akkefa]

Proposed changes:

• crawler API docs updated.

[julian-risch]

@akkefa Looks good to me! We are still working on a GitHub action that keeps the docs in sync with the code automatically by running ./generate_docstrings.sh as described here: https://github.com/deepset-ai/haystack/tree/master/docs
Just out of curiosity, did you run this script or did you change the crawler.md file manually?

[julian-risch]

keeping the docs in sync with the changes made in #1360

[akkefa]

@akkefa Looks good to me! We are still working on a GitHub action that keeps the docs in sync with the code automatically by running ./generate_docstrings.sh as described here: https://github.com/deepset-ai/haystack/tree/master/docs
Just out of curiosity, did you run this script or did you change the crawler.md file manually?

I changed the crawler.md file manually.

[julian-risch]

@akkefa Looks good to me! We are still working on a GitHub action that keeps the docs in sync with the code automatically by running ./generate_docstrings.sh as described here: https://github.com/deepset-ai/haystack/tree/master/docs
Just out of curiosity, did you run this script or did you change the crawler.md file manually?

I changed the crawler.md file manually.

Okay, thanks for letting us know. We will make sure that's not necessary anymore as soon as the GitHub actions is running (again) and automatically takes care of that.