From 400eca8ca886f41866309a73b3dbd86b87c94805 Mon Sep 17 00:00:00 2001 From: Sultan Iman Date: Thu, 18 Jan 2024 11:32:54 +0100 Subject: [PATCH] Update readme --- sources/scraping/README.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/sources/scraping/README.md b/sources/scraping/README.md index 884a1b0c8..253500825 100644 --- a/sources/scraping/README.md +++ b/sources/scraping/README.md @@ -105,6 +105,19 @@ class CustomSpider(DLTSpiderBase): self.done() ``` +## 💈 Using custom queue + +You can provide custom queue to `build_scrapy_source` via `queue=CustomQueue` parameter and it is up to you +to initialize and prepare it accordring your requriements. + +Also please note that we have generic typing definition of queue in `types.py` + +```py +class BaseQueue(_Queue[T]): + pass +``` + +

Enjoy it!


✨ 🚀 ✨