Skip to content

Commit

Permalink
Update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
sultaniman committed Jan 18, 2024
1 parent 85f5999 commit 400eca8
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions sources/scraping/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,6 +105,19 @@ class CustomSpider(DLTSpiderBase):
self.done()
```

## 💈 Using custom queue

You can provide custom queue to `build_scrapy_source` via `queue=CustomQueue` parameter and it is up to you
to initialize and prepare it accordring your requriements.

Also please note that we have generic typing definition of queue in `types.py`

```py
class BaseQueue(_Queue[T]):
pass
```


<p align="center"><strong>Enjoy it!<strong></p>
<hr>
<p align="center">✨ 🚀 ✨</p>

0 comments on commit 400eca8

Please sign in to comment.