Skip to content

Issues: meilisearch/scrapix

Prepare scrapix for production use
#14 opened Jun 19, 2023 by bidoubiwa
Open
Scrapix V2
#111 opened Nov 9, 2024 by qdequele
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

37 Open 29 Closed
37 Open 29 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

By default use cheerio instead of Puppeteer breaking-change The related changes are breaking for the users enhancement New feature or request
#113 opened Nov 9, 2024 by qdequele
@qdequele
Remove the useless headless option breaking-change The related changes are breaking for the users enhancement New feature or request
#112 opened Nov 9, 2024 by qdequele
@qdequele
Scrapix V2 epic
#111 opened Nov 9, 2024 by qdequele
12 of 19 tasks
1
@qdequele
Create Markdown scraping strategy enhancement New feature or request
#110 opened Nov 9, 2024 by qdequele
@qdequele
Create Cheerio crawling backend option enhancement New feature or request
#109 opened Nov 9, 2024 by qdequele
@qdequele
Create Puppeteer crawling backend option enhancement New feature or request
#108 opened Nov 9, 2024 by qdequele
@qdequele
Create Playwright crawling backend option enhancement New feature or request
#107 opened Nov 9, 2024 by qdequele
Update Schema scraping strategy to handle microdata
#106 opened Nov 9, 2024 by qdequele
Detect/handle localized pages enhancement New feature or request
#105 opened Nov 9, 2024 by qdequele
Index the PDF files enhancement New feature or request
#104 opened Nov 9, 2024 by qdequele
Keep the previous settings enhancement New feature or request
#103 opened Nov 9, 2024 by qdequele
Load the sitemap as starter point for crawling. enhancement New feature or request
#102 opened Nov 9, 2024 by qdequele
Provide option to slow or rate limit requests enhancement New feature or request
#99 opened May 10, 2024 by klvs
1
Cannot run under Windows (path contains invalid characters) bug Something isn't working
#98 opened May 9, 2024 by AXYZE9
1
Scrapix Docker image configuration: JSON string parsing and Liquid syntax compatibility bug Something isn't working
#95 opened Feb 20, 2024 by CaroFG
user_agents in configuration file doesn't change HTTP User-Agent header bug Something isn't working
#94 opened Feb 15, 2024 by TonyRL
Add possibility to exclude selectors enhancement New feature or request
#93 opened Jan 23, 2024 by CaroFG
@qdequele
Document the purpose of hierarchy_radio_lvl
#90 opened Jan 18, 2024 by CaroFG
fix(crawler): fix failed webhook cloudboard
#80 opened Aug 22, 2023 by brunoocasali
2
Throw error when redis server is not answering bug Something isn't working
#56 opened Jul 3, 2023 by bidoubiwa
Retrieve page titles from meta tags enhancement New feature or request
#53 opened Jun 29, 2023 by Strift
3
Ensure same documents are not pushed more than once. enhancement New feature or request
#52 opened Jun 29, 2023 by bidoubiwa
2
url_to_index does not work bug Something isn't working needs more info This issue needs a minimal complete and verifiable example
#49 opened Jun 28, 2023 by bidoubiwa Prepare Scrapix for production
1
Handle pages not found bug Something isn't working enhancement New feature or request
#48 opened Jun 28, 2023 by bidoubiwa
Find out which field in the config files are mandatory or not enhancement New feature or request
#35 opened Jun 21, 2023 by bidoubiwa Prepare Scrapix for production
ProTip! Follow long discussions with comments:>50.