Skip to content

Issues: Norconex/crawlers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

25 Open 788 Closed
25 Open 788 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

List of URLs for Redirects
#954 opened Mar 21, 2024 by salinausd305
1
I want to extract all the html information.
#950 opened Mar 15, 2024 by haolin96
3
Scheduled Threads for crawling stale From automation, when inactive for too long.
#919 opened Mar 7, 2024 by haolin96
5
How to fetch a given set of files but NOT parse them in Norcornex web crawler? stale From automation, when inactive for too long.
#918 opened Mar 6, 2024 by HailunTan
3
Internal sharepoint website is giving a 403 Forbidden stale From automation, when inactive for too long.
#917 opened Mar 4, 2024 by michaelt16
3
What can I do if I want to get the images(.jpg) from the sites? stale From automation, when inactive for too long.
#884 opened Feb 21, 2024 by haolin96
3
collector v.3 - log4j2 - log-file per crawler feature-request resolved
#790 opened Jun 17, 2022 by jetnet
5
HstsResolver mishandles country code second-level domains bug resolved
#785 opened May 5, 2022 by blue-jam
2
HTTPCollector duplicates listeners when multiple crawlers have set them feature-request
#784 opened May 2, 2022 by dutsuwak
1
Crawl https sitemap with http urls feature-request
#639 opened Sep 9, 2019 by SaschaHeyer
5
i want to test your crawler help me!!! feature-request
#632 opened Aug 19, 2019 by DeveloperYoungsuk
5
ignore www prefix feature-request
#614 opened Jun 18, 2019 by jetnet
4
Question: crawling in similar domain feature-request
#612 opened Jun 8, 2019 by FcrbPeter
7
Crawling JSON feature-request
#601 opened May 10, 2019 by coprisanu
1
Indexing custom fields from a sitemap feature-request
#558 opened Feb 8, 2019 by coprisanu
3
RegexReferenceFilter from file feature-request
#534 opened Oct 31, 2018 by ghost
1
List names of failed jobs when crawl finishes feature-request
#504 opened Jul 11, 2018 by ohtwadi
2
possibility of a com.norconex.collector.http.data.store.impl.dynamodb ? feature-request
#448 opened Dec 28, 2017 by obxpete
3
Is there a way to configure collector behaviour based on IP address? feature-request
#426 opened Nov 14, 2017 by ronjakoi
2
Documentation for Auth - OKTA SSO feature-request question
#421 opened Nov 5, 2017 by jacksonp2008
16
Fetching document text from alternate text/plain rel link feature-request
#364 opened Jul 4, 2017 by radomirml
3
SiteMinder Authentication feature-request
#218 opened Jan 12, 2016 by shubhamsamy
19
Cloning website feature-request
#186 opened Nov 21, 2015 by jaanuska
7
Administration GUI for collector-http crawler config feature-request
#183 opened Nov 12, 2015 by leonardsaers
6
HTTP Collector and Hadoop feature-request question
#92 opened Apr 20, 2015 by csaezl
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.