Discussions

• 1 You must be logged in to vote

  🙏

  Where is the data saved ?

  archive.org archive.org services not (just) Heritrix

  CubeBeveled asked Apr 25, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to change auth type?

  Moogamouth asked Apr 24, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to disable the default basic authentication?

  jasoncaojingren asked Apr 15, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to crawl only one page

  nk-yuta asked Nov 16, 2023 in Q&A · Answered

  

  

  3
• 2 You must be logged in to vote

  🙏

  Crawling our website takes a very long time, looking for configuration advice

  Glenruben asked Nov 13, 2023 in Q&A · Answered

  

  

  2
• 3 You must be logged in to vote

  🙏

  Failed to start bean 'bdb'; nested exception is java.lang.IllegalStateException: com.sleepycat.je.EnvironmentFailureException: (JE 7.5.11)

  albertkao9 asked Feb 17, 2023 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Heritrix 3.4.0-SNAPSHOT-2022-03-08T19:15:59Z keeps pausing..

  cslr asked Oct 16, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Crawl from local files instead of from a website

  cgr71ii asked Jul 3, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Unable to set up ExtractorChrome, fails with Can't create bean 'fetchProcessors'; Can't create bean 'crawlController'; Can't create bean 'extractorChrome'

  vnznznz asked Jun 27, 2023 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is it possible to update report files without necessarily open them?

  cgr71ii asked Apr 25, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  How to create a new log/report for a single class

  question

  cgr71ii asked Sep 24, 2022 in Q&A · Closed · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  How to create new .warc file for each HTML link and add all relevant non HTML links into the file?

  Moogamouth asked Feb 13, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is the "data" variable from CrawlURI thread-safe?

  cgr71ii asked Feb 7, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to get the HTML content from CostAssignmentPolicy instance

  cgr71ii asked Nov 25, 2022 in Q&A · Answered

  

  

  6
• 1 You must be logged in to vote

  🙏

  Is there a way to use Heritrix3 to write WARCs in Java?

  TheTechRobo asked Nov 26, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Question (saving content as plain text, recrawling)

  question

  zhaobm asked May 17, 2022 in Q&A · Answered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to resume a crawl for later

  question

  JenPho asked Sep 10, 2022 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Question about the size of the 'state' directory

  cgr71ii asked Sep 7, 2022 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Crawl Job Settings Documentation for 3.4.0

  question

  mutlurasit asked Jul 30, 2020 in Q&A · Unanswered

  

  

  

  

  8
• 2 You must be logged in to vote

  🙏

  TransclusionDecideRule: meaning of maxTransHops and maxSpeculativeHops

  question

  cgr71ii asked Aug 31, 2022 in Q&A · Answered

  

  

  6
• 2 You must be logged in to vote

  🙏

  How to exclude PDF files

  question

  oschihin asked Dec 14, 2021 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  How to cite?

  pull request welcome question

  Querela asked Feb 7, 2022 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Question re: cloudfront.net

  question

  carj asked Jun 1, 2022 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  RateLimitGuard.authenticate() authentication failure

  question

  troloff asked Apr 2, 2022 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How to scale Heritrix with Kubernetes?

  question

  naveen17797 asked Feb 15, 2022 in Q&A · Unanswered

  

  

  0