Assignment 2

Assignment Overview

New must have features

• New feature to allow concurrent crawling (and optionally also translation) of multiple websites. Given two or more URLs as input to your program, your solution should concurrently gather the data for the websites and their referenced websites. In the end, you should combine the results for each website in a single report while retaining the original structure of the websites.
• Implement proper and clean error handling. Various errors might occur when crawling and/or translating a website. Protect your application against crashing by handling the errors and informing the user by logging the error in the report.
• The dependencies on third-party libraries, e.g., jsoup, should be small to allow future updates or even replacements of the third-party libraries.

Implementation

Keep in mind the guidelines presented in the course and make sure that (most of) your code respects the SRP, OCP, and DIP, or at least keep the violations as small as possible. Regarding the dependencies to third-party libraries, use the principles presented in the book to define and implement these boundaries. Also, provide clean tests to verify that your solution correctly implements the features (make sure to write clean and testable code). As for Assignment 1, the repository needs to contain a README file that briefly states the steps to build, run, and test your crawler.

---

What's Changed

• Feat: Implemenation of Colored System Messages by @Marty-Byrde in #9
• Refactor: Improved the Quality of the Codebase by @Marty-Byrde in #10
• Feat: Implementation of Concurrent Crawling by @Marty-Byrde in #11
• Refactor: Improved the Quality of the Codebase by @Marty-Byrde in #12
• Refactor: Updated ReadMe to include new changes by @Marty-Byrde in #13
• Feat: Created JsoupAdapter that wraps the Jsoup-Dependency by @Marty-Byrde in #14
• Refactor: Improved the Quality of the Codebase by @Marty-Byrde in #15
• Tests: implemented tests for the Crawler class by @bensuppanz in #19
• Tests: implemented test for the InputValidation class by @bensuppanz in #18
• Tests: implemented test for the Configuration class by @bensuppanz in #17
• Tests: implemented tests for JsoupAdapter by @bensuppanz in #16

Full Changelog: assignment-1...assignment-2

Assignment 1

What's Changed

• Chore: Configuration of the Project + Dependency Installation by @Marty-Byrde in #1
• Feat: Implementation of the Crawler Configuration and Prompting by @Marty-Byrde in #2
• Feat: Implementation of the Translation Functionality by @Marty-Byrde in #3
• Feat: Implementation of the Page Crawling process by @Marty-Byrde in #4
• Feat: Implementation of functionality to generate reports for a crawled URL by @bensuppanz in #6
• Docs: Added a Comment to the Configuration Class regarding the Usage-Limits of the API Token by @Marty-Byrde in #5
• Docs: added README.md by @bensuppanz in #7
• refactor: Removed unnecessary Translation Test-Case by @Marty-Byrde in #8

Full Changelog: https://github.com/Marty-Byrde/Clean-Code/commits/assignment-1