fix(generator): respect options.router.trailingSlash for crawler

[manniL]

Types of changes

• Bug fix (a non-breaking change which fixes an issue)

Description

When crawling and enforcing a trailing slash, all pages will be crawled twice because the trailing slash is skipped. This also leads to massive errors because pages without trailing slashes can't be generated (as they throw a 404 when enforcing a trailing slash)

[codecov-commenter]

Codecov Report

Merging #7431 into dev will decrease coverage by 0.03%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##              dev    #7431      +/-   ##
==========================================
- Coverage   70.26%   70.22%   -0.04%     
==========================================
  Files          88       88              
  Lines        3696     3698       +2     
  Branches     1008     1009       +1     
==========================================
  Hits         2597     2597              
- Misses        892      893       +1     
- Partials      207      208       +1     

Flag	Coverage Δ
#unittests	70.22% <0.00%> (-0.04%)	⬇️

Impacted Files	Coverage Δ
packages/generator/src/generator.js	85.42% <0.00%> (-0.87%)	⬇️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2e711c1...981b474. Read the comment docs.

[pi0]

Thanks! Seems we need a utility for trailing slash asap