feat: support loader-runner and pitching

[h-a-n-a]

Related issue (if exists)

closes #2394
closes #1750
closes #1751

Summary

This PR refactors the loader architecture and adapts webpack's loader-runner to rspack.
Pitching loader is supported for both Rust and JS side from now on.

The old architecture is a quite simple version, which only supports loaders for normal stage.
Pitching loader does not put into consideration. The basic concept of the old version is to
convert the normal loader to a native function which can be called from the Rust side.
Furthermore, for performance reason, Rspack also composes loaders from the JS side to
mitigate the performance issue of Node/Rust communications.

In this new architecture, loaders will not be converted directly into native functions.
Instead, it is almost the same with how webpack's loader-runner resolves its loaders, by
leveraging the identifier. Every time Rspack wants to invoke a JS loader, the identifiers will
be passed to the handler passed by Node side to process. The implementation also keeps
the feature of composing JS loaders for performance reason.

See #2846 for more details on the architecture.

Tracking PRs:

• feat: impl new loader-runner for preparing to support vue-loader and pitching loader #2789

🤖 Generated by Copilot at 2c6ea7c

This pull request refactors the rspack_core and rspack_loader_runner crates to use a new ResolverFactory abstraction for resolving module dependencies and a new run_loaders function for running loaders. It also adds support for more complex resource URLs, loaders, and modules, and implements hot module replacement (HMR) for modules. It removes unused and outdated code and simplifies the code with the derivative crate.

Walkthrough

🤖 Generated by Copilot at 2c6ea7c

• Remove the LoaderRunnerRunner type and replace it with the ResolverFactory type and the run_loaders function to simplify the loader running and resolving logic (link, link, link, link, link, link, link, link, link, link, link, link, link, link, link, link, link, link)
• Add the CompilerContext type and the BuildContext type to hold the common compiler options and the ResolverFactory instance that are used by different modules and loaders (link, link)
• Add the LoaderRunnerPluginProcessResource type and use it in the NormalModule struct to support plugin hooks for the loader runner (link, link)
• Add the resource_fragment, resource_query, and resource_path fields to the ResourceData struct to support more complex resource URLs and parameters (link)
• Modify the identifier method of the NormalModuleFactory struct to use the identifier method of the Loader trait instead of the name method to support more complex and dynamic loaders and modules (link)
• Add the derivative crate and the Derivative derive macro to customize the Debug implementation for some structs and enums in the rspack_core crate (link, link, link, link, link, link, link)
• Rename the rspack_loader_runner2 crate to rspack_loader_runner and update the rspack_core crate to use the new version (link, link)
• Delete the old version of the rspack_loader_runner crate and its files (link, link, link, link, link, link, link, link)

[changeset-bot]

🦋 Changeset detected

Latest commit: 303b79b

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages

Name	Type
@rspack/binding	Patch
@rspack/postcss-loader	Patch
@rspack/core	Patch
webpack-test	Patch
@rspack/cli	Patch
@rspack/dev-middleware	Patch
@rspack/dev-server	Patch
@rspack/plugin-html	Patch
benchmarkcase-rspack-react-refresh	Patch
@rspack/dev-client	Patch
@rspack/plugin-minify	Patch
@rspack/plugin-node-polyfill	Patch
@rspack/binding-darwin-arm64	Patch
@rspack/binding-darwin-x64	Patch
@rspack/binding-linux-x64-gnu	Patch
@rspack/binding-win32-x64-msvc	Patch
@rspack/fs	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[hardfist]

it would be better if we have a example about pitching loader

[hardfist]

!bench

[h-a-n-a]

it would be better if we have a example about pitching loader

@hardfist Pitching loader is often used with inline loaders to initiate a new loader pipeline like how style-loader did, rspack does not support inline loaders now, I would like to add an example after style-loader or something else is supported.

[github-actions]

Benchmark Results

group                                                 baseline                               pr
-----                                                 --------                               --
criterion_benchmark/ten_copy_of_threejs               1.00       2.3±0.07s        ? ?/sec    1.02       2.3±0.06s        ? ?/sec
high_cost_benchmark/ten_copy_of_threejs_production    1.02       7.5±0.09s        ? ?/sec    1.00       7.4±0.10s        ? ?/sec