[Fix] Fix the problem that ham_head cannot be executed on NPU.

[Ginray]

Motivation

The original code only considered the case that the device is cuda and cpu, when executed on other devices, coredump occurs.

Modification

Modified the _build_bases function to be compatible with different types of devices.

Checklist

1. Pre-commit or other linting tools are used to fix the potential lint issues.
2. The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
3. If the modification has potential influence on downstream projects, this PR should be tested with downstream projects, like MMDet or MMDet3D.
4. The documentation has been modified accordingly, like docstring or example tutorials.

[CLAassistant]

All committers have signed the CLA.