update: update neighbors.py to use pybind11 instead of daal4py

[yuejiaointel]

Description

Add a comprehensive description of proposed changes

List associated issue number(s) if exist(s): #6 (for example)

Documentation PR (if needed): #1340 (for example)

Benchmarks PR (if needed): IntelPython/scikit-learn_bench#155 (for example)

---

PR should start as a draft, then move to ready for review state after CI is passed and all applicable checkboxes are closed.
This approach ensures that reviewers don't spend extra time asking for regular requirements.

You can remove a checkbox as not applicable only if it doesn't relate to this PR in any way.
For example, PR with docs update doesn't require checkboxes for performance while PR with any change in actual code should have checkboxes and justify how this code change is expected to affect performance (or justification should be self-evident).

Checklist to comply with before moving PR from draft:

PR completeness and readability

• I have reviewed my changes thoroughly before submitting this pull request.
• I have commented my code, particularly in hard-to-understand areas.
• I have updated the documentation to reflect the changes or created a separate PR with update and provided its number in the description, if necessary.
• Git commit message contains an appropriate signed-off-by string (see CONTRIBUTING.md for details).
• I have added a respective label(s) to PR if I have a permission for that.
• I have resolved any merge conflicts that might occur with the base branch.

Testing

• I have run it locally and tested the changes extensively.
• All CI jobs are green or I have provided justification why they aren't.
• I have extended testing suite if new functionality was introduced in this PR.

Performance

• I have measured performance for affected algorithms using scikit-learn_bench and provided at least summary table with measured data, if performance change is expected.
• I have provided justification why performance has changed or why changes are not expected.
• I have provided justification why quality metrics have changed or why changes are not expected.
• I have extended benchmarking suite and provided corresponding scikit-learn_bench PR if new measurable functionality was introduced in this PR.

[icfaust]

@yuejiaointel you are on the right path before the reverts. The design pattern test issues are to be expected. This was a PR which I did a little bit of testing towards it. https://github.com/uxlfoundation/scikit-learn-intelex/pull/2213/files please message me with questions to save time.

[icfaust]

design patterns key off of to_table showing that onedal rather than daal4py was run, but the design of kneighbors is so wrong that now those tests show that the incorrect ordering of operations is occurring with validate_data etc., you'll have to either deselect and make a new ticket, or fix them in this PR.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Flag	Coverage Δ
azure	77.90% <100.00%> (-0.07%)	⬇️
github	70.96% <100.00%> (-0.07%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
onedal/neighbors/neighbors.py	83.50% <100.00%> (-1.61%)	⬇️
sklearnex/neighbors/knn_classification.py	92.59% <100.00%> (+4.49%)	⬆️

... and 13 files with indirect coverage changes

[yuejiaointel]

design patterns key off of to_table showing that onedal rather than daal4py was run, but the design of kneighbors is so wrong that now those tests show that the incorrect ordering of operations is occurring with validate_data etc., you'll have to either deselect and make a new ticket, or fix them in this PR.

Hi Ian,
Thx for the pointers, I can replicate the error locally and I plan to fix it in this PR, and will ask questions later : D
Best
Yue

[yuejiaointel]

/intelci: run ml_benchmarks

[yuejiaointel]

/intelci: run