Add XGBoost integration

[buruzaemon]

Motivation

• For addressing the XGBoost module migration portion of Isolation of optuna integration modules. #4484

Description of the changes

• Migrated optuna/integration/xgboost.py and its corresponding test from tests/integration_tests/test_xgboost.py to optuna_integration/xgboost.py and tests/test_xgboost.py, respectively. Additional related changes were made to update/correct the documentation as well.

[nabenabe0928]

@y0z Could you review this PR?

[y0z]

Thank you for your contribution.
I leave a review comment.

[y0z]

I think one change should be made.

Also, please add XGBoost to init.py as same as other integrations.

[nabenabe0928]

Thank you for your PR, please address my comments:)

[nabenabe0928]

@buruzaemon
Plus, could you please press Resolve conflicts and resolve the conflict?

Basically, the conflict is happening in pyproject.toml, but you can keep both torch and xgboost in pyproject.toml.

After addressing my comments and the conflict resolve, we can merge this PR!

[buruzaemon]

... and finally, resolved that conflict in pyproject.toml. ptal

[codecov]

Codecov Report

Attention: 26 lines in your changes are missing coverage. Please review.

Comparison is base (661aa9c) 65.06% compared to head (3470d9b) 64.92%.

Files	Patch %	Lines
optuna_integration/xgboost.py	60.31%	25 Missing ⚠️
optuna_integration/__init__.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #65      +/-   ##
==========================================
- Coverage   65.06%   64.92%   -0.14%     
==========================================
  Files          25       26       +1     
  Lines        1869     1933      +64     
==========================================
+ Hits         1216     1255      +39     
- Misses        653      678      +25     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[y0z]

@buruzaemon

Could you please apply isort?
https://github.com/optuna/optuna-integration/actions/runs/7824603273/job/21347417916?pr=65

[buruzaemon]

@buruzaemon

Could you please apply isort? https://github.com/optuna/optuna-integration/actions/runs/7824603273/job/21347417916?pr=65

sure, i am on that now...

[nabenabe0928]

@buruzaemon
Here are the changes you should make by isort.

[nabenabe0928]

Suggested change

	import numpy as np
	import pytest
	import optuna
	from optuna_integration._imports import try_import
	from optuna_integration.xgboost import XGBoostPruningCallback
	from optuna.testing.pruners import DeterministicPruner
	import numpy as np
	import optuna
	from optuna.testing.pruners import DeterministicPruner
	import pytest
	from optuna_integration._imports import try_import
	from optuna_integration.xgboost import XGBoostPruningCallback

[buruzaemon]

... and this is done!

[nabenabe0928]

Suggested change

	from typing import Any
	import optuna
	import optuna_integration
	from typing import Any
	import optuna
	import optuna_integration

[buruzaemon]

... and this change to the imports is done as well!

[nabenabe0928]

Thank you for the changes, LGTM!