[Feat] Expand Python support

[izzet]

This pull request adds support for Python 3.12 across the project, updates dependencies to support newer versions, and improves the CI workflow logic for test selection and naming. These changes ensure broader compatibility and cleaner, more maintainable CI/CD processes.

Python 3.12 Support and Compatibility

• Added Python 3.12 to the test matrix in both .github/workflows/ci.yml and .github/workflows/cd.yml to ensure CI/CD runs against Python 3.12. [1] [2]
• Updated pyproject.toml to allow Python versions up to 3.12 (requires-python = ">3.8, <3.13") and added Python 3.12 to the classifiers. [1] [2]

Dependency Updates

• Updated several dependencies in pyproject.toml to support newer versions, including relaxing version constraints for dask_jobqueue, updating numpy to >=2.0.0, and requiring pandas>=2.2.0.

CI Workflow Improvements

• Refactored the test type selection in .github/workflows/ci.yml for clarity: replaced run_full boolean with a test_type output (smoke or full), and updated downstream steps to use this new variable. [1] [2]
• Restricted the C++ tooling tests to run only when the full test suite is selected, making the workflow more efficient.

[rayandrew]

looks good to me

[hariharan-devarajan]

Looks good.