refactor(sdk): Package wandb with wandb-core

[timoffex]

Description

Includes the wandb-core binary in the wandb wheel, deprecating the wandb-core package.

Now we only have one package!

Some notes:

• We now use hatch to build wandb instead of setuptools
  • I removed the MANIFEST.in files which were for setuptools
• pip install . will compile the wandb-core Go binary
  • This can be turned off by setting the WANDB_BUILD_UNIVERSAL=true environment variable
  • Use pip wheel to build a wheel (this calls python -m build, except it also installs build deps)
  • I removed wini as we no longer need it!
• We now build platform-specific wandb wheels and a universal one
  • Since we continue to build a universal wheel, and since we don't require wandb-core just yet, this should be transparent to all users
  • Users on supported platforms can use wandb.require("core") without any additional installs
  • Everything is set up to allow for uploading source distributions in the future

Testing

Successful release-sdk run: https://github.com/wandb/wandb/actions/runs/8697668570

[socket-security]

New and removed dependencies detected. Learn more about Socket for GitHub ↗︎

Package	New capabilities	Transitives	Size	Publisher
pypi/hatchling@1.23.0	environment, eval, filesystem, network, shell	+2	465 kB	Ofekmeister

🚮 Removed packages: pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/grpcio@1.63.0rc1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/libcst@1.3.1, pypi/pytest-openfiles@0.5.0, pypi/pytest-openfiles@0.5.0, pypi/twine@5.0.0, pypi/twine@5.0.0, pypi/wandb-core@0.17.0b9, pypi/wandb-core@0.17.0b9, pypi/wandb-core@0.17.0b9, pypi/wandb-core@0.17.0b9, pypi/wandb-core@0.17.0b9, pypi/wheel@0.43.0, pypi/wheel@0.43.0

View full report↗︎

[codecov]

Codecov Report

Attention: Patch coverage is 89.47368% with 2 lines in your changes are missing coverage. Please review.

❗ No coverage uploaded for pull request base (main@6a3cc89). Click here to learn what that means.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #7381   +/-   ##
=======================================
  Coverage        ?   67.40%           
=======================================
  Files           ?      517           
  Lines           ?    54509           
  Branches        ?        0           
=======================================
  Hits            ?    36740           
  Misses          ?    17383           
  Partials        ?      386           

Flag	Coverage Δ
func	41.81% <84.21%> (?)
system	57.82% <84.21%> (?)
unit	45.09% <78.94%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
core/pkg/monitor/gpu_apple.go	11.02% <100.00%> (ø)
wandb/__init__.py	95.65% <ø> (ø)
wandb/env.py	79.31% <100.00%> (ø)
wandb/sdk/service/service.py	79.68% <100.00%> (ø)
wandb/util.py	79.08% <75.00%> (ø)

[dmitryduev]

🚀

[kptkin]

Huge milestone!