feat(integrations): port OpenAI WandbLogger for openai-python v1.0

[ayulockin]

Description

• Fixes WB-NNNNN
• Fixes #NNNN

What does the PR do?

This PR ports the the existing WandbLogger.sync() to wandb to make it work with openai v1.0.

The WandbLogger has the following features:

• syncs the metrics to a W&B run
• logs training and validation data as artifact and table
• tracks the configs
• works with openai v0.28.1

During the rewrite of the openai-python repo, the authors had decided that this logger should live in the wandb python package instead of the openai package. Check out the discussion here.

This PR ports the logic to this repo in the from wandb.integration.openai import WandbLogger namespace (subject to change). The implementation removes support for any openai legacy functionality and will work with v1.0.

TODO:

• formatting
• documentation
• tests?
• minor fixes to W&B Tables logging logic

🤖 Generated by Copilot at ce4ee24

This pull request adds a new module wandb.integration.openai that provides a class WandbLogger to integrate wandb and openai fine-tuning. It also adds a test script test_openai_finetune.py that uses the class to sync a specific fine-tuning job with wandb. The module and the script are commented and documented.

Testing

How was this PR tested?

🤖 Generated by Copilot at ce4ee24

WandbLogger class
Syncs openai fine-tuning
With wandb platform

[codecov]

Codecov Report

Merging #6498 (c7e2636) into main (7a705a9) will decrease coverage by 0.35%.
Report is 1 commits behind head on main.
The diff coverage is 0.00%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #6498      +/-   ##
==========================================
- Coverage   79.48%   79.13%   -0.35%     
==========================================
  Files         415      416       +1     
  Lines       47737    47958     +221     
==========================================
+ Hits        37943    37953      +10     
- Misses       9582     9790     +208     
- Partials      212      215       +3     

Flag	Coverage Δ
func	52.45% <0.00%> (-0.43%)	⬇️
system	63.82% <0.00%> (+0.51%)	⬆️
unit	60.73% <0.00%> (-0.46%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
wandb/integration/openai/__init__.py	0.00% <0.00%> (ø)
wandb/integration/openai/fine_tune.py	0.00% <0.00%> (ø)

... and 40 files with indirect coverage changes

[ayulockin]

Hey @kptkin, do let me know if anything else is needed from my end to get this PR merged? Also thanks for all the detailed feedback.

[ayulockin]

Hey @kptkin, the PR is ready from my end. Do let me know if anything else is needed. :)

[kptkin]

👍