feat: Add support for a LocalBackend Tinker model service #499
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…pport - Updated Python version requirement from 3.10 to 3.11 in .python-version and pyproject.toml. - Added new dependencies: tinker, tinker-cookbook, polars, and tblib. - Introduced TinkerBackend and TinkerService classes for enhanced model training capabilities. - Refactored model configuration to include TinkerArgs and TinkerTrainingClientArgs. - Updated training input handling to support new configurations. - Adjusted various model and backend components to accommodate the new Tinker integration.
- Updated the return statement in TinkerService to return the correct mean policy loss instead of the policy loss sum.
…r port management - Updated Qwen3InstructRenderer to correctly handle "args" instead of "arguments" in tool calls. - Refactored server startup to dynamically find a free port starting from 8000. - Removed unused server attribute from TinkerService and streamlined server initialization.
- Added TinkerBackend and TinkerService classes to support Tinker model training. - Updated LocalBackend to utilize TinkerService for checkpoint management. - Modified pyproject.toml to include "tinker" as a known third-party library. - Refactored yes-no-maybe.py to remove unnecessary parameters in LocalBackend instantiation. - Introduced new files for Tinker backend and service implementations, including methods for model registration, training, and checkpoint management.
- Modified LocalBackend initialization to set in_process=True, enabling in-process execution for improved performance and resource management.
- Introduced a boolean variable to check for Tinker arguments, improving readability. - Updated process name assignment for service management based on Tinker integration.
- Deleted the TinkerBackend class and its associated methods, as it was not implemented and not in use. - This cleanup helps streamline the codebase by removing unused components related to Tinker model handling.
…vice - Updated assertions in LocalBackend and TinkerService to enhance readability by consolidating multi-line assertions into single-line statements with formatted error messages.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.