ENG-1129: aixplain sdk caching functions #324
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
thiago-aixplain
suggested changes
Nov 27, 2024
aixplain/enums/function.py
Outdated
| cache_data = {"timestamp": time.time(), "functions": {"enum": {name: value for name, value in functions.__members__.items()}, "input_output": convert_sets(functions_input_output)}} | ||
| temp_file = CACHE_FILE + ".tmp" | ||
| try: | ||
| os.makedirs(os.path.dirname(CACHE_FILE), exist_ok=True); json_str = json.dumps(cache_data); logging.info(f"Serialized JSON size: {len(json_str)} bytes") |
There was a problem hiding this comment.
Why everything in the same line?
There was a problem hiding this comment.
why do we need to serialize the JSON in bytes? Couldn't you save it using:
import json
with open(CACHE, "w") as f:
json.dump(dictionary, f, indent=4)
There was a problem hiding this comment.
When I used dump it cut off abruptly for some reason, I changed to serialize and then right, that worked and the json files looked more readable too.
There was a problem hiding this comment.
Please investigate this deeply. The outcome is already a JSON as you can see here. My guess is that there is not need to change anything.
aixplain/enums/function.py
Outdated
|
|
||
| def convert_lists_to_sets(obj): |
There was a problem hiding this comment.
Why do we need to do this conversion?
There was a problem hiding this comment.
I had a problem with parsing as I mentioned, I thought this might be related because JSON doesn’t support sets, so I changed the sets to lists when saving. I didn’t test it without this conversion after fixing the issue though. I will test removing the conversion, and if everything works fine without it, I’ll clean it up and remove this function.
aixplain/enums/function.py
Outdated
| import json | ||
| import os | ||
|
|
||
| CACHE_FILE = ".aixplain_cache/functions.json" |
There was a problem hiding this comment.
add these constants into aixplain.utils.config
There was a problem hiding this comment.
Don't forget to add the CACHE_FILE into the right constant place.
aixplain/enums/language.py
Outdated
| os.makedirs(os.path.dirname(CACHE_FILE), exist_ok=True) | ||
| with open(temp_file, "w") as f: | ||
| json.dump(cache_data, f) | ||
| f.flush() |
There was a problem hiding this comment.
why we need to flush?
There was a problem hiding this comment.
I added flush because the code was cutting off the JSON file while writing, and I thought it might help. flush makes sure everything in the program’s write buffer is sent to the file right away as far as I understand, so the file is fully written before anything else happens. Again this was part of my debugging process to ensure the data was saved correctly. I'll check out if it works properly without it, but out of curiosity isn't is usually recommended to have something like this when writing to external files regardless if the function is not running into any issues? Just to make sure that the sequence of actions runs smoothly
aixplain/enums/language.py
Outdated
| CACHE_DURATION = timedelta(hours=24) | ||
|
|
||
|
|
||
| def save_to_cache(languages): |
There was a problem hiding this comment.
Try to create a generic save_to_cache file that could be used across all files.
thiago-aixplain
suggested changes
Nov 28, 2024
aixplain/enums/cache_utils.py
Outdated
There was a problem hiding this comment.
Add this file in this folder: https://github.com/aixplain/aiXplain/tree/main/aixplain/utils
aixplain/enums/function.py
Outdated
| import json | ||
| import os | ||
|
|
||
| CACHE_FILE = ".aixplain_cache/functions.json" |
There was a problem hiding this comment.
Don't forget to add the CACHE_FILE into the right constant place.
thiago-aixplain
changed the title
thiago-aixplain
approved these changes
Dec 3, 2024
ahmetgunduz
referenced
this pull request
Apr 2, 2025
* Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Add new LLMs finetuner models (mistral and solar) (#128) * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Merge to test (#135) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Merge dev to test (#137) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> * Merge to prod. (#130) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key pa…
lucas-aixplain
referenced
this pull request
Apr 3, 2025
* Merge to test (#163) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> * Merge to prod. (#130) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Downgraded click Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: ikxplain <88332269+ikxplain@users.noreply.github.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * M 5905660469 enhance benchmark job response (#145) * added fetching score * add simplified benchmark job scores * add getting failuire rates * added explanations to benchmark * temp push 1 * M 5905660469 enhance benchmark job response (#146) * added fetching score * add simplified benchmark job scores * add getting failuire rates * added explanations to benchmark * temp push 1 * undo temp change * New pipeline functional tests (#143) * New pipeline functional tests * Fixe on attribute name * Fixing test cases --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * M 6107719447 check finetuner status (#133) * Finetune status object * New finetune status checker * Covering some None cases * Finetune status checker updates and new unit tests --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * Update metric.py (#147) * Fixing finetune checker test and doc (#150) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * Skip model onboard and deployment tests (#153) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Saving/Update Pipeline Services (#154) * Saving/Update Pipeline Services * Docstrings for new functions * Pipeline creation unit test --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Do not run service mode tests for specific pipelines (#159) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> * Fix on Metadata (#162) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Shreyas Sharma <85180538+shreyasXplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> * Interval label new structures (#157) * Interval label new structures * Fixes on data type * Docs for onboarding an image label detection corpus * Adding label detection dataset onboarding example in documentation * Fixing documentation link * Pixel to percentage --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> * Development 2 Test - Release 0.2.11 (#165) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-ai…
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.