Skip to content

Commit 5ae1f35

Browse files
ikxplainahmetgunduzayberkjsbasitaneeslucas-aixplain
authored
Development (#694)
* Test to dev sync (#678) * Update main.yaml (#640) * Hotfix add docs (#641) * set max iteration to 30 if single agent has tasks - equivalent to teamagent * Updated readme * inspector warning added * Added API reference docs and generation script/configuration files --------- Co-authored-by: Ayberk Demir <ayberkdemir1903@hotmail.com> * Update README.md * HOTFIX: BUG-616 added pagination to get model by ids (#643) * Remove model deletion from tests (#644) * HOTFIX: Utility-function-bug-in-input-parsing (#648) * HOTFIX: Add time delay before searching indexes in tests (#646) * Dev to test (#660) * Merge to prod (#530) * Merge to test (#246) * Update Finetuner search metadata functional tests (#172) * Downgrade dataclasses-json for compatibility (#170) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix model cost parameters (#179) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Treat label URLs (#176) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Add new metric test (#181) * Add new metric test * Enable testing new pipeline executor --------- Co-authored-by: Thiago Castro Ferreira <thiago@aixplain.com> * LLMModel class and parameters (#184) * LLMModel class and parameters * Change in the documentation * Changing LLMModel for LLM * Remove frequency penalty --------- Co-authored-by: Thiago Castro Ferreira <thiago@aixplain.com> * Gpus (#185) * Release. (#141) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge to test (#135) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Merge dev to test (#137) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Merge to prod. (#152) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * A…
1 parent 9c84c3b commit 5ae1f35

File tree

7 files changed

+131
-31
lines changed

7 files changed

+131
-31
lines changed

aixplain/factories/agent_factory/__init__.py

Lines changed: 43 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,4 @@
1-
__author__ = "lucaspavanelli"
2-
3-
"""
4-
Copyright 2024 The aiXplain SDK authors
1+
"""Copyright 2024 The aiXplain SDK authors.
52
63
Licensed under the Apache License, Version 2.0 (the "License");
74
you may not use this file except in compliance with the License.
@@ -21,6 +18,8 @@
2118
Agent Factory Class
2219
"""
2320

21+
__author__ = "lucaspavanelli"
22+
2423
import json
2524
import logging
2625
import warnings
@@ -49,6 +48,19 @@
4948
from aixplain.enums import DatabaseSourceType
5049

5150

51+
def to_literal_text(x):
52+
"""Convert value to literal text, escaping braces for string formatting.
53+
54+
Args:
55+
x: Value to convert (dict, list, or any other type)
56+
57+
Returns:
58+
str: Escaped string representation
59+
"""
60+
s = json.dumps(x, ensure_ascii=False, indent=2) if isinstance(x, (dict, list)) else str(x)
61+
return s.replace("{", "{{").replace("}", "}}")
62+
63+
5264
class AgentFactory:
5365
"""Factory class for creating and managing agents in the aiXplain system.
5466
@@ -90,9 +102,11 @@ def create(
90102
api_key (Text, optional): team/user API key. Defaults to config.TEAM_API_KEY.
91103
supplier (Union[Dict, Text, Supplier, int], optional): owner of the agent. Defaults to "aiXplain".
92104
version (Optional[Text], optional): version of the agent. Defaults to None.
105+
tasks (List[WorkflowTask], optional): Deprecated. Use workflow_tasks instead. Defaults to None.
93106
workflow_tasks (List[WorkflowTask], optional): list of tasks for the agent. Defaults to [].
94107
output_format (OutputFormat, optional): default output format for agent responses. Defaults to OutputFormat.TEXT.
95108
expected_output (Union[BaseModel, Text, dict], optional): expected output. Defaults to None.
109+
96110
Returns:
97111
Agent: created Agent
98112
"""
@@ -133,7 +147,8 @@ def create(
133147

134148
if tasks is not None:
135149
warnings.warn(
136-
"The 'tasks' parameter is deprecated and will be removed in a future version. " "Use 'workflow_tasks' instead.",
150+
"The 'tasks' parameter is deprecated and will be removed in a future version. "
151+
"Use 'workflow_tasks' instead.",
137152
DeprecationWarning,
138153
stacklevel=2,
139154
)
@@ -144,8 +159,8 @@ def create(
144159
payload = {
145160
"name": name,
146161
"assets": [build_tool_payload(tool) for tool in tools],
147-
"description": description,
148-
"instructions": instructions or description,
162+
"description": to_literal_text(description),
163+
"instructions": to_literal_text(instructions) if instructions is not None else description,
149164
"supplier": supplier,
150165
"version": version,
151166
"llmId": llm_id,
@@ -228,6 +243,17 @@ def create_workflow_task(
228243
expected_output: Text,
229244
dependencies: Optional[List[Text]] = None,
230245
) -> WorkflowTask:
246+
"""Create a new workflow task for an agent.
247+
248+
Args:
249+
name (Text): Name of the task
250+
description (Text): Description of what the task does
251+
expected_output (Text): Expected output format or content
252+
dependencies (Optional[List[Text]], optional): List of task names this task depends on. Defaults to None.
253+
254+
Returns:
255+
WorkflowTask: Created workflow task object
256+
"""
231257
dependencies = [] if dependencies is None else list(dependencies)
232258
return WorkflowTask(
233259
name=name,
@@ -238,6 +264,11 @@ def create_workflow_task(
238264

239265
@classmethod
240266
def create_task(cls, *args, **kwargs):
267+
"""Create a workflow task (deprecated - use create_workflow_task instead).
268+
269+
.. deprecated::
270+
Use :meth:`create_workflow_task` instead.
271+
"""
241272
warnings.warn(
242273
"The 'create_task' method is deprecated and will be removed in a future version. "
243274
"Use 'create_workflow_task' instead.",
@@ -351,7 +382,7 @@ def create_sql_tool(
351382
tables: Optional[List[Text]] = None,
352383
enable_commit: bool = False,
353384
) -> SQLTool:
354-
"""Create a new SQL tool
385+
"""Create a new SQL tool.
355386
356387
Args:
357388
name (Text): name of the tool
@@ -361,6 +392,7 @@ def create_sql_tool(
361392
schema (Optional[Text], optional): database schema description
362393
tables (Optional[List[Text]], optional): table names to work with (optional)
363394
enable_commit (bool, optional): enable to modify the database (optional)
395+
364396
Returns:
365397
SQLTool: created SQLTool
366398
@@ -403,7 +435,9 @@ def create_sql_tool(
403435
# Already the correct type, no conversion needed
404436
pass
405437
else:
406-
raise SQLToolError(f"Source type must be either a string or DatabaseSourceType enum, got {type(source_type)}")
438+
raise SQLToolError(
439+
f"Source type must be either a string or DatabaseSourceType enum, got {type(source_type)}"
440+
)
407441

408442
database_path = None # Final database path to pass to SQLTool
409443

aixplain/factories/team_agent_factory/__init__.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -227,10 +227,13 @@ def _setup_llm_and_tool(
227227
team_agent = build_team_agent(payload=internal_payload, agents=agent_list, api_key=api_key)
228228
team_agent.validate(raise_exception=True)
229229
response = "Unspecified error"
230+
inspectors=team_agent.inspectors
231+
inspector_targets=team_agent.inspector_targets
230232
try:
231233
payload["inspectors"] = [
232234
inspector.model_dump(by_alias=True) for inspector in inspectors
233-
] # convert Inspector object to dict
235+
]
236+
payload["inspectorTargets"] = inspector_targets
234237
logging.debug(f"Start service for POST Create TeamAgent - {url} - {headers} - {json.dumps(payload)}")
235238
r = _request_with_retry("post", url, headers=headers, json=payload)
236239
response = r.json()

aixplain/factories/team_agent_factory/utils.py

Lines changed: 47 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,11 +10,12 @@
1010
from aixplain.modules.agent.agent_task import AgentTask
1111
from aixplain.modules.agent.tool.model_tool import ModelTool
1212
from aixplain.modules.team_agent import TeamAgent, InspectorTarget
13-
from aixplain.modules.team_agent.inspector import Inspector
13+
from aixplain.modules.team_agent.inspector import Inspector, InspectorAction, InspectorAuto, InspectorPolicy, InspectorOutput
1414
from aixplain.factories.agent_factory import AgentFactory
1515
from aixplain.factories.model_factory import ModelFactory
1616
from aixplain.modules.model.model_parameters import ModelParameters
1717
from aixplain.modules.agent.output_format import OutputFormat
18+
from aixplain.modules.model.response import ModelResponse
1819

1920
GPT_4o_ID = "6646261c6eb563165658bbb1"
2021
SUPPORTED_TOOLS = ["llm", "website_search", "website_scrape", "website_crawl", "serper_search"]
@@ -154,6 +155,51 @@ def get_cached_model(model_id: str) -> any:
154155
elif tool["description"] == "mentalist":
155156
mentalist_llm = llm
156157

158+
resolved_model_id = payload.get("llmId", None)
159+
if not resolved_model_id:
160+
resolved_model_id = GPT_4o_ID
161+
has_quality_check = any(
162+
(getattr(ins, "name", "") or "").lower() == "qualitycheckinspector"
163+
for ins in inspectors
164+
)
165+
if not has_quality_check:
166+
try:
167+
def process_response(model_response: ModelResponse, input_content: str) -> InspectorOutput:
168+
critiques = model_response.data
169+
action = InspectorAction.RERUN
170+
return InspectorOutput(critiques=critiques, content_edited=input_content, action=action)
171+
172+
default_inspector = Inspector(
173+
name="QualityCheckInspector",
174+
model_id=resolved_model_id,
175+
model_params={"prompt": "Analyze content to ensure correctness of response"},
176+
policy=process_response
177+
)
178+
179+
inspectors = [default_inspector] + inspectors
180+
inspector_targets = payload.get("inspectorTargets", inspector_targets if 'inspector_targets' in locals() else [])
181+
if isinstance(inspector_targets, (str, InspectorTarget)):
182+
inspector_targets = [inspector_targets]
183+
normalized = []
184+
for t in inspector_targets:
185+
if isinstance(t, InspectorTarget):
186+
normalized.append(t)
187+
elif isinstance(t, str):
188+
try:
189+
normalized.append(InspectorTarget(t.lower()))
190+
except Exception:
191+
logging.warning(f"Ignoring unknown inspector target: {t!r}")
192+
else:
193+
logging.warning(f"Ignoring inspector target with unexpected type: {type(t)}")
194+
195+
if InspectorTarget.STEPS not in normalized:
196+
normalized.append(InspectorTarget.STEPS)
197+
198+
inspector_targets = normalized
199+
200+
except Exception as e:
201+
logging.warning(f"Failed to add default QualityCheckInspector: {e}")
202+
157203
team_agent = TeamAgent(
158204
id=payload.get("id", ""),
159205
name=payload.get("name", ""),

aixplain/modules/agent/__init__.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -325,6 +325,7 @@ def run(
325325
output_format (OutputFormat, optional): response format. If not provided, uses the format set during initialization.
326326
expected_output (Union[BaseModel, Text, dict], optional): expected output. Defaults to None.
327327
trace_request (bool, optional): return the request id for tracing the request. Defaults to False.
328+
328329
Returns:
329330
Dict: parsed output from model
330331
"""
@@ -427,6 +428,7 @@ def run_async(
427428
output_format (ResponseFormat, optional): response format. Defaults to TEXT.
428429
evolve (Union[Dict[str, Any], EvolveParam, None], optional): evolve the agent configuration. Can be a dictionary, EvolveParam instance, or None.
429430
trace_request (bool, optional): return the request id for tracing the request. Defaults to False.
431+
430432
Returns:
431433
dict: polling URL in response
432434
"""
@@ -490,7 +492,7 @@ def run_async(
490492
input_data = process_variables(query, data, parameters, self.instructions)
491493
if expected_output is None:
492494
expected_output = self.expected_output
493-
if expected_output is not None and issubclass(expected_output, BaseModel):
495+
if expected_output is not None and isinstance(expected_output, type) and issubclass(expected_output, BaseModel):
494496
expected_output = expected_output.model_json_schema()
495497
expected_output = normalize_expected_output(expected_output)
496498
# Use instance output_format if none provided

aixplain/modules/model/llm_model.py

Lines changed: 32 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,4 @@
1-
__author__ = "lucaspavanelli"
2-
3-
"""
4-
Copyright 2024 The aiXplain SDK authors
1+
"""Copyright 2024 The aiXplain SDK authors.
52
63
Licensed under the Apache License, Version 2.0 (the "License");
74
you may not use this file except in compliance with the License.
@@ -20,6 +17,8 @@
2017
Description:
2118
Large Language Model Class
2219
"""
20+
21+
__author__ = "lucaspavanelli"
2322
import time
2423
import logging
2524
import traceback
@@ -63,7 +62,7 @@ def __init__(
6362
function: Optional[Function] = None,
6463
is_subscribed: bool = False,
6564
cost: Optional[Dict] = None,
66-
temperature: float = 0.001,
65+
temperature: Optional[float] = None,
6766
function_type: Optional[FunctionType] = FunctionType.AI,
6867
**additional_info,
6968
) -> None:
@@ -79,14 +78,16 @@ def __init__(
7978
function (Function, optional): Model's AI function. Must be Function.TEXT_GENERATION.
8079
is_subscribed (bool, optional): Whether the user is subscribed. Defaults to False.
8180
cost (Dict, optional): Cost of the model. Defaults to None.
82-
temperature (float, optional): Default temperature for text generation. Defaults to 0.001.
81+
temperature (Optional[float], optional): Default temperature for text generation. Defaults to None.
8382
function_type (FunctionType, optional): Type of the function. Defaults to FunctionType.AI.
8483
**additional_info: Any additional model info to be saved.
8584
8685
Raises:
8786
AssertionError: If function is not Function.TEXT_GENERATION.
8887
"""
89-
assert function == Function.TEXT_GENERATION, "LLM only supports large language models (i.e. text generation function)"
88+
assert function == Function.TEXT_GENERATION, (
89+
"LLM only supports large language models (i.e. text generation function)"
90+
)
9091
super().__init__(
9192
id=id,
9293
name=name,
@@ -112,12 +113,13 @@ def run(
112113
history: Optional[List[Dict]] = None,
113114
temperature: Optional[float] = None,
114115
max_tokens: int = 128,
115-
top_p: float = 1.0,
116+
top_p: Optional[float] = None,
116117
name: Text = "model_process",
117118
timeout: float = 300,
118119
parameters: Optional[Dict] = None,
119120
wait_time: float = 0.5,
120121
stream: bool = False,
122+
response_format: Optional[Text] = None,
121123
) -> Union[ModelResponse, ModelResponseStreamer]:
122124
"""Run the LLM model synchronously to generate text.
123125
@@ -138,8 +140,8 @@ def run(
138140
Defaults to None.
139141
max_tokens (int, optional): Maximum number of tokens to generate.
140142
Defaults to 128.
141-
top_p (float, optional): Nucleus sampling parameter. Only tokens with cumulative
142-
probability < top_p are considered. Defaults to 1.0.
143+
top_p (Optional[float], optional): Nucleus sampling parameter. Only tokens with cumulative
144+
probability < top_p are considered. Defaults to None.
143145
name (Text, optional): Identifier for this model run. Useful for logging.
144146
Defaults to "model_process".
145147
timeout (float, optional): Maximum time in seconds to wait for completion.
@@ -150,6 +152,8 @@ def run(
150152
Defaults to 0.5.
151153
stream (bool, optional): Whether to stream the model's output tokens.
152154
Defaults to False.
155+
response_format (Optional[Union[str, dict, BaseModel]], optional):
156+
Specifies the desired output structure or format of the model’s response.
153157
154158
Returns:
155159
Union[ModelResponse, ModelResponseStreamer]: If stream=False, returns a ModelResponse
@@ -166,9 +170,13 @@ def run(
166170
parameters.setdefault("context", context)
167171
parameters.setdefault("prompt", prompt)
168172
parameters.setdefault("history", history)
169-
parameters.setdefault("temperature", temperature if temperature is not None else self.temperature)
173+
temp_value = temperature if temperature is not None else self.temperature
174+
if temp_value is not None:
175+
parameters.setdefault("temperature", temp_value)
170176
parameters.setdefault("max_tokens", max_tokens)
171-
parameters.setdefault("top_p", top_p)
177+
if top_p is not None:
178+
parameters.setdefault("top_p", top_p)
179+
parameters.setdefault("response_format", response_format)
172180

173181
if stream:
174182
return self.run_stream(data=data, parameters=parameters)
@@ -210,9 +218,10 @@ def run_async(
210218
history: Optional[List[Dict]] = None,
211219
temperature: Optional[float] = None,
212220
max_tokens: int = 128,
213-
top_p: float = 1.0,
221+
top_p: Optional[float] = None,
214222
name: Text = "model_process",
215223
parameters: Optional[Dict] = None,
224+
response_format: Optional[Text] = None,
216225
) -> ModelResponse:
217226
"""Run the LLM model asynchronously to generate text.
218227
@@ -233,12 +242,14 @@ def run_async(
233242
Defaults to None.
234243
max_tokens (int, optional): Maximum number of tokens to generate.
235244
Defaults to 128.
236-
top_p (float, optional): Nucleus sampling parameter. Only tokens with cumulative
237-
probability < top_p are considered. Defaults to 1.0.
245+
top_p (Optional[float], optional): Nucleus sampling parameter. Only tokens with cumulative
246+
probability < top_p are considered. Defaults to None.
238247
name (Text, optional): Identifier for this model run. Useful for logging.
239248
Defaults to "model_process".
240249
parameters (Optional[Dict], optional): Additional model-specific parameters.
241250
Defaults to None.
251+
response_format (Optional[Text], optional): Desired output format specification.
252+
Defaults to None.
242253
243254
Returns:
244255
ModelResponse: A response object containing:
@@ -261,9 +272,13 @@ def run_async(
261272
parameters.setdefault("context", context)
262273
parameters.setdefault("prompt", prompt)
263274
parameters.setdefault("history", history)
264-
parameters.setdefault("temperature", temperature if temperature is not None else self.temperature)
275+
temp_value = temperature if temperature is not None else self.temperature
276+
if temp_value is not None:
277+
parameters.setdefault("temperature", temp_value)
265278
parameters.setdefault("max_tokens", max_tokens)
266-
parameters.setdefault("top_p", top_p)
279+
if top_p is not None:
280+
parameters.setdefault("top_p", top_p)
281+
parameters.setdefault("response_format", response_format)
267282
payload = build_payload(data=data, parameters=parameters)
268283
response = call_run_endpoint(payload=payload, url=url, api_key=self.api_key)
269284
return ModelResponse(

aixplain/modules/team_agent/inspector.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,7 @@ class InspectorOutput(BaseModel):
5858

5959
class InspectorAuto(str, Enum):
6060
"""A list of keywords for inspectors configured automatically in the backend."""
61-
61+
ALIGNMENT = "alignment"
6262
CORRECTNESS = "correctness"
6363

6464
def get_name(self) -> Text:

tests/functional/agent/agent_functional_test.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -122,7 +122,7 @@ def test_python_interpreter_tool(delete_agents_and_team_agents, AgentFactory):
122122
assert len(response["data"]["intermediate_steps"]) > 0
123123
intermediate_step = response["data"]["intermediate_steps"][0]
124124
assert len(intermediate_step["tool_steps"]) > 0
125-
assert intermediate_step["tool_steps"][0]["tool"] == "Custom Code Tool"
125+
assert intermediate_step["tool_steps"][0]["tool"] == "Python Code Interpreter Tool"
126126
agent.delete()
127127

128128

0 commit comments

Comments
 (0)