[chatglm] Add taskflow static load

[w5688414]

PR types

PR changes

Description

prefix predict

import time
from paddlenlp import Taskflow
chatbot = Taskflow("text2text_generation", batch_size=2, is_static_model=True,static_mode=True,prefix=True, dtype='float16', task_path='./inference_static')
import numpy as np
pre_caches_numpy = np.load("./prefix_tuning/pre_caches.npy")
message = "小明有15本漫画书，他每天阅读3本。请问他可以连续阅读几天？"
for i in range(10):
    start = time.perf_counter()
    output = chatbot(message,pre_caches_numpy = pre_caches_numpy)
    hf_cost = (time.perf_counter() - start) * 1000
    print("Speed Paddle:", hf_cost)
    print(len(output['result'][0]))
    print(output['result'][0])

Normal Usage

import time
from paddlenlp import Taskflow
chatbot = Taskflow("text2text_generation", batch_size=2,is_static_model=True,static_mode=True, dtype='float16', task_path='./inference_chatglm_static')
message = "强改写：一群蚂蚁士兵冲向一块披萨"
for i in range(10):
    start = time.perf_counter()
    output = chatbot(message)
    hf_cost = (time.perf_counter() - start) * 1000
    print("Speed Paddle:", hf_cost)
    print(len(output['result'][0]))
    print(output['result'][0])

静态图的目录结构，名字必须以inference开头：

inference_chatglm_static/
├── ice_text.model
├── inference.pdiparams
├── inference.pdiparams.info
├── inference.pdmodel
├── special_tokens_map.json
└── tokenizer_config.json

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Merging #6180 (fabc613) into develop (818e1a1) will decrease coverage by 0.03%.
The diff coverage is 27.77%.

@@             Coverage Diff             @@
##           develop    #6180      +/-   ##
===========================================
- Coverage    62.95%   62.93%   -0.03%     
===========================================
  Files          526      526              
  Lines        76354    76414      +60     
===========================================
+ Hits         48069    48089      +20     
- Misses       28285    28325      +40     

Impacted Files	Coverage Δ
paddlenlp/taskflow/text2text_generation.py	62.50% <16.66%> (-10.50%)	⬇️
paddlenlp/taskflow/task.py	60.77% <75.00%> (-3.45%)	⬇️
paddlenlp/taskflow/taskflow.py	84.88% <100.00%> (ø)

... and 5 files with indirect coverage changes

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。