RexUniNLU模型多线程调用报错

[zhangkesheng]

import time

from fastapi import FastAPI
from modelscope.pipelines import pipeline
from pydantic import BaseModel

semantic_cls = pipeline('rex-uninlu',
                        model='damo/nlp_deberta_rex-uninlu_chinese-base',
                        model_revision='v1.2.1')

app = FastAPI()


class Item(BaseModel):
    input: str
    fields: object


@app.post("/damo/rex-uninlu")
def uie(item: Item):
    start = time.time()
    return {
        'data': semantic_cls(input=item.input, schema=item.fields),
        'took': time.time() - start
    }

用FastAPI对外提供了接口, 在阿里云FC里部署, 实例并发度10, 多线程调用的时候就会出现下面的报错

Pipeline related: @Firmament-cyou @wenmengzhou

[github-actions]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.