Skip to content

Commit

Permalink
Add GMC chatqna benchmark script (#64)
Browse files Browse the repository at this point in the history
* Add GMC chatqna benchmark script

Signed-off-by: Li Gang <gang.g.li@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Li Gang <gang.g.li@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
gavinlichn and pre-commit-ci[bot] authored Aug 21, 2024
1 parent 1004d5b commit 6a390da
Showing 1 changed file with 23 additions and 0 deletions.
23 changes: 23 additions & 0 deletions evals/benchmark/stresscli/locust/gmc_chatqnafixed.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
# Copyright (C) 2024 Intel Corporation
# SPDX-License-Identifier: Apache-2.0

import tokenresponse as token


def getUrl():
return "/"


def getReqData():
return {
"text": "What is the revenue of Nike in last 10 years before 2023? Give me detail,more than 1024 words",
"parameters": {"max_new_tokens": 128, "do_sample": True},
}


def respStatics(environment, resp):
return token.respStatics(environment, resp)


def staticsOutput(environment, reqlist):
token.staticsOutput(environment, reqlist)

0 comments on commit 6a390da

Please sign in to comment.