where is the lightseq.inference Transformer class file?

[VincentChen95]

hello team, I am following the tutorial to load a transformer model with a PB format file.
Code:

import lightseq.inference as lsi
import sys

file_name = sys.argv[1]
model = lsi.Transformer(file_name, 8)
output = model.infer([[1, 2, 3], [4, 5, 6]])

I am trying to understand what parameters we should pass to the "Transformer" class.
However, I cannot find the "Transformer" class in lightseq.inference
could you please tell me where can I find that class?
thank you

[Taka152]

You can check here https://github.com/bytedance/lightseq/blob/4d370305656fe602f8628fc3bc8aa7b81464075b/lightseq/inference/pywrapper/transformer.cc.cu#L39

…

On Fri, Oct 1, 2021 at 7:10 AM Vincent Chen ***@***.***> wrote: hello team, I am following the tutorial to load a transformer model with a PB format file. Code: import lightseq.inference as lsi import sys file_name = sys.argv[1] model = lsi.Transformer(file_name, 8) output = model.infer([[1, 2, 3], [4, 5, 6]]) I am trying to understand what parameters we should pass to the "Transformer" class. However, I cannot find the "Transformer" class in lightseq.inference could you please tell me where can I find that class? thank you — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#195>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AELIZAL6RBGBC4TUBQSRRWLUETU7LANCNFSM5FDM3T2Q> .