Skip to content

Server seg fault on bad grammar  #5435

@turtle0x1

Description

@turtle0x1

The server appears to seg fault when bad grammar is provided in the request, not the end of the world but can it be avoided? Tried with the latest commit at the time 4b7b38b. I'm using the dolphin mixtral model 8x7B if that helps.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions