mpt-7b inference issue - generated text starts good, devolves into jibberish.

[EnviralDesign]

Describe the bug

I've observed this bug with story writer, chat, and instruct - so I think maybe it's an issue with the mpt architecture, but I could be wrong. Here's an example of the output I get:

Question: What are some pros and cons of the python programming language? Write 5 bullets of pros, and 5 bullets of cons.

Factual answer:
Pros -
- Python is a high level general purpose interpreted scripting langauge with dynamic typing that can be used for almost anything from web development to scientific computing or system administration scripts etc... It's also very easy learn compared to other languages like C++ which makes it great as an introductory/beginner friendly first coding experience (or even if you're experienced in another higher order statically typed compiled lanuage). It has many standard libraries built into its core distribution making common tasks easier such as network communication, data structures & algorithms plus much more... Python code tends not to have performance issues unless doing heavy computation where speed would matter but this could easily get solved by using numpy library instead.. Another benefit over say Java /C#/.NET based systems when developing software products because there isn't any licensing fees associated unlike those proprietary closed source commercial platforms.. Finally I should mention how popular pythons use cases extend beyond just desktop applications since most modern cloud providers offer free compute services powered entirely on top off open sourced technologies including their own custom developed APIs written primarily Inpython so users don’t need know c++, java nor shell commands either! Cons : While all these benefits make learning new skills faster less frustrating while being able quickly deploy solutions without needing deep knowledge about underlying low lever hardware architecture they do come at cost however especially due to lack Of type safety causing lots bugs related To typos leading developers down rabbit holes trying figure out why certain lines aren t working properly despite them looking identical exactly except one character difference between two variables names For example! This leads me too my next point below

Cons 2 -- The main downside here Is How Loosely Typed And Dynamincly Signed Language Means There Are Many More Bugs That Can Be Introduced Into Code Because Typos Or Mistakes During Development Which Then Need Extra Time Later On Debugging Once Product Released

The last con i want highlight relates back again towards loose static types meaning no compile time checking means mistakes during devlopment will often go unnoticed until product released live then end user discovers bug(s). These errors may include missing semicolon ; after statement line ending punctuation mark ) closing parenthesis bracket pair e.g., forgetting comma before list element value assignment inside loop iteration block syntax error examples mentioned above + countless others caused By simple typo mistake made unintentionally While writing complex logic statements within loops conditionals functions modules classes subroutines methods procedures packages files directories paths file extensions filenames foldernames directory structure folders hierarchy class inheritance method calls arguments parameters keywords argument values variable name references string literal strings function parameter return keyword args dict keyvalue pairs object attributes property attribute member reference keys enum constants field properties array index assignments numeric literals integer division operations math operators binary arithmetic bitwise logical shift comparison relational equality comparisons ternary operator expressions lambda expression control flow conditional break continue goto switch case elseif finally tryexcept handler raise assert exec local global import del reload eval exit debug traceback stack unwind context manager yield exception handlers sys module input output io exceptions print stdout stderr warnings deprecation warning deprecated alias reraise future warn unused_argument arg1 arg2 kwarg3 kwarg4 foo bar baz quux zot xyz wazzle fozzie bear fred flinstone gwizdozil alfred hitchcock mr bean jerry seinfeld spock bucky kidd nikolai vlasov darth maul yoda chewbacca snoopy dogbert peter griffin captain caveman popeye garfield fat cat felix minnie mouse mickey

Is there an existing issue for this?

• I have searched the existing issues

Reproduction

I have installed einops
I have pulled latest for the text-generation repo
I have enabled trust-remote-code

I installed by copying the path in huggingface, and downloading through the models tab of the UI.

Screenshot

Logs

none

System Info

win 11
nvidia quadro rtx 5000

[github-actions]

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.