llama-7b-4bit failed to extract pronouns and lemmas.

[otakutyrant]

Just to share my experience. This is the first LLM model I try to run locally in my GTX 1080. And the prompt is:

List all proper nouns from this passgraph. And list all lemmas of other words again.

"Pierre Tardivel reached out for the hand of Molly Bond. He was a good-looking, wiry man of thirty-three, with narrow shoulders, a round head, and hair the same chocolate brown as his eyes. Molly, who would turn thirty-three herself in a couple of weeks, was beautiful— stunningly so, even without makeup. She had high cheekbones, full lips, deep blue eyes, and naturally blond hair parted in the center and cut short up front but tumbling to her shoulders in back. Molly squeezed Pierre’s hand, and they began walking side by side."

And this model returns:

⁇  ⁇  ⁇ ▶ 96824 61219 84857 94889 120830 849710 284783 94314 65789 547556 358994 47103 74568 43718 97846 38567 258996 248979 89675 87843 26967 68574 54241 47189 97685 42791 99374 68514 57897 91994 47189 19768 59674 23851 32498 61784 26579 43899 87842 17945 86597 98342 28479 93718 54689 32468 21964 89467 27859 63714 38981 96249 25978 44381 95762 99843 72837 87512 59649 94199 87246 68512 25894 19682 82799 89857 21969 97644 42888 67592 82479 35199 75344 37698 28944 57317 98579 91742 36513 56488 19354 7

ChatGPT 3.5 returns:

Proper nouns from the passage:
- Pierre Tardivel
- Molly Bond

Lemmas of other words:
- reach
- out
- for
- the
- hand
- be
- a
- good-looking
- wiry
- man
- of
- thirty-three
- with
- narrow
- shoulder
- round
- head
- and
- hair
- same
- chocolate
- brown
- eye
- who
- would
- turn
- herself
- in
- couple
- week
- beautiful
- stunningly
- even
- without
- makeup
- have
- high
- cheekbone
- full
- lip
- deep
- blue
- naturally
- blonde
- part
- center
- cut
- short
- up
- front
- but
- tumble
- shoulder
- back
- squeeze
- they
- begin
- walk
- side by side

It is a pity that the llama model cannot accomplish that. I'm done here.