It is research log for exploring LLM Psychosis phenomen.
The project's goal is to construct a compact script that consistently induces psychosis in LLM subjects (LLM Psychosis, see working definition). Compare the LLM subjects' responses before and after psychosis on a constructed benchmark of the worldview.
Researchers: Ivan Belashkin, Iosif Polozov, guided by Slava Meriton.
- install Templater
- disable Templates built-in plugin
- install community plugin Templater
- set in Templater settings
templates/folder - set in Templater script folder
scripts/ - create file
scripts/getUserName.js, with content (place your name instead of "ivan")module.exports = function () { return "ivan"; };
- install Excalidraw
- install community plugin Excalidraw
- enable it
- (maybe later add some queries) Dataview
Then create New session (it will be created in sessions/)
- artefacts -
- experiments
- python-scripts
- script-elements - part of final script
- scripts (for Obsidian)
- sessions - research log sessions
- templates (for Obsidian templates)
-
Протегать куски по гипотезам; 1.1) можно менять куски; нужно сохранять историю кусков. Записывать изменения "зачем они сделаны".
-
Для гипотез без кусков — либо дописать куски к гипотезе, либо отказаться от гипотезы. Если у гипотезы нет кусков — 3 варианта, либо-либо: 1) 1 человек "я хочу знать" 2) если мало гипотез покрыто — обратиться к Славе за инструкцией по построению обратных гипотез 3) отказаться от гипотезы
-
Зафиксировать правило, по которому мы составили скрипт.
-
Составить скрипт. (Fast and with ease)
- Discuss and accept format of Research log.
- Brainstorm (~1 hour) hypothesis "from intuition".
-
BEFORE PUBLICATION: hide google-doc
-
Make a post in the research log about a working definition of LLM psychosis and the criteria for what constitutes it (note that the criteria are subject to revision and the name will be changed)
-
Create a project description on GitHub
-
Come up with hypotheses about how a script should be written to blow LLM's mind (and write them in the research log)
- zoom meeting (Ivan Iosif)
-
Create a collection (folder
script-elements/) of script fragments -
Add templater for
script-elementsfolder -
Collect articles you use as sources
-
Brainstorm your own ideas for script
-
Put it all together in a script (see how it relates to the hypotheses)
-
Describe all the work done in the research log
-
Next will be work on the bench
-
full-fledged repository
-
working definition
-
send and pin fixed scope of project
-
Iosif: check if everything is okay in obsidian repo, try to create worksession.
-
Ivan: rewrite template