Skip to content

FreedomLW/psychic-engine

Repository files navigation

What is it

It is research log for exploring LLM Psychosis phenomen.

The project's goal is to construct a compact script that consistently induces psychosis in LLM subjects (LLM Psychosis, see working definition). Compare the LLM subjects' responses before and after psychosis on a constructed benchmark of the worldview.

Researchers: Ivan Belashkin, Iosif Polozov, guided by Slava Meriton.

Obsidian settings

  1. install Templater
    1. disable Templates built-in plugin
    2. install community plugin Templater
    3. set in Templater settings templates/ folder
    4. set in Templater script folder scripts/
    5. create file scripts/getUserName.js, with content (place your name instead of "ivan")
      1. module.exports = function () { return "ivan"; };
  2. install Excalidraw
    1. install community plugin Excalidraw
    2. enable it
  3. (maybe later add some queries) Dataview

Then create New session (it will be created in sessions/)

folder structure

  • artefacts -
  • experiments
  • python-scripts
  • script-elements - part of final script
  • scripts (for Obsidian)
  • sessions - research log sessions
  • templates (for Obsidian templates)

python-scripts

See python-scripts/README.md

current TODOs (to 14 febr)

  1. Протегать куски по гипотезам; 1.1) можно менять куски; нужно сохранять историю кусков. Записывать изменения "зачем они сделаны".

  2. Для гипотез без кусков — либо дописать куски к гипотезе, либо отказаться от гипотезы. Если у гипотезы нет кусков — 3 варианта, либо-либо: 1) 1 человек "я хочу знать" 2) если мало гипотез покрыто — обратиться к Славе за инструкцией по построению обратных гипотез 3) отказаться от гипотезы

  3. Зафиксировать правило, по которому мы составили скрипт.

  4. Составить скрипт. (Fast and with ease)

old todos

  1. Discuss and accept format of Research log.
  2. Brainstorm (~1 hour) hypothesis "from intuition".

old TODOs

  • BEFORE PUBLICATION: hide google-doc

  • Make a post in the research log about a working definition of LLM psychosis and the criteria for what constitutes it (note that the criteria are subject to revision and the name will be changed)

  • Create a project description on GitHub

  • Come up with hypotheses about how a script should be written to blow LLM's mind (and write them in the research log)

    • zoom meeting (Ivan Iosif)
  • Create a collection (folder script-elements/) of script fragments

  • Add templater for script-elements folder

  • Collect articles you use as sources

  • Brainstorm your own ideas for script

  • Put it all together in a script (see how it relates to the hypotheses)

  • Describe all the work done in the research log

  • Next will be work on the bench

  • full-fledged repository

  • working definition

  • send and pin fixed scope of project

  • Iosif: check if everything is okay in obsidian repo, try to create worksession.

  • Ivan: rewrite template

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors