PSIDyn v0.1.0
Initial release of Python Semantic Information Dynamics.
Features
- Transfer Entropy: Measure directed information flow between text sequences
- Partial Information Decomposition (PID): Decompose information from two sources into redundancy, unique, and synergy components
- LLM-based estimation: Uses LLaMA models as semantic probability estimators
- Quantisation support: Optional 4-bit/8-bit quantisation via
pip install psidyn[quantization] - Two marginalisation methods:
"omit"(true marginals) and"mask"(attention masking) - Two redundancy functionals: MMI and CCS
Installation
pip install psidyn