Testing whether RLHF instills a privileged self-emotion direction in the residual stream, and whether surgical steering on emotion sub-directions can decouple sycophancy from harshness. Open-weight replication on Qwen2.5-32B.
ai-safety ai-alignment rlhf mechanistic-interpretability sycophancy representation-engineering activation-steering llm-internals linear-probes
-
Updated
May 31, 2026 - Python