Skip to content

v0.0.8 — response brevity

Choose a tag to compare

@prashanthaitha24 prashanthaitha24 released this 08 Jun 07:11

Adds a feature that cuts output tokens — usually the bulk of a chat's cost.

Added

  • promptOptimizer.responseBrevity (off by default): appends a short "answer concisely" instruction to the forwarded prompt, so the model returns a shorter response. This saves far more than input compression on typical prompts.
  • promptOptimizer.brevityInstruction: customize the instruction text; empty uses the built-in default.

The reported token savings still reflect input compression only (the brevity instruction shapes output, not input), so the figure stays honest. A new "Response brevity: on" line appears when enabled.

22 tests passing. Install the attached .vsix via "Install from VSIX…", or update from the Marketplace.