Skip to content

Computer use in CLI: HiDPI / high-resolution display guidance missing #46216

Description

@ktbeaulieu

Context

Computer use in CLI (Week 14 release) is a great addition. I want to use it on macOS but I'm hitting the same issue I previously hit with the original computer-use API on a high-resolution display.

The gap

The official docs (code.claude.com/docs/en/computer-use) provide no guidance on:

  • Recommended screen resolution / scaling for reliable model interpretation
  • How the feature handles HiDPI / Retina / 5K / 6K displays
  • Whether full-screen screenshots at native resolution are reliably interpretable
  • Any documented workaround (e.g. shrinking the target window into a corner) similar to what was needed with the original computer-use API

Why it matters

On the original computer-use API, full-resolution screenshots from large/HiDPI displays were too large for the model to read accurately. The practical workaround was to manually resize the target window into the top-left corner at a reduced size and screenshot just that region. This was clunky and offset most of the benefit of the feature.

It's unclear whether the new CLI version inherits the same limitation, has a built-in scaling step, or has any recommended setup. Some explicit documentation here would significantly help adoption for users on modern Macs with 5K+ displays.

Asks

  1. Document recommended display setup / scaling for computer use in CLI
  2. If HiDPI screenshots are downscaled internally, document the target resolution and any trade-offs
  3. If users need to manually configure their display, provide a recommended resolution or window-size guidance

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:docsdocumentationImprovements or additions to documentationenhancementNew feature or requestplatform:macosIssue specifically occurs on macOSstaleIssue is inactive

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions