Skip to content

GameScrcpy 2.1.0

Choose a tag to compare

@NuoRan NuoRan released this 13 Nov 09:43
· 78 commits to main since this release

GameScrcpy 2.1 把扩展平台做到第三版:扩展可以带来设备、连接手机的方式、画面与声音、朗读与语音命令、界面语言、AI 模型服务和格式转换,安装与更新也更安全。ESP32 触控盒搬出主程序,成为社区扩展;手机上的伴侣 App 重新设计。

下载

文件 说明
GameScrcpy-2.1.0-setup.exe 安装包(推荐):默认只为当前用户安装,不需要管理员权限;直接装在 2.0 上面就是升级
GameScrcpy-2.1.0-portable.zip 便携版:解压后运行 GameScrcpy.exe,数据存在旁边的 data 文件夹
GameScrcpy-2.1.0-symbols.zip 调试符号,只在分析崩溃时需要

两种都自带 adb 和运行库。程序暂时没有代码签名,第一次运行时 Windows 可能提示"Windows 已保护你的电脑":点"更多信息",再点"仍要运行"。

要求:Windows 10 / 11 64 位;Android 9 或更高(声音与无线配对需要 Android 11 或更高)。

亮点

  • 扩展平台第三版:扩展可以在设备页加设备(例如触控盒),提供连接手机的新方式、画面与声音的来源和去处、朗读与语音命令、界面语言、AI 模型服务、识别引擎,以及导入导出别的格式。
  • 逻辑能做的更多:经 GameScrcpy 发 https 请求、用 WebSocket;打开用户选的文件、使用用户选的文件夹;在 127.0.0.1 上接受本机其他程序的连接;用 media.frames 取得投屏画面的帧;用 events.on 收听 GameScrcpy 自己的事件(手机连上与断开、投屏开始与结束、套用方案、前台应用变化等)。
  • 更安全地安装与更新扩展:扩展包可以签名;网页上的 gamescrcpy:// 链接下载扩展包、核对 SHA-256 后打开安装框;受限的原生扩展在没有任何权限的 AppContainer 里运行;扩展可以写明更新列表,只在你点“更新”时下载。
  • 伴侣 App 2.1:重新设计,开关在手机和电脑上都能改,两边同步。
  • ESP32 触控盒成为社区扩展 community.esp32,电脑和板子之间新增低功耗蓝牙连接。
  • AI:模型用下拉框选,下面只列出这个模型支持的深度思考、思考强度和长上下文选项;所有对话都保留在电脑上。
  • 帮助菜单与帮助页加了“赞助…”。

扩展平台

用户看得到的

  • 设备页:扩展的触控盒等设备有自己的卡片,可以“控制”手机、打开面板、运行带进度的任务;扩展提供的画面来源可以像采集卡一样交给手机;经扩展提供的连接方式连上的手机也列在这里。
  • 投屏窗口:“更多”里的“发送到 …”把画面和声音送给扩展(例如虚拟摄像头);扩展读取画面、在画面上标注,每台手机分别开关。录像可以用扩展导出成别的格式;转换器扩展把别的格式导入成方案,把方案、任务和录像导出成别的格式。
  • 设置:“设置 › 音频”多了“朗读与语音命令”;“设置 › AI”可以选扩展提供的模型服务;“设置 › 通用”的界面语言可以选语言包添加的语言。扩展的面板可以出现在设置、扩展自己的设置窗口、投屏窗口的工具栏、卡片的“更多”菜单和托盘菜单里。
  • 帮助与引导:帮助里的“扩展”一组放着扩展带来的帮助文章;扩展可以带功能引导。
  • 扩展卡片:写明签名状态(以前装过、记住了公钥的才是“已验证的发布者”;换了公钥或去掉签名的更新不予安装)、最近 7 天停止的次数和被自动关闭的原因;诊断包里有扩展列表与 gs-exthost 的崩溃报告。
  • 更新:“设置 › 通用 › 更新”里的“检查扩展更新”(默认关闭)打开后,每天启动时最多查一次,不会发送你装了哪些扩展;扩展页也可以随时“检查更新”。下载的包要和更新列表写的大小、SHA-256 与签名对得上,再打开安装框,列出新版本多了或少了哪些权限与依赖。
  • 版本兼容:每个扩展的卡片、详情和安装框写着它“为 GameScrcpy X.Y 编写”;为旧版本写的扩展只要它用的接口还在就照常用、不提示。GameScrcpy 更新后第一次启动时,如果有你开着、却因为版本不兼容打不开的扩展,会弹一次提示列出它们,写明“为 GameScrcpy 2.0 编写,与 2.1 不兼容”这样的原因,可以“检查更新”或“打开扩展页”;与这个 GameScrcpy 不兼容的包装不上,安装框写明原因。

扩展作者得到的

  • 原生接口第 2 版(sdk/include/gamescrcpy_ext.h):DLL 导出 gs_ext_main;带进度、日志和结果的长任务(逻辑里写 ext.<扩展>.<任务>({ ... }),蓝图里是一个带“进度”“完成”“失败”出口的块);给自己扩展的逻辑发事件;读取扩展设置并在改动时得到通知;设备提供者、连接方式、画面与声音、画面读取、输入设备、语音引擎、识别引擎、AI 模型服务;硬件占用,以及经 GameScrcpy 使用用户允许的设备;受限模式("sandbox": "restricted")。
  • 逻辑与清单:面板的新位置、程序事件、扩展之间的服务(ext.provide、ext.call)、本机连接(net.listen)、联网(net.fetch、net.socket)、用户选的文件与文件夹(files.pick、files.folder)、语音(speech.say、speech.listen)、识别(vision.recognize)、转换器、语言包、功能引导与帮助文章、更新列表(updates.index)。
  • 工具:gs ext test 不开 GameScrcpy、不连手机就能测试扩展;gs ext <扩展> <命令> 运行扩展声明的命令;gs ext init 新建扩展;gs ext keygen 与 gs pack --sign 给扩展包签名。
  • 版本规范:扩展点按“主.次”定版本(加了东西升次版本,改掉或去掉的升主版本),清单的 requires 写你照着写的那个版本,gamescrcpy 写你照着写的 GameScrcpy 版本(如 "2.1",卡片上显示“为 GameScrcpy 2.1 编写”;没写时按 requires 推算)。GameScrcpy 2.1.0 提供 native 2.0,script、panel、component、task 1.1,其余 1.0;gs validate 与 gs pack 会检查,见清单参考的“requires 与版本范围”。
  • 文档:扩展开发指南,以及其中的清单参考、逻辑扩展指南、原生扩展指南、测试扩展和打包与发布。示例在仓库的 examples/extensions,打好的包在安装目录的 sdk\samples 里。

伴侣 App 2.1

  • 重新设计:首页、功能、电脑、权限、关于五页,深浅色跟随手机,连上电脑后用电脑的强调色;通知里写着连着哪台电脑、连了多久。
  • 手机上的光标、键位提示、电脑键盘输入和自动连接四个开关,在手机和电脑上都能改,两边同步;没连电脑时改的,连上后再发过去。键位提示的不透明度两边都能调。
  • 光标可以选大小与样式,打字时的提示条可以放在底部或顶部。
  • “电脑”页列出连过的电脑,可以马上重连,也可以删除。
  • 经 USB 调试投屏时,GameScrcpy 会自己把手机上的伴侣换成新版。旧版伴侣照旧能用,只是不同步开关。

ESP32 触控盒改为社区扩展

  • ESP32 触控盒搬出主程序,成为社区扩展 community.esp32(1.1.0),在单独的项目里发布:https://github.com/NuoRan/GameScrcpy-ESP32。固件、刷写和协议都在那里。
  • GameScrcpy 本身不再驱动任何板子,也不再附带 ESP32 的固件。装上扩展后,板子以触控盒的身份出现在设备页,也可以和采集卡配对。
  • 扩展新增电脑和板子之间的低功耗蓝牙连接(固件 1.1,经典 ESP32、C3、C6 与 S3)。这部分还没有在真板子上核对过。
  • 帮助里的 ESP32 文章换成通用的“触控盒”;扩展自己的帮助在帮助的“扩展”一组里。

修复

  • 没有打开投屏窗口时,从方案页“编辑逻辑…”打开较大的方案会卡死并占满内存(Qt 6.10.1 的问题,已绕开)。
  • ESP32 触控盒闲置几分钟后会话断开、第一下触控失败(在社区扩展里修复):盒子不出声时会重新询问,必要时切回握手波特率再升回高速。
  • 扩展的新版本要的权限比以前多、等你重新打开时,扩展卡片误写“需要的扩展没有安装”;现在写“重新打开,同意新的要求”。
  • 扩展包里名为 con .txt、CONIN$、CONOUT$ 这类 Windows 设备名的文件现在也会被拒绝;从手机复制到电脑的这类文件,名字前面会加上 _。

不兼容的变化

  • 原生扩展接口升到第 2 版:按第 1 版编译、只导出 gs_ext_entry 的 DLL 不再加载,要用新的 sdk/include/gamescrcpy_ext.h 重新编译,导出 gs_ext_main。扩展点 native 随之升到 2.0:清单写 "native": "^2.0";为 2.0 写的原生扩展在 2.1 里不打开,卡片与升级后的提示写“为旧版 GameScrcpy 制作”。
  • 内置的 ESP32 触控盒没有了,2.0 的 ESP32 设置也不迁移:选着 ESP32 触控方式的手机改回普通的触控方式,采集卡上选的 ESP32 触控改为不触控,esp32.* 设置被丢弃。
  • 不再内置任何扩展:CRT 扫描线与石板主题改为 sdk\samples 里的示例,id 也从 gamescrcpy.* 改成了 example.*。正在用石板主题的回到默认主题;CRT 扫描线装上示例后,原来调过的参数接不上。
  • 扩展清单里 files.paths 权限的固定路径 paths 不再给扩展任何访问(只得到警告 permission-paths-fixed),改用 folders:逻辑用 files.folder(name) 打开,真实的文件夹由用户第一次使用时选定。
  • 设置 general.language 改为存语言代码(文字),也可以是语言包添加的语言(如 ja);选了语言包的语言后再用 2.0 打开,2.0 不认这个值,界面回到跟随 Windows。

怎么升级

  • 安装版:直接运行 GameScrcpy-2.1.0-setup.exe,装在 2.0 上面。设置、方案、日志和装过的扩展都保留(在 %APPDATA%\GameScrcpy)。
  • 便携版:解压到一个新文件夹,再把 2.0 文件夹里的 data 文件夹搬过来,设置、方案和日志就都在。不要直接解压覆盖旧文件夹,否则 2.0 自带的扩展会留在程序旁边。
  • 伴侣 App:经 USB 调试投屏时,GameScrcpy 会自己更新手机上的伴侣。
  • ESP32 触控盒:从 https://github.com/NuoRan/GameScrcpy-ESP32 下载 community.esp32-1.1.0.gsext,在扩展页“从文件安装”并同意它要的权限;然后重新给手机(和采集卡)选触控方式,并在扩展里重新设置一次板子的 Wi-Fi。板子上 1.0.x 的固件照常能用,电脑经蓝牙连板子要先把固件升到 1.1。
  • 石板主题与 CRT 扫描线:在扩展页“从文件安装”安装目录 sdk\samples 里对应的示例;石板主题再在“设置 › 外观 › 配色主题”里重新选。
  • 原生扩展作者:用新的 sdk/include/gamescrcpy_ext.h 重新编译,导出 gs_ext_main,清单里写 "native": "^2.0";清单里用了 files.paths 的 paths,改写成 folders。

完整说明见 CHANGELOG.md,使用帮助见 docs。


English

GameScrcpy 2.1 brings the third version of the extension platform: extensions can add devices, ways to connect phones, pictures and sound, reading aloud and voice commands, interface languages, AI model services and format converters, and installing and updating them is safer. The ESP32 touch box moved out of GameScrcpy into a community extension, and the companion app on the phone is redesigned.

Download

File What it is for
GameScrcpy-2.1.0-setup.exe The installer (recommended): installs for the current user without administrator rights; installing it over 2.0 upgrades in place
GameScrcpy-2.1.0-portable.zip The portable build: unzip and run GameScrcpy.exe; data stays in the data folder next to it
GameScrcpy-2.1.0-symbols.zip Debug symbols, needed only to analyze a crash

Both include adb and the runtime. The program is not code-signed yet; if Windows says "Windows protected your PC", choose "More info", then "Run anyway".

Requirements: Windows 10 / 11 64-bit; Android 9 or later (audio and wireless pairing need Android 11 or later).

Highlights

  • Extension platform, third version: extensions can add devices such as touch boxes to the Devices page, new ways to connect phones, places pictures and sound come from and go to, reading aloud and voice commands, interface languages, AI model services, recognition engines, and importing and exporting other formats.
  • More for logic: https requests and WebSockets through GameScrcpy; the files and folders the user picks; answering programs on this computer on 127.0.0.1; frames of the mirrored picture with media.frames; GameScrcpy's own events with events.on (phones connecting and disconnecting, sessions starting and ending, profiles applied, the app in front and more).
  • Safer installs and updates: packages can be signed; gamescrcpy:// links on web pages download a package, check its SHA-256 and open the install dialog; restricted native DLLs run in an AppContainer without rights; extensions can name an update list, and a newer version is downloaded only when you choose Update.
  • Companion app 2.1: redesigned, with switches that you can change on the phone or on the computer, kept in sync.
  • The ESP32 touch box is the community extension community.esp32, which adds Bluetooth LE between the computer and the board.
  • AI: pick the model from a drop-down that shows only the thinking, effort and long context options the model takes; every conversation is kept on the computer.
  • Help offers a Sponsor dialog.

Extension platform

What users see:

  • Devices page: an extension's touch boxes and other devices get cards with Control, a panel and jobs with progress; an extension's picture sources can be given to a phone like a capture card; phones reached through an extension's connection method are listed too.
  • Mirror window: "Send to …" in More sends the picture and sound to an extension (a virtual camera, for example); an extension reads and marks up the picture on the phones where you turn it on. Recordings can be exported in an extension's format; converters import other formats as profiles and export profiles, tasks and recordings.
  • Settings: Settings › Audio has "Reading aloud and voice commands"; Settings › AI can use a model service from an extension; the interface language in Settings › General lists the languages of language packs. Extension panels can sit in Settings, in the extension's own settings window, on the mirror window's toolbar, in the More menu of cards and in the tray menu.
  • Help and tours: the Extensions group in Help holds the articles extensions bring, and extensions can show you around with tours.
  • Extension cards show the signature state (a verified publisher only for a key remembered from an earlier install; updates signed with another key or not signed are refused), how often the extension stopped in the last 7 days and why it was turned off; the diagnostics bundle includes the extension list and crash reports from gs-exthost.
  • Updates: once "Check extensions for updates" (off by default) is on in Settings › General › Updates, GameScrcpy checks at most once a day at startup and sends nothing about what you installed; the Extensions page can check at any time. A download must match the size, SHA-256 and signature in the update list before the install dialog opens, which lists the permissions and dependencies a new version adds or drops.
  • Versions: each extension's card, details and install dialog say which GameScrcpy it was "Made for", and an extension written for an older version keeps working without a prompt as long as the interfaces it uses are still there. The first start after GameScrcpy is updated lists the extensions you had turned on that no longer open because of their version, with reasons such as "Made for GameScrcpy 2.0; does not work with 2.1", and offers Check for updates and Open Extensions; packages that do not fit this GameScrcpy cannot be installed, with the reason in the install dialog.

What extension authors get:

  • Native interface 2 (sdk/include/gamescrcpy_ext.h): DLLs export gs_ext_main; jobs with progress, log lines and a result (ext.<extension>.<job>({ ... }) in logic, one block with Progress, Done and Failed exits in blueprints); events to the extension's own logic; the extension's settings with change notices; device providers, transports, pictures and sound, frame taps, input devices, speech engines, recognition engines and AI providers; hardware claims and the devices the user allows, through GameScrcpy; the restricted mode ("sandbox": "restricted").
  • Logic and manifest: the new panel places, program events, services between extensions (ext.provide, ext.call), local connections (net.listen), the network (net.fetch, net.socket), the files and folders the user picks (files.pick, files.folder), speech (speech.say, speech.listen), recognition (vision.recognize), converters, language packs, tours and help articles, and update lists (updates.index).
  • Tools: gs ext test tests an extension without GameScrcpy or a phone; gs ext <extension> <command> runs the commands an extension declares; gs ext init starts a new extension; gs ext keygen and gs pack --sign sign packages.
  • Version rule: extension points have major.minor versions (a minor step adds, a major step changes or removes), and requires names the version you wrote against, while gamescrcpy names the GameScrcpy version you wrote against (such as "2.1", shown as "Made for GameScrcpy 2.1"; worked out from requires when missing). GameScrcpy 2.1.0 offers native 2.0, script, panel, component and task 1.1, and 1.0 for the rest; gs validate and gs pack check it (see "requires and version ranges" in the manifest reference).
  • Documentation: the guide to writing extensions with its pages on the manifest, logic, native code, testing and publishing. The examples are in examples/extensions, and their packages in sdk\samples of the installation.

Companion app 2.1

  • Redesigned around Home, Features, Computers, Permissions and About, with a light and a dark look that follow the phone and the connected computer's accent color; the notification names the computer and how long it has been connected.
  • The cursor, key hints, computer keyboard input and auto connect switches can be changed on the phone or on the computer and stay in sync; changes made while not connected are sent when the computer connects. The opacity of the key hints can be set on both sides.
  • The cursor has a size and a style, and the typing bar can sit at the bottom or the top.
  • Computers lists the computers the phone has connected to, with Connect now and Remove.
  • Over USB debugging, GameScrcpy replaces the companion on the phone with the new version by itself. The old companion keeps working, without the synced switches.

The ESP32 touch box is now a community extension

  • The ESP32 touch box moved out of GameScrcpy into the community extension community.esp32 (1.1.0), published in its own project: https://github.com/NuoRan/GameScrcpy-ESP32. The firmware, the flashing and the protocol live there.
  • GameScrcpy itself no longer drives any board and no longer comes with ESP32 firmware. With the extension installed, boards show up on the Devices page as touch boxes and can be paired with a capture card.
  • The extension adds Bluetooth LE between the computer and the board (firmware 1.1; classic ESP32, C3, C6 and S3). This part has not been checked on a real board yet.
  • The ESP32 article in Help is replaced by a general "Touch boxes" article; the extension's own help is in the Extensions group of Help.

Fixes

  • Opening a larger profile with "Edit logic…" from the Profiles page while no mirror window was open froze GameScrcpy and filled the memory (a Qt 6.10.1 problem, now worked around).
  • An ESP32 touch box lost its session after a few idle minutes and the first touch failed (fixed in the community extension): when the box goes quiet, it is asked again, at the handshake speed if needed, and the fast speed is negotiated back.
  • An extension waiting for you to turn it on again after a new version asked for more read "Needs an extension that is not installed"; it now reads "Turn it on again to allow what's new".
  • Files named after Windows devices such as con .txt, CONIN$ and CONOUT$ are now refused in extension packages, and such files copied from the phone get a leading _.

Incompatible changes

  • Native extension interface 2: DLLs built for version 1, which export only gs_ext_entry, are not loaded; rebuild them with the new sdk/include/gamescrcpy_ext.h and export gs_ext_main. The extension point native is 2.0 with it: manifests write "native": "^2.0", and native extensions made for 2.0 do not open in 2.1 and show as made for an older GameScrcpy on their card and in the notice after the update.
  • The built-in ESP32 touch box is gone and its 2.0 settings are not carried over: phones with the touch method ESP32 go back to normal touches, a capture card's ESP32 touches go back to none, and the esp32.* settings are dropped.
  • No extension is built in any more: the CRT scanlines and the slate theme are samples in sdk\samples, and their ids changed from gamescrcpy.* to example.*. The slate theme falls back to the default theme, and the CRT scanlines start from their default values once the sample is installed.
  • The fixed paths of the files.paths permission give an extension nothing (only the warning permission-paths-fixed); use folders, which logic opens with files.folder(name) after the user chooses each real folder the first time.
  • The setting general.language holds a language tag as text and can name a language pack's language (such as ja); with such a language chosen, 2.0 does not understand the value and follows Windows.

Upgrading

  • Installer: run GameScrcpy-2.1.0-setup.exe over 2.0. Your settings, profiles, logs and installed extensions stay (in %APPDATA%\GameScrcpy).
  • Portable: unzip into a new folder and move the data folder of 2.0 into it; your settings, profiles and logs come along. Do not unzip over the old folder, or the extensions that came with 2.0 stay next to the program.
  • Companion app: when you mirror over USB debugging, GameScrcpy updates the companion on the phone.
  • ESP32 touch box: download community.esp32-1.1.0.gsext from https://github.com/NuoRan/GameScrcpy-ESP32, choose Install from file on the Extensions page and allow what it asks for; then choose the touch method again for each phone (and capture card) and set up the board's Wi-Fi again in the extension. Boards with firmware 1.0.x keep working; Bluetooth between the computer and the board needs firmware 1.1 first.
  • Slate theme and CRT scanlines: install the samples from sdk\samples of the installation with Install from file, then choose the slate theme again in Settings › Appearance › Color theme.
  • Native extension authors: rebuild with the new sdk/include/gamescrcpy_ext.h, export gs_ext_main and write "native": "^2.0" in the manifest; replace paths of files.paths with folders.

See CHANGELOG.md for details and docs for the user guide.

SHA-256

d8a154856e1c41505686a28ffc47add2591722e2cead13cea698daa5766c400f  GameScrcpy-2.1.0-setup.exe
a9abc4db51c4be4afd61cf2f2d78e22468775dff3f56a470aae81370a80dfd21  GameScrcpy-2.1.0-portable.zip
be4a76813eb76ce8bce0e6e45c8b9ba419199e9d73da3fdcbd21ddeb48b19c64  GameScrcpy-2.1.0-symbols.zip