Skip to content

0.69.0

Choose a tag to compare

View all tags
@takahirom takahirom released this 29 Dec 08:50
· 292 commits to main since this release
0.69.0
41e111b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

New feature: AI Hints - App-Provided Context:

  • Apps can provide domain-specific hints to help the AI understand the current screen better. The hint you provide serves as additional context for the AI.
  • Embed hints in the accessibility label using the [[aihint:...]] format: 
    // Android (contentDescription)
view.contentDescription = "Play button [[aihint:Video player, buffering]]"
    // iOS (accessibilityLabel)
button.accessibilityLabel = "Play button [[aihint:Video player, buffering]]"
    <!-- Web (aria-label) -->
<button aria-label="Play button [[aihint:Video player, buffering]]">Play</button>
  • The [[...]] format allows hints to coexist with accessibility labels and supports structured data like JSON.
  • Note: Since this uses accessibility labels, it affects screen readers (TalkBack, VoiceOver, etc.). Enable hints only during testing to avoid accessibility issues in production.

What's Changed

  • Add ArbigentHint feature for app-provided domain context by @takahirom in #361
  • Refactor AI hints to use [[aihint:...]] format by @takahirom in #362

Full Changelog: 0.68.0...0.69.0

Contributors

takahirom
Assets 11
Loading