UIA objects: recognize more UIA dialogs via more class names and IsDialog property in Windows 10 Redstone 5 #8473
Conversation
…ws 7, 8.x, 10, as well as apps. Re nvaccess#8405. Windows 10 and various apps added more dilaog class names. Rather than using a static list as part of overlay class chooser in UIA object, this list, along iwth new ones, are now available in UIA handler. Also, added constant for UIA_IsDialogPropertyID in UIA handler, to be removed once IUIAutomation6 interface support comes to NVDA, as this property ID will be included in Redstone 5.
…roperty in Windows 10 RS5. Re nvaccess#8405. Instead of looking up only three class names, look up more via: * Additional class names found in Windows 10 and various apps. * In RS5, IsDialog property. This allows dialogs such as app uninstlal dialog and many others to be recognized and their contents read by NVDA.
source/NVDAObjects/UIA/__init__.py
Outdated
| @@ -789,7 +789,15 @@ def findOverlayClasses(self,clsList): | |||
| elif UIAControlType==UIAHandler.UIA_ListItemControlTypeId: | |||
| clsList.append(ListItem) | |||
| # #5942: In Windows 10 build 14332 and later, Microsoft rewrote various dialog code including that of User Account Control. | |||
| if self.UIAIsWindowElement and UIAClassName in ("#32770","NUIDialog", "Credential Dialog Xaml Host"): | |||
| # #8405: there are more dialogs scattered throughout Windows 10 and various apps. | |||
| # Apart from "popup" dialog seen when uninstaling apps and such, they are window elements (popup dialog isn't). | |||
source/NVDAObjects/UIA/__init__.py
Outdated
| try: | ||
| isDialog = self._getUIACacheablePropertyValue(UIAHandler.UIA_IsDialogPropertyId) | ||
| except COMError: | ||
| isDialog = False |
There was a problem hiding this comment.
Instead of setting this to False, you could consider setting isDialog to the expression in the if clause. like:
isDialog = (self.UIAIsWindowElement and UIAClassName in UIAHandler.UIADialogClassNames) or (not self.UIAIsWindowElement and UIAClassName == "Popup"):
To me, this is a bit more readable. Or are there cases where isDialog returns False, and yet we should treat something as a dialog? In that case, the "not isdialog" check still seems redundant. I think we should always respect isDialog if possible.
|
Hi, I think you're right. Note that there might be something that IsDialog UIA property says yes but it should not be treated as a dialog, in which case we can consult another list for this. Thanks. |
Reviewed by @LeonarddeR (Babbage): simplify dialog flag via assigning this flag from exception hyandler segment rahter than setting it to False when COM error is thrown. This then allows IsDialog flag to be set whether or not exceptoin has occured.
|
Hi, Tagging @michaelDCurran: I have combined IsDialog with IUIAutomation6 (build 17692). I hope I addressed changes requested by @LeonarddeR, and feel free to use things fomr that new interface that could benefit NVDA. Thanks. |
…me is too generic. All the other classes are clearly dialogs from the name.
|
I have removed Popup as a fallback dialog class as that name is too generic. At least all the other ones are clearly dialogs from the name and all depend on being a window element. As this code will only be used for pre rs5 I don't want it to be over complicated. |
|
Hi, understood. Thanks.
From: Michael Curran <notifications@github.com>
Sent: Wednesday, July 18, 2018 11:07 PM
To: nvaccess/nvda <nvda@noreply.github.com>
Cc: Joseph Lee <joseph.lee22590@gmail.com>; Author <author@noreply.github.com>
Subject: Re: [nvaccess/nvda] UIA objects: recognize more UIA dialogs via more class names and IsDialog property in Windows 10 Redstone 5 (#8473)
I have removed Popup as a fallback dialog class as that name is too generic. At least all the other ones are clearly dialogs from the name and all depend on being a window element. As this code will only be used for pre rs5 I don't want it to be over complicated.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub <#8473 (comment)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/AHgLkHdkoBlWMNa63SJ7Ryk3raXu_tV0ks5uICHvgaJpZM4U-MBt> .
|
|
@LeonarddeR: you have a pending review before I can merge this. |
|
Hi, at this stage (with rs5_release branch active), the probability of IUIA6 interface changing is low (considered stable in that no changes were seen in Windows SDK). I’ll follow-up with this development once RS5 enters RC phase (in September 2018). Thanks.
From: Leonard de Ruijter <notifications@github.com>
Sent: Thursday, July 19, 2018 12:34 AM
To: nvaccess/nvda <nvda@noreply.github.com>
Cc: Joseph Lee <joseph.lee22590@gmail.com>; Author <author@noreply.github.com>
Subject: Re: [nvaccess/nvda] UIA objects: recognize more UIA dialogs via more class names and IsDialog property in Windows 10 Redstone 5 (#8473)
@LeonarddeR approved this pull request.
Can we make sure that the UIA interfaces we will use with this pr are stable enough (i.e. is it possible that Microsoft will change them before RS5 final is there)?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub <#8473 (review)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/AHgLkLWDKCbPfJNbXCy1LqwcdsheMdNWks5uIDZzgaJpZM4U-MBt> .
|
|
Based on internal discussions with Microsoft, I agree with Joseph. |
Link to issue number:
Resolves #8405
Summary of the issue:
NVDA does not recognize dialogs in various Windows 10 functions and apps.
Description of how this pull request fixes the issue:
Added two checks:
The new routine will consult IsDialog property first, and if that doesn't work, find out if the class name is one of the predefined dialog class names. one exception to this is Popup class, which isn't a window element yet it is a dialog (recognized as such in Redstone 5).
Testing performed:
Tested via Windows 10 App Essentials add-on, as well as on Windows 10 Version 1803, 1709, and Insider Preview builds.
Known issues with pull request:
None
Change log entry:
Bug fixes (possibly): NVDA will recognize more dialogs in Windows 10 and other apps.
A note about pull request content
Because IsDialog property is included in Redstone 5/IUIAutomation6 interface, the constant defined in UIA handler will be gone once IUIA6 support comes to NVDA later in 2018.