Re: Will NVDA eventually use AI for better GUI recognition?

Suhas Dharwad

That would be so amazing.
Oh, the possibilities!


Sent from Thunderbird

“Things can turn out differently, Apollo.
That's the nice thing about being human.
We only have one life, but we can choose what kind of story it's going to be.”
Rick Riordan
On 1/12/2021 5:18, Luke Robinett wrote:

So one thing I enjoy about VoiceOver on my iPhone is it has gotten really good at using UI to make otherwise inaccessible UI elements available to interact with. More than just simple OCR, it can ascertain the layout and make educated guesses about controls like buttons and tabs, greatly expanding the usability of apps that otherwise would be partially or totally inaccessible.

Is there any chance NVDA will eventually reach that level of sophistication? I know there are third party add-ons that attempt to bridge that gap for specific types of apps, for example the great Sibiac add-on which helps make certain music production apps and plugins accessible with NVDA, but it would be great to see these capabilities broadened and rolled into the core functionality of the product.





Join to automatically receive all group messages.