OCR: Interacting with items from recognized UI

Luke Robinett <blindgroupsluke@...>



For inaccessible UIs I’ll often run NVDA OCR on the UI and then press enter or space bar on the UI controls I find in the recognized text such as tabs, menus and buttons. I find this only works in some programs and other times seems to be ignored. I believe the issue in some cases is that some UIs only respond when an actual mouse is clicked on a control. Is there a way to have the mouse cursor move to the UI element corresponding with its label in the OCR viewer and produce a click on that element? If not, is this something I could submit on GitHub as a feature request? It would make the already helpful OCR feature even more useful.





Join nvda@nvda.groups.io to automatically receive all group messages.