Hey,

I bound a few NVDA commands, including OCR, to touchscreen input gestures. The issue I'm hitting now is that the OCR results don't appear to be interactive via touchscreen. I can review them via the keyboard, but if I'm touchscreen-only then I'm not sure there's a way to reach them.

Ideally I'd like some sort of floating text window containing the OCR result, along with a touch button to close the window, with the same click/tap behavior of the OCR result (I.e. clicking/tapping text tries to click the text in the image.) Is there any way to achieve this via the touchscreen? I tried OCRing both a game and a browser window, but in neither instance was I able to either touch or swipe to the OCR result. It's possible I'm just missing something.

If this isn't possible now, should an addon be able to do it? I won't ask further questions about that here--just curious if an addon can intercept whatever sort of virtual buffer NVDA is creating and map that to something I can interact with.

Thanks again.

Hi,

To review OCR results, once the result is ready, switch to text touch mode and use one:

• One finger flick left/right: review by character
• Two finger flick left/right: review by word
• One finger flick up/down: review by line

Cheers,

Joseph

Thanks. Haven't tried this on the screen myself, but my head is spinning a bit with both "touch" and "review" modes. :) I'll figure it out eventually but it feels like a whole new dimension to grapple with.

Still though, I'm running NVDA on what feels like a piece of hardware designed to be handheld. Definitely want to figure out how to make the NVDA experience on this nice, the Steam Deck is a pretty neat/repairable bit of hardware for anyone willing to go through the trouble of installing Windows 11 and drivers on it.

Still haven't tried this yet--right now my Steam Deck is wired into power/audio as a desktop replacement so it's a bit challenging--but I'm anticipating another issue. To exit out of OCR results I need to press Escape on the keyboard. Is there a touchscreen equivalent? I searched through the input gestures for a likely candidate but didn't find anything.

Hi,

There is no entry to let you assign a touch gesture to emulate pressin Escape key (and I'm sorry to say that it won't be part of Enhanced Touch Gestures).

Cheers,

Joseph

Awesome, thanks, I'll probably just fork it and use it as the basis of a Steam Deck-specific addon. I appreciate you saving me the trouble and letting me know that it isn't yet possible. :)

Thanks for all your work.

Hi,

Don't fork it just yet - wait until the add-on is officially end of life from me. I think it would be best to just keep working on Enhanced Touch Gestures, and if you want, become the new add-on maintainer.

Cheers,

Joseph