Hello Bhavya,


On Wed, 30 Sep 2020 04:46:35 +0530
"Bhavya shah" <bhavya.shah125@...> wrote:

Dear all,

I look forward to using this neat OCR functionality when I switch to a
Windows 10 system.

I assume you're avare of the tesseract based OCR add-on for older
versions of Windows? Assuming that you have tried it what exactly is so
neat in the Windows 10 OCR in comparison with the tesseract based one.
Since i'm currently maintaining it I'm genuinely interested in your
feedback.

--
Regards
Lukasz

Hello,

On Mon, 28 Sep 2020 10:03:12 -0700
"Luke Robinett" <blindgroupsluke@...> wrote:

With that in mind, it seems like this could be evolved even further. Is the technology available such that NVDA could try to not only recognize text from the app but ascertain the structure of the user interface, perhaps organizing things into form elements like buttons, text fields etc and then presenting them in the same element browser we use for web pages?

Have you heard about Sibiac (
http://www.azslow.com/index.php?topic=372.0)?
I'm personally not a musician, so I haven't tested, but some people
reports great success with it and it more or less does what you've asked
for.

Barring that, perhaps a

more immediately reachable upgrade would be different actions we can
take on items in the OCR result. For example, instead of just the option
to hit enter to invoke something, what about a Context menu that lets
you invoke it or simply position the mouse cursor where that element was
found?

It is possible already. To position your mouse on the recognized item you
just need to press NVDA+numpad Slash to route the mouse to the review
cursor position. After that you can perform any mouse operation.

--
Regards
Lukasz

Dear all,

I look forward to using this neat OCR functionality when I switch to a
Windows 10 system. I am not sure about interpreting control types and
interface structure from scanned text, but I am quite surprised to
learn that while you can press Enter to simulate a left click on a
portion of the scanned text, you cannot press the Applications key to
right click it currently. Is there an existing GitHub ticket for this
feature request? If not, I encourage Luke and others to consider
filing one.

Thanks.

--
Best Regards
Bhavya Shah
Stanford University | Class of 2024
E-mail Address: bhavya.shah125@...
LinkedIn: https://www.linkedin.com/in/bhavyashah125/

It is only available in Windows 10, it is also limited by your system language. For ocr on lower version of windows you can try this addon written by me.

https://github.com/larry801/online_ocr/releases/download/0.19.5-dev/onlineOCR-0.19-dev.nvda-addon

在 2020/9/29 5:39, Hope Williamson 写道:

Hi,  Rob Hudson.

I actually have not try the OCR function with games that involves fast movement of texts, or requires constant realtime interaction with texts, so I can't say how well OCR would work in that kind of situation.

Games move pretty fast though. Are you able to OCR and read and act with real speed?

I think I totally agree with the original post.
NVDA OCR, in the current form, is quite good already but I think this could be improved further, if technology allows it.
From my tests, OCR seems to work even with games such as Sims 3, thus allowing me to read in-game texts without the use of Windows Magnifier (well, at least for most of the time).

--

It works with content immediately visible on the screen.

Ok nope it really doesn't. I guess that's the one thing I'll keep the
other screen reader for.

OK will do. Does this work with image PDF documents?

Find a graphic with text and hit NVDA+r. OCR results pop up in a little virtual window. Hit escape to close.

I've never used the OCR with NVDA, so how do you use it?

First of all, just having OCR capabilities in NVDA has been a game changer! It was only recently that I learned you can hit enter on text in the OCR window and NVDA would try to invoke that corresponding control in the application.
With that in mind, it seems like this could be evolved even further. Is the technology available such that NVDA could try to not only recognize text from the app but ascertain the structure of the user interface, perhaps organizing things into form elements like buttons, text fields etc and then presenting them in the same element browser we use for web pages?
Barring that, perhaps a more immediately reachable upgrade would be different actions we can take on items in the OCR result. For example, instead of just the option to hit enter to invoke something, what about a Context menu that lets you invoke it or simply position the mouse cursor where that element was found?
I’m not a python developer so take these as suggestions from a layman, but if possible, I think it would frankly revolutionize NVDA. I Work with a lot of music recording/production software and much of it is completely inaccessible, relying on highly visual interfaces that screen readers have no handle into. Something like what I’ve described would really be amazing for these types of programs. Thanks!