Issue when using NVDA on “Touch Keyboard” on Windows 11 Laptop in Tablet Mode ((Laptop is foldable to make tablet without mouse pad or real keyboard)


David Lenton
 

User has dexterity issues and cannot use mouse or keyboard so "Touch keyboard" is only way to access computer

Issue 1 – Double tap of pinned icon on task bar, does not open respective app/program when NVDA is on

Issue 2 - Double tapping  inside an edit field does not open "Touch keyboard" when NVDA is on. It worked when NVDA is switched off. (Eg In Notepad it does work but Pycharm it doesn’t work.

Issue 3 - Some programs (not all) when "Touch keyboard" is opened from task bar icon, it opens but does not allow program edit field to have focus. When you double tap within the edit field, nothing happens so you cannot type into edit field. This works correctly when NVDA off.

 

Issue 4 - Close Key (X in top right corner of "Touch keyboard") does not work when NVDA is on but will work to close the keyboard when NVDA is off

 

Issue 5 – If you touch the screen and hold finger on the screen and drag, NVDA repeatedly says “Hover” even when you have removed finger.



This is a summary of some of the difficulties we have using NVDA in tablet mode. Has anyone had these issues and found a resolution. 


Dave Grossoehme
 

What version of NVDA is being used on this machine, and what version of windows?  These are things that will be needed before anyone can help here.

Dave


On 11/29/2022 3:01 PM, davidlenton via groups.io wrote:

User has dexterity issues and cannot use mouse or keyboard so "Touch keyboard" is only way to access computer

Issue 1 – Double tap of pinned icon on task bar, does not open respective app/program when NVDA is on

Issue 2 - Double tapping  inside an edit field does not open "Touch keyboard" when NVDA is on. It worked when NVDA is switched off. (Eg In Notepad it does work but Pycharm it doesn’t work.

Issue 3 - Some programs (not all) when "Touch keyboard" is opened from task bar icon, it opens but does not allow program edit field to have focus. When you double tap within the edit field, nothing happens so you cannot type into edit field. This works correctly when NVDA off.

 

Issue 4 - Close Key (X in top right corner of "Touch keyboard") does not work when NVDA is on but will work to close the keyboard when NVDA is off

 

Issue 5 – If you touch the screen and hold finger on the screen and drag, NVDA repeatedly says “Hover” even when you have removed finger.



This is a summary of some of the difficulties we have using NVDA in tablet mode. Has anyone had these issues and found a resolution. 


David Lenton
 

Thanks for advice.
Windows 11 Home

NVDA 2022.3.2 is installed. (This is not a portable version)

Enhanced Touch Gestures addon is installed



Dave Grossoehme
 

Only part of the question was answered.  We need the version of NVDA, which can be found by going into NVDA, history, then about and you will find the NVDA version number here.

Dave


On 11/29/2022 3:15 PM, davidlenton via groups.io wrote:

Thanks for advice.
Windows 11 Home

NVDA 2022.3.2 is installed. (This is not a portable version)

Enhanced Touch Gestures addon is installed



Jackie
 

The op did say the version of NVDA is 2022.3.2.

On 11/29/22, Dave Grossoehme <dave@...> wrote:
Only part of the question was answered.  We need the version of NVDA,
which can be found by going into NVDA, history, then about and you will
find the NVDA version number here.

Dave


On 11/29/2022 3:15 PM, davidlenton via groups.io wrote:
Thanks for advice.
Windows 11 Home

NVDA 2022.3.2 is installed. (This is not a portable version)

Enhanced Touch Gestures addon is installed






--
Jackie McBride
Be a hero. Fight Scams. Learn how at www.scam911.org
Also check out brightstarsweb.com & mysitesbeenhacked.com


Gene
 

The question was answered.  The message says, "NVDA 2022.3.2 is installed."

On 11/29/2022 2:39 PM, Dave Grossoehme wrote:

Only part of the question was answered.  We need the version of NVDA, which can be found by going into NVDA, history, then about and you will find the NVDA version number here.

Dave


On 11/29/2022 3:15 PM, davidlenton via groups.io wrote:
Thanks for advice.
Windows 11 Home

NVDA 2022.3.2 is installed. (This is not a portable version)

Enhanced Touch Gestures addon is installed




Dave Grossoehme
 

Thanks, I guess I missed that. 

Dave


On 11/29/2022 3:43 PM, Gene wrote:

The question was answered.  The message says, "NVDA 2022.3.2 is installed."

On 11/29/2022 2:39 PM, Dave Grossoehme wrote:

Only part of the question was answered.  We need the version of NVDA, which can be found by going into NVDA, history, then about and you will find the NVDA version number here.

Dave


On 11/29/2022 3:15 PM, davidlenton via groups.io wrote:
Thanks for advice.
Windows 11 Home

NVDA 2022.3.2 is installed. (This is not a portable version)

Enhanced Touch Gestures addon is installed




 

Hi,

To answer the original question: Enhanced Touch Gestures add-on did offer an option to disable NVDA's touchscreen support completely. The add-on no longer offers this as it became part of NVDA in a recent release. To disable touchscreen support (as this is what the original poster is looking for), either:

  1. If a keyboard is attached, press Control+Alt+NVDA+T to turn off touch interaction.
  2. Open NVDA menu, Preferences, Settings, Touch interaction, and uncheck "Enable touch interaction support" checkbox and click (tap) OK.

Touch support toggle credit: Joseph Lee (ask him how that was possible; he says he is willing to go into details on how NVDA's touch support works upon request).

Cheers,

Joseph


Brian's Mail list account
 

I think I'll do this or very soon my laptop might go out the window.. ahem.
Brian

--
bglists@...
Sent via blueyonder.(Virgin media)
Please address personal E-mail to:-
briang1@..., putting 'Brian Gaff'
in the display name field.

----- Original Message -----
From: "Joseph Lee" <joseph.lee22590@...>
To: <nvda@nvda.groups.io>
Sent: Tuesday, November 29, 2022 9:59 PM
Subject: Re: [nvda] Issue when using NVDA on “Touch Keyboard” on Windows 11 Laptop in Tablet Mode ((Laptop is foldable to make tablet without mouse pad or real keyboard)


Hi,

To answer the original question: Enhanced Touch Gestures add-on did offer an option to disable NVDA's touchscreen support completely. The add-on no longer offers this as it became part of NVDA in a recent release. To disable touchscreen support (as this is what the original poster is looking for), either:

1. If a keyboard is attached, press Control+Alt+NVDA+T to turn off touch interaction.
2. Open NVDA menu, Preferences, Settings, Touch interaction, and uncheck "Enable touch interaction support" checkbox and click (tap) OK.

Touch support toggle credit: Joseph Lee (ask him how that was possible; he says he is willing to go into details on how NVDA's touch support works upon request).

Cheers,

Joseph


Gene
 

In vision settings, using NVDA 2022.3.2, installed, I see no such option concerning turning off touch mode.  Is this new feature in a beta or in snapshots?

On 11/30/2022 1:35 AM, Brian's Mail list account via groups.io wrote:
I think I'll do this or very soon my laptop might go out the window.. ahem.
Brian


Gene
 

Why do you want to turn it off.  As far as I know, when using a keyboard, no touch gestures are accessible in that way.

Gene

On 11/30/2022 1:35 AM, Brian's Mail list account via groups.io wrote:
I think I'll do this or very soon my laptop might go out the window.. ahem.
Brian


David Lenton
 

We don't want to switch it off, I think there may be a miss-understanding of what we were asking in the original post. We want to use the touch screen (ie using a Windows 11 Laptop in tablet mode where the physical keyboard is folded away and the user has just a tablet like screen. To interface with the computer, you tap an icon to open a "touch keyboard" in the same way you do on a smart phone or IPAD. When NVDA is off everything works well. As soon as NVDA is switched on functions that previously worked don’t any more. I have repeated the problems we had stated in the original post below. Issue 1 – Double tap of pinned icon on task bar, does not open respective app/program when NVDA is on. Issue 2 - Double tapping  inside an edit field does not open "Touch keyboard" when NVDA is on. It worked when NVDA is switched off. (Eg In Notepad it does work but Pycharm it doesn’t work. Issue 3 - Some programs (not all) when "Touch keyboard" is opened from task bar icon, it opens but does not allow program edit field to have focus. When you double tap within the edit field, nothing happens so you cannot type into edit field. This works correctly when NVDA off. Issue 4 - Close Key (X in top right corner of "Touch keyboard") does not work when NVDA is on but will work to close the keyboard when NVDA is off. Issue 5 – If you touch the screen and hold finger on the screen and drag, NVDA repeatedly says “Hover” even when you have removed finger. This is a summary of some of the difficulties we have using NVDA in tablet mode.


 

Hi,

I see. Allow me to explain what's going on when it comes to NVDA's support for touchscreens:

It is true that when NVDA is on, touchscreens don't work as one would expect. This is not the fault of NVDA- rather, it is the way Windows reconfigures touch gestures when an assistive technology such as a screen reader is active. In Windows 8 and later, Ease of Access (part of Windows) will give priority to NVDA on touchscreen computers when processing touch gestures, similar to the way it works in iOS while VoiceOver is active. This is so that blind users do not activate screen controls by accident while performing touch gestures with a screen reader turned on, as well as to let people explore screen content when swiping with fingers on a touchscreen.

I knew that there are people who would like to perform touch gestures as if NVDA is switched off, so I implemented touchscreen support (interaction) toggle feature in Enhanced Touch Gestures add-on. A while after implementing this feature, I decided that NVDA itself should have this feature, so I asked NV Access to incorporate this feature, and someone added a keyboard command for it as well. Thus Control+Alt+NVDA+T command was born to keep NVDA on while turning off its touch support feature.

As for touch interaction toggle: you won't find this in vision category because it is not a vision setting. Touch interaction toggle setting is shown only on touch capable computers - this has been the standard when Enhanced Touch Gestures carried this feature, and still the same with NVDA having the ability to toggle touch support.

Hope this answers dozens of questions.

Cheers,

Joseph


 

Hi,

As a follow-up: to activate screen controls while NVDA is on, you must double-tap the icon in question. For example, to activate touch keyboard, double-tap the touch keyboard icon on the taskbar/notification area.

Cheers,

Joseph


Sarah k Alawami
 

Actually on my surface even when using the keyboard I can use my touch screen. I have done this in the past.

-----Original Message-----
From: nvda@nvda.groups.io <nvda@nvda.groups.io> On Behalf Of Gene
Sent: Wednesday, November 30, 2022 7:30 AM
To: nvda@nvda.groups.io
Subject: Re: [nvda] Issue when using NVDA on “Touch Keyboard” on Windows 11 Laptop in Tablet Mode ((Laptop is foldable to make tablet without mouse pad or real keyboard)

Why do you want to turn it off. As far as I know, when using a keyboard, no touch gestures are accessible in that way.

Gene

On 11/30/2022 1:35 AM, Brian's Mail list account via groups.io wrote:
I think I'll do this or very soon my laptop might go out the window..
ahem.
Brian


 

Hi,

Yes - this is because keyboards and touchscreens are seen as two different sources of input by NVDA. A better way to explain is how people using braille displays can use braille input and computer keyboards at the same time if they choose since keyboards and braille display hardware are independent input sources.

I am willing to write an entry in Inside Story of NVDA dealing with touchscreens and other input gestures.

Cheers,

Joseph


Gene
 

I didn't state what I meant clearly.  I meant that you don't need touch gestures when you use a keyboard, but on further reflection, there must be a reason the person wants to use touch gestures without using the keyboard.

Gene

On 11/30/2022 11:18 AM, Sarah k Alawami wrote:
Actually on my surface even when using the keyboard I can use my touch screen. I have done this in the past.

-----Original Message-----
From: nvda@nvda.groups.io <nvda@nvda.groups.io> On Behalf Of Gene
Sent: Wednesday, November 30, 2022 7:30 AM
To: nvda@nvda.groups.io
Subject: Re: [nvda] Issue when using NVDA on “Touch Keyboard” on Windows 11 Laptop in Tablet Mode ((Laptop is foldable to make tablet without mouse pad or real keyboard)

Why do you want to turn it off. As far as I know, when using a keyboard, no touch gestures are accessible in that way.

Gene

On 11/30/2022 1:35 AM, Brian's Mail list account via groups.io wrote:
I think I'll do this or very soon my laptop might go out the window..
ahem.
Brian









.


David Lenton
 

Thanks for the comments. We understand that the functionality  the the touch screen changes when a screen reader is on (thank Joseph for the additional information) but that isn't really the main issue Even with the difference  in the way we interact with the touchscreen we should still be able to do certain interactions but we cannot. For example we know when NVDA is off we can simply tap or double tap an icon or button and  it will activate the expected response and when NVDA is on we also know that NVDA expects us to find the icon or button first, then double tap on the screen  to perform the associated function. However in some situations this doesn't work properly. Eg Programs pinned to the task bar cannot be opened when NVDA is on because the "find then double tap" method just does nothing. We just want to know whether other people have had this issue or have found a way around it.
We have managed to do extensive comparisons with NVDA on and off because I am a sighted user helping a blind user. The blind user has severe dexterity issues and needs to find away of using touch screen functionality only. At the moment these issues are making it difficult to use his computer. We appreciate, as Joseph Lee suggested, this might be a Microsoft problem rather than a NVDA issue, as we have just discovered that the similar issues occur with Microsoft Narrator.