A Blind Trek Through Android – Part 1: Unwrapping the ...



A Blind Trek Through Android – Part 1: Unwrapping the Jelly Bean (Getting Started)

by Jeffrey Stark

July 31st, 2012

Filed under:

• Accessibility & Adaptive Technology

• Mobile Devices

• Persons With Disabilities

The mobile space changes so dramatically on a daily basis. I had just started to write the 2nd half of my walkthrough for Android Ice Cream Sandwich when Jelly Bean comes on the scene. Jelly Bean is the name of the latest version of android’s popular mobile phone, tablet & device operating system. I am revising my previous article to update it to take into account the changes in jelly bean. There have been some significant changes for blind mobile phone users including indirect touch screen based navigation, braille support for braille displays that use Bluetooth and a whole new gesture system for the screen reader that is customizable.

I have been involved in the testing, development and evaluation of accessible mobile devices for well over 10 years. I have used some of the very early proprietary devices, the phones running Microsoft’s Windows Mobile, Symbian, the blackberry OS, Apple’s iOS and Google’s Android.

Each platform had things it brought to the table for blind consumers and each platform had pitfalls and issues. The 2 most popular mobile platforms at present are iOS and Android for general consumers. So it should be no surprise that both platforms have been dedicating resources to improve their offerings in terms of Accessibility. Apple is the veteran in this space and has created a fantastic offering. Likely, that is the last reference to Apple that I will make in this series of articles. If you want an iPhone, go get an iPhone. It is great and very usable for blind consumers. On the same point, Google has recently released a new version of their android mobile operating system and they should be commended by the strides they have made. I contentedly use an android phone on a daily basis on Mobilicity’s network.

This series of articles is intended to give the reader a sense of what to expect from Android, to share some tips and to demonstrate how to get the most out of an android device.

So far, I have used several android devices. The first was running v2 of the Android OS and had no direction pad or direction controls; the 2nd was running v3 of the Android OS and had a direction pad. At the time, as a blind consumer, I felt both devices to have some shortcomings in terms of functionality and capability; however, the 2nd device running v3 of the operating system was very functional and I got a lot of use out of it. The most recent phone I have had the opportunity to use is the Samsung Galaxy Nexus running v4 of the Android operating system (named: Ice Cream Sandwich or ICS for short). I have recently upgraded my phone from ice cream sandwich to its successor Jelly Bean (JB).

ICS brought 2 important features to the Android space:

1) Talkback (an Android Screen Reader) and the various accessibility features are built into the operating system and can be activated At the setup screen, by performing a double tap and hold for four seconds anywhere on the screen.  You will be asked to keep holding, if you want accessibility turned on.  Talkback will then switch itself on properly and you can release the screen. 

And 2) Android implements a form of touch Exploration, which allows a blind person to explore the screen with touch without activating the items on the screen. Talkback’s touch exploration provides feedback about screen items by making use of the mobile device’s haptic feedback capabilities, by providing audio alerts and by speaking text as controls and information is touched.

Jelly Bean retains these features and as previously mentions, it adds braille support and a whole new interaction model based on gestures.

Many manufacturers make “Android” devices. This means that there is a great deal of diversity in shapes, sizes and designs. All the android phones I have seen have a touch screen; a volume rocker and an unlock/power key. This is where the similarities end. There are many different screen sizes and form factors available. Some devices have touch pads for cursoring, arrow keys, a rocker or joystick or a trackpad. Some devices have a qwerty keypad on the front face of the device or a sliding keypad that slides out for extended typing. With the purchase of any device, I highly recommend seeing the device before purchase. Personally, I prefer devices with a dedicated hardware qwerty keypad, simply because I can type more than 20 words per minute on a qwerty phone. Especially newer users will have a much easier time learning the device if they have the option of a phone with a direction pad or other method of moving up, down, left and right. Less technical or adventurous blind consumers should consider buying Code Factory’s Mobile Accessibility. Many carriers offer Mobile Accessibility at no cost (sometimes under the name “wireless accessibility” or “mobile accessibility lite”). Mobile Accessibility is very helpful for new users or less technical users because it creates a much simpler interface that requires even less learning. None of the above recommendations are required but they do simplify a number of tasks and allow a consumer to get up and using the phone in a matter of seconds with very little learning. The emphasis of the rest of this article will be on understanding and using a phone running JB with the stock out of box experience provided on the Samsung Galaxy Nexus. It will assume the reader has not or is not going to install Mobile Accessibility.

Once you power on the phone for the first time, in order to make it usable for a blind person, you will need to activate TalkBack At the setup screen by doing a  double tap and hold for four seconds anywhere on the screen.  You will be asked to keep holding, if you want accessibility turned on.  Talkback will then switch itself on properly and you can release the screen. 

Optionally, you can activate Talkback by getting a sighted person to go to the settings screen, selecting accessibility and checking the “talkback” checkbox. also on the same screen make sure to check the checkbox for allow web scripts.

 

What is great about the experience on android is that it requires you to memorise only a small number of gestures or actions to get up and going.

Using Touch Exploration, Initially, you should start out by “Exploring” the screen by sliding your finger slowly across the surface of the touch screen. As you slide your finger across the surface of the screen you will hear the items under your finger announced. You will also feel a light vibration from the phone paired with a “bubble like sound” to indicate you are passing over a clickable object.

When you raise your finger from the surface of the screen, the device will remember what item you last touched. Talkback will announce if an item is clickable or long clickable when using touch exploration if you leave your finger on the same item or an area of the screen for a short period of time. Once Talkback announces that your finger is on an item or clickable item, you can at that point perform a few actions to interact with the item.

You can double click the item by tapping the surface of the screen quickly twice with 1 finger. This usually activates the item or selects the item. This works very similarly to hitting enter on a desktop PC.

Next, to perform an action or activate a context based menu you will need to be able to “long click”. You can long click (click and hold) an item by tapping the screen twice with 1 finger and on the 2nd tap keeping your finger on the surface of the screen until the device responds. Usually this action either allows you to click and drag an item or more often opens a context based menu related to the item you clicked (i.e. it acts like a right click on a desktop PC).

By sliding your finger or “swiping” from left to right or right to left quickly across the screen you can move forward or backwards through items on the screen. This is very similar to tabbing and shift tabbing on a desktop PC.

 

. Many android screens have lists or panes that contain more items than can be displayed on the screen at once. You move through the list by scrolling. To scroll you simply swipe 2 fingers across the surface of the screen. It is important that when swiping your fingers that they hit the surface of the screen slightly apart and at the same time. It is also important that they move in a relatively straight direction either up, down, left or right. As you scroll through a group of panes or a list of items you will receive information verbally about where you are currently in the list (such as “displaying items 5 through 10) and you will hear audio feedback that goes from a high to low pitch sound as you scroll from the beginning to the end of the list or group.

• You also have a number of configurable gestures. You can pair a gesture with a limited choice of commands. By default, the following gestures work:

• -          Draw an upper case L on the screen (i.e. touch the surface of the screen and quickly draw a line down, than continue to the right and raise your finger) to go at any time to the recently used applications.

• -          Draw an upper case L backwards (i.e. touch the surface of the screen and quickly draw a line down, than continue to the left and raise your finger) to go to the previous screen

• -          Draw an upside down upper case L (i.e. touch the surface of the screen and quickly draw a line up, than continue to the right and raise your finger) to go to the notification area

• -          Draw a backwards and upside down upper case L (i.e. touch the surface of the screen and quickly draw a line up, than continue to the left and raise your finger)to go to the “home” screen

•  

The Android screen is generally divided into 3 pieces. The 1st is the notification bar, which is a thin slice of the screen at the top of the screen. The notification bar contains alerts, date/time, battery levels and other important information. The 2nd section is a row of icons on the bottom of the screen, that from left to right are back, home, recent apps & menu, which will be referred to as the “soft key icon bar” in these articles. The soft key bar is present at the bottom of the screen at all times. This allows you to go to the workspace by clicking the “home” icon. Clicking the “back” icon will return to the previous page or screen. To get a list of the recently loaded apps click “recent apps”. The rest of the space on the device’s screen below the notification bar and above the soft key bar is devoted to the content of the current app or screen currently loaded. This area will be referred to as the “content area” for the rest of these articles.

When you power on your phone you will be placed on the “lock screen”. There are a variety of settings that you can explore that allow you to change how you “unlock” your device. These range from a simple 1 finger slide to unlock, to camera based facial recognition all the way to being required to enter a complex password. By default, on my Samsung Galaxy Nexus, the slide to unlock setting is enabled and this requires you to touch the lower center of the screen and slide it right to the “unlock” icon.

Once your phone is unlocked you will be placed on the main “. Workspace”. The workspace is the equivalent to your “desktop”. It has 5 panes (or screens) that you can scroll between by “flicking” or “swiping” with 2 fingers either left or right on the surface of the screen. The panes of the workspace are a 4×4 grid of place holders that can contain icons or widgets that you can customize. Below the workspace pane is a “dock” or bar of icons that sits just above the “soft key bar”. The dock is only visible when on the workspace and not in apps… The icons on the dock from left to right are Dock Space 1 & 2, Apps and Dock space 3 and 4. You can place shortcuts to apps into Dock Space 1-4 to quickly access apps you use very regularly such as the phone or email app. In the middle of the dock is a permanent icon called “Apps”. The “Apps” icon is similar to the window key on a PC in that it launches the “app menu” which contains all the apps that have been installed on the device. These will be displayed in a 4×4 grid in the content area of the screen. The number of panes in the app menu grows as you install apps on the phone. You perform a 2 finger swipe left or right to scroll through the panes.

This should get you started, but stay tuned for the next part of the article “A Blind Trek through Android Part 2: Eating the Jelly Bean (Getting Productive)”.

 

Related posts:

1. A Blind Trek Through Android – Part 1: Unwrapping the Ice cream sandwich (Getting Started)

2. Android and external keyboards

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download