Eyes-Free Updates: Marvin And TalkBack Simplified

We routinely push updates to our access tools on Android; usersget these updates automatically via Android Market updates. Wejust pushed out updated versions of TalkBack, our Open Sourcescreenreader for Android, and Marvin, the Eyes-Free shell. Hereis a brief summary of these updates:

  • Android applications can now programmatically discover ifTalkBack is running, thanks to the latest changes inTalkBack. From an end-user perspective, this means that you nolonger need to configure Eyes-Free shell via EyesFreeConfig tobe the default home. If you run TalkBack, and have EyesFreeShell installed, then pressing Home automatically givesyou the EyesFree Shell.Remember, you can always get to the default Android Home bylong-pressing Back.
  • EyesFree Shell now includes a touch-based shortcutsmanager. Until now, shortcuts needed to be explicitly configuredby editting an XML file on the SDCard. With the recent EyesFreeupdate, you can interactively define short-cuts via a touch-basedShortCuts manager. By default, we have assigned shortcut1 to the ShortCuts manager; so to invoke this newfeature, do:
    1. Stroke left (4 using stroke dialer notation) toenter the shortcuts screen.
    2. Stroke up and to the left (1 using stroke-dialernotation) to invoke application ShortCuts Manager.
    3. Use the trackball/D-Pad to configure each of the 8 availableshortcuts.

Marvin: We hope this gives some minimal relief to the painin all the diodes on your left side.

Silencing Speech With A Wave Of Your Hand On Android 2.0

Update To Android Access: TalkBack

Smart phones tend to be short on physical buttons --- evendevices like the G1 or MotoRola Droid have very few buttons when thephysical keyboard is not open. This provides interestingchallenges when designing an efficient eyes-free interface ---especially given the old maxim Speech is silvern, but silenceis golden!.Said differently, once you have built a systemthat talks back, the first thing you want to build is anefficient means of silencing spoken feedback.

Early versions of TalkBack on Android skimmed by without astop speech button --- you basically moved from one activity toanother,and the speech produced by the new activity effectivelystopped ongoing spoken output. However, as we make more and moreapplications work seamlessly with our Access APIs, it's alwaysbeen clear to us that we need a global stop speechgesture! Notice that I said gesture --- notkey --- stopping speech is a critical function that we'dlike to enable without having to pull out the physical keyboard,and something we'd like to have devices without a physicalkeyboard.

In the spirit of the dual to every access challenge is an opportunity toinnovate, we recently launched a new experimental TalkBackfeature on devices running Android 2.0. Devices on the Android2.0 platform have a proximity sensor on the top frontleft corner of the phone --- this is typically used to lock thescreen when you're holding the phone up to your ear when on aphone call. As the name implies, the proximitysensorfires when you get close to it --- you can activate itby waving your hand close to the top left corner of the phone. Asan experimental feature, we have configured the latest version ofTalkBack to silence ongoing speech if you wave your hand infront of the proximity sensor.

Note that this is a new, experimental feature --- it'ssomething that we welcome feedback on our public Eyes-Free GoogleGroup. We'd like to know if you accidentally activatestop speechbecause of this new feature. In having usedit for a few weeks, I find that I am not triggering itaccidentally --- but that might well be a function of how I holdthe phone.

What Devices Does This Available On?

Note that at the time of writing, the devices that have aproximity sensor that I have used this on include:

  • MotoRola Droid from Verizon
  • Google NexusOne

Note that the G1 and other older Android devices did not havea proximity sensor.

R.I.P. Kenai - Microlog4Android has been Moved

I admit it. I was wrong. It is not business as usual for microlog4android. Yesterday I got an e-mail explaining that Kenai will be shutdown. But fortunately there are other hosting options. I wanted to move the project as fast as possible and have a simple solution. I was recommended by my esteemed colleague Hugo about using Google Code together with GitHub. Google Code allows a project to use other service, such as GitHub, when Google Code  is not sufficient enough. Moving the source code was rather simple. The part that took time was to generate a new SSH key for my new computer. The nice thing with git is that all the history is preserved.

To move the source code from the Kenai git repository I did the following:

git pull git://kenai.com/microlog4android~source-code-repository

git remote add git@github.com:johanlkarlsson/microlog4android.git

git push origin master


It was as simple as that. The first line was needed to pull the source code out from Kenai, since I had no backup copy on my new computer. So for a user with the code on his computer, it would be even simpler.

Right now it is time for me to relax a little. I know I have a lot of things to do tomorrow at work. Please stay tuned for more updates about microlog4android.

The project:
http://code.google.com/p/microlog4android/

The source code:
http://github.com/johanlkarlsson/microlog4android

The Future of Kenai?

As I wrote in an earlier article, the Android part of Microlog has been forked into a new project. The project is hosted on Project Kenai beta. This is Suns offering for open source project. With Oracles acquisition of Sun this project seems to be endangered.  But I am not sure how it will be affected. If it is going to be changed, I sure hope that the projects will get support for the migration if any. For more information, read the article about the subject on Kenai's blog.

I guess we have to continue with business as usual for microlog4android.

1Vox --- Your Query Is Our Command

Video: 1Vox --- Your Query Is Our Command

1 Video: 1Vox --- Your Query Is Our Command!

Device Used: Motorola Droid on Verizon

Speech interface designers often express surprize at the the factthat the average blind user rarely if ever uses spoken input. Butwhen you come down to it, this is not too surprizing --- giventhat the eyes-free user has speech output active, the overall system ends up talking to itself!

To show that these conflicts can be avoided by careful user-interface design,we demonstrate 1Vox --- our voice-search wizard for the Marvin Shell.

  1. You activate 1Vox by stroke 9 on the Marvin screen.
  2. You hear a spoekn prompt Search
  3. You hear a little auditory icon when the system is readyfor you.
  4. You speak oft-used queries e.g., Weather Mountain View.
  5. You hear a short spoken snippet in response.

We called this widget 1Vox --- in honor of the Google onebox foundon the Google Results page.

Author: T.V Raman<raman@google.com>

YouTube And TalkBack --- Entertainment On The Go

Video: TalkBack And YouTube

1 Video: TalkBack And YouTube

Device: Motorola Droid on Verizon

This video demonstrates searching for and playing YouTube videos with TalkBack providing spoken feedback at each step in the interaction.

  1. Launch YouTube from the Marvin Application launcher.
  2. The trackball can be used here to move through the list of videos.
  3. Pressing down on the trackball launches the selected video.
  4. Press menu key to enter the YouTube application menu.
  5. Click on Search with the trackball.
  6. Type a query into the edit field. TalkBack speaks as you type.
  7. Press Enter to perform the search.
  8. Scroll the results list with the track-ball.
  9. Click a desired result to start playing the video.

Author: T.V Raman<raman@google.com>

Using TalkBack With Google Maps

Video: TalkBack And Google Maps

1 Video: TalkBack And Google Maps

Device Used: Motorola Droid On Verizon

TalkBack provides spoken feedback as you use Google Maps.In this video, we will demonstrate typical maps tasks such as:

  1. Launch Google Maps using the Marvin application launcher.
  2. From within the Maps application, press the menu key.
  3. Select Search and type a query into the search field.
  4. Notice that I can type a partial query and haveauto-completion based on previous searches.
  5. Press Enter to perform the search.
  6. Bring up the result list in ListView by touching thebottom left of the screen.
  7. Scroll through this list using the D-Pad.
  8. Click with the D-Pad (or enter) to select a business.
  9. Scroll through available options, and click Get Directions.

10.Click the Go button to get directions.

  1. Scroll with the trackball to hear the directions spoken.

In addition, you can also use Google Latitude to locate yourfriends.

Note that other Map tools such as Google Latitude are accessiblefrom within the set of options that appear when you press themenu key.

Author: T.V Raman<raman@google.com>

Powered by Blogger