Link: Apple's AssistiveTouch Helps the Disables use a Smartphone

A favorite line: "Dimensional compression is dimensional compression, however, and even those sentient beings that reside in string-theory N space probably whine that their N - 1 dimensional display device (necessary to fit in their N - 1 dimensional pockets) fails to capture the rich experience of their real N space."

Main site: http://www.usabilityprofessionals.org/conference/2012/

They're also looking for reviewers, and you can sign up for that here: http://www.surveymonkey.com/s/WYMT8M2

I've attended UPA for several years now and am helping on the committee this year. I can answer questions if you want to know more. In my opinion, UPA is the best UX/HCI conference focused on practitioners.

This is a revised chapter for the 3rd edition of the HCI Handbook and includes more coverage of direct-touch input than in the 2nd edition (2007).

Reverse Scrolling Direction

One of the first things you see after installing Lion is a little tutorial screen alerting you to the fact that your scrolling world has been turned upside down. This is a change to the scrolling metaphor -- you're now manipulating the content rather than the scroll bars (which are now hidden much of the time in Lion, though you can still click and grab them if you try). This is now called the "Natural" scrolling direction by Apple.

I wondered whether users would get used to this. So far, judging by reviews and Twitter comments, it looks like most people are okay with it, but some find it irritating, especially if they have to switch between computers.

One factor that forced this change, I suspect, is the new and more fluid navigation left and right between screens (with either 2, 3, or 4 fingers, depending on how you configure it). This feels right when the screen moves with your finger direction (the "natural" direction). If you go back to the unnatural scrolling direction then sliding left and right feels odd. (But this depends on the particular scroll or swipe navigation gesture -- more on this below.)

More fluid gestures

In addition to the more fluid swiping/scrolling between screens, scrolling now has the edge bounce physics as in iOS. This depends on the application, though; so far it's only supported in Apple applications like Safari and iWork. I don't know if Apple will be opening up this feature to other developers.

Two-finger double-tap to zoom ("Smart zoom")

This works well, but again only in Apple programs for now. I had questioned how this would coexist with the existing two-finger tap option (for secondary click). It looks like my prediction for how they would handle this was right -- there is now a noticeable delay after two-finger tap responds, if you have Smart zoom enabled. This allows the system to unambiguously recognize the two gestures. (If you didn't have this delay then you would get secondary clicks happening before smart zoom happens.)

Different navigation gestures

In the previous post I noted that Apple was introducing two-finger swipes in addition to three-finger swipes for navigation, and that this might confuse users. The reality is even more complicated than that. For several of the navigation gestures on the "More Gestures" tab (pictured above), the user can select between

• scroll with two fingers,
• swipe with three fingers,
• swipe with two or three fingers, and
• swipe with four fingers.

And changing the setting for any one gesture may change the settings for the others so that they don't conflict.

They've dealt with "Three finger drag" conflicting with three finger navigation by linking that setting to the navigation settings; if you enable Three finger drag then you have to use two or four finger gestures for navigation.

There's some inconsistency in the terms that Apple is using for these gestures: there is both "scroll" and "swipe" for the options for Swipe between pages. In Safari, "scroll" left or right seems to mean you get the continuous sliding back and forth for navigation. If you choose "swipe" it's a discrete action and you don't get a preview as with "scroll." For the next setting, however, (Swipe between full-screen apps) the options are called "swipe" yet they give you the smooth version, so I would have thought they'd be called "scroll."

I wondered how two-finger scrolling and two-finger navigation would get along. For example, if you are zoomed in on a page in Safari, will two-finger scroll pan around the page or navigate forward and back? Apple's solution seems to work well: it pans/scrolls until you get to the edge of the page, then stops. If you start another gesture, it then does navigation.

More on "Scroll Direction: Natural" and navigation gestures

The scrolling direction applies not only to two-finger scrolling/panning, but also to the continuous swiping (or scrolling) for navigation between pages or full-screen apps. It does not, however, change the direction of the discrete swiping gestures for navigation. This can lead to some odd configurations, such as with the Swipe between pages settings (pictured above). Scroll direction applies to two-finger scrolling/swiping but not the three-finger swiping. So if you select "Swipe with two or three fingers," then

• if Scroll direction: natural is checked, swiping two fingers right will go back, but swiping three fingers right will go forward,
• if scroll direction: natural is unchecked, swiping two fingers right will go back, and swiping three fingers right will also go back.

That this mismatch between the direction of continuous vs. discrete navigation gestures is allowed seems odd, but I don't know if it will bother users, or just those who go digging, like me. Users may never master all these gesture combinations and instead just stick with one or two that they're familiar with.

I suspect that the reason there is an option for both two and three fingers (and thus the mismatch) is because the two finger scroll/swipe is only supported in Apple programs for now, so if you use Firefox, for example, you need that option to continue using three-finger swipes.

So many choices

If the above has confused you, then I suspect it's not just my confusing writing -- Apple has given users a surprising number of choices for configuring their trackpad in Lion. The settings page itself is much bigger, with three tabs instead of the previous single-page layout. And because of the dependencies I noted above, changing one setting might change other settings automatically, even settings on another tab.

What's missing?

Despite the more complicated settings panel, there are a few controls missing that were present in Snow Leopard (pictured below).

At first I thought that double-click speed, scrolling speed, tap-to-drag, drag lock, and the option to turn off scrolling inertia were all gone, but it turns out they're now hidden away in the Universal Access settings. You have to select the "Mouse & Trackpad" tab and then select Trackpad Options (pictured below). That's a fairly non-obvious place for them to be, but I suppose it's good to have them somewhere. The one that I'm most surprised is hidden is the tap-to-drag option, and it appears that it defaults to off when you install Lion.

The only feature that really appears to be gone for good is the old-style screen zoom, which worked by holding the Control key and scrolling. That's now replaced with Smart zoom using two-finger double taps.

Other observations

I've written mostly about the changes to features, but there are of course a couple of new ones: Launchpad is done with a pinch with thumb and three fingers, Show desktop is done with a spread with thumb and three fingers. These are a bit awkward to perform but seem to work well enough.

As far as I can tell there are no other changes to the recognition or responsiveness of other gestures like pinch and rotate. Likewise, "resting finger" support on the trackpad appears to work the same as before. (You can rest your thumb at the bottom of the pad, for example, and point or scroll with your fingers -- the system ignores your thumb in this case. Resting finger support is one of the most technically challenging aspects of clickpads.)

If you have a Magic Mouse, you'll notice that Apple has increased the choices there as well, but that's a different post.

I assume this is due to a concern over copyright violation, but that seems a bit extreme as it makes it difficult to copy even small snippets for note-taking or other writing tasks (and I'm all in favor of reasonable copyright protection). It's absurd that it's easier for me to tweet a sentence from a paper book to an iDevice than it is to tweet from an ebook on that same device.

The second thing I noticed was that highlighting a passage -- a feature all the e-readers advertise -- has a huge usability issue. You can't highlight a passage that goes over a page boundary. In the situation pictured above I tried all the gestures I could think of to move the marker onto the next page while still highlighting, but nothing worked. I then tried decreasing the text size to make everything fit on one page. That still left a page break, but after a number of increase/decrease text operations the pagination magically shifted so that I got the passage I wanted onto one pagein order to highlight.