Recent Articles

Apple is investigating new user-interface ideas, including motion-based function selection and multi-layered interface elements that change their appearance during use.

Two patents published Thursday by the US Patent and Trademark office give a glimpse into some of the interface thinking going on in Cupertino - and possibly hint at capabilities of future iPhones and the look-and-feel of upcoming versions of Mac OS X.

Both of the applications were originally filed in October 2007, but are only now being made public. The first, "Movement-based interfaces for personal media device," describes how a handheld's functions could be controlled by motion sensing performed by an internal "position, orientation, or movement (POM) sensor."

The first of the two filings details a way to control a handheld device such as an iPhone or iPod without needing to look at its display.

One example given is that of a runner wanting to change a tune on her iPod without having to take her eyes off her path and run into a tree. Instead of risking breaking her nose, she could merely grasp her iPod - which would tell it to awaken its POM and ready it for a command - then move it in a predetermined pattern that would be translated into the "skip to next song" request.

Rotate your iPhone to scroll through lists

Movement-based commands could be used to control a variety of functions, including launching or closing apps, selecting or de-selecting features, changing settings, making or ending phone calls, or - in a hint of future iPhone features - "initiating or ending an audio or video recording session."

In addition to POM-based input, the filing also describes how feedback could be provided to the user through vibration patterns, which would be useful when a command doesn't trigger audible changes such as a skipping from one tune to another.

The second of the two filings centers on what it refers to as providing a "more aesthetically pleasing" GUI.

That pleasure is to be induced by a set of graphics layers that define a GUI element's background color, shape, alpha-channel transparency, and patterns that could all change in response to a user's movement of the element.

For example, a scroll bar could change its appearance while being moved in such as way as to indicate the direction in which it is being moved. Although the filing focuses to a large degree on scroll bars, it also discusses windows, buttons, scroll bars, icons, sliders, tabs, toolbars, "and so on."

In addition to user input, the filing also describes how the same multi-layered system could be used to modify GUI elements based on the time of day, how long the computer has been in use or idle, or in response to any other condition.