Apple explores home power system, mood sensing media software

More new patent applications from Apple this week show a potential device that would analyze and control the power consumption of electronic devices within a home, and a method for sensing a user's mood and choosing media based on their emotional state.

Smart home power panel

Apple's filing for "Intelligent Power Monitoring" describes a system that would identify networked hardware, along with processes on a computer, to determine how much power consumption is necessary to keep everything running. The system could then predict the cost of the existing power requirements, and allow users the ability to reduce their overall power consumption.

The system would allow users to execute or close applications to create an ideal power plan. Through the system, devices such as iPhones, iPods and printers, along with Mac applications like Safari, Finder and iTunes, could be ranked according to priority levels assigned by the user.

Apple, in the application, noted that household power consumption continues to grow as devices like computers are left on for longer periods of time, and portable electronic devices have batteries that frequently need to be recharged. With the rising cost of electricity, these habits will not only result in wasted power, but also larger bills for consumers.

The application describes an "electronic device" that would aim to reduce waste and minimize a user's bill by calculating how much power a device will need to perform certain tasks.

"The cost of power can vary based on a number of factors, including for example the time of day, week or month, the consumer's tier or type of service, the amount of power previously consumed by the consumer, alternate sources of power used by the consumer (e.g., solar cells used during the day), or any other suitable criteria," the application reads.

"The criteria can be combined into one or more tables or graphs, or into one or more equations or algorithms used by the power supplier to determine how much to charge for each consumer's power use."

The system would define "boundaries or limits" to the power cost of operating a device. Users could, for example, say that their computer is not permitted to use power that totals more than a specified amount of money each week.

"Before performing each operation," it states, "the electronic device can then determine the power cost associated with the operation, and determine whether the power cost satisfies the boundaries or limits set for the operation."

Credited to Anthony Fadell, the invention was filed with the U.S. Patent and Trademark Office on May 8, 2009.

Another report on the matter Thursday included images that were implied to be from the "Intelligent Power Monitoring" patent application. However, those drawings are not a part of the specific application revealed this week. They show a greater emphasis on home automation with a mock-up of a house and various power plugs, but their source is unknown.

Mood-sensing software

New software could select music in response to a user's mood, through a system that would determine whether they are happy, sad, angry or something else.

The system would detect a user's mood through a capacitance sensor in a variety of manners. For example, a sensor could be a part of a device's touchscreen panel, from which it would gather data and compare it to information corresponding to a common set of moods from a sample sized population.

The system could then recommend or automatically play various media types, including music and movies, based on the suer's current mood. The technology could also be used to counteract a "bad" mood: slow or soft music could be played when the user is angry or upset.

If no appropriate content is available, such a system could also automatically download or stream the right video, music or photos for that moment in time.

The system could also keep track of users' prior moods and playback preferences, and use that information to determine the best media to choose based on their current state of mind.

Entitled "System and Method for Creating Playlists Based on Mood," the application was filed for on July 10, 2008.

Contacts, promotions on iPhone home screen

Another application presents an option for users to place individual contacts directly on their phone's home screen. Simply titled "Adding a Contact to a Home Screen," the document describes just that.

The contact icon could be used to retrieve and display contact information, and also to access an application that is specifically chosen for that contact. The icon could also employ a proximity sensor with the contact's own separate cell phone, and show up on the screen only when that person is nearby.

"User created icons can allow convenient access to all information and applications related to a contact," the application reads. "Thus, consecutive access to applications related to a contact can be greatly diminished. Additionally, temporary user access to applications relative to a location allows a user to minimize the amount of application data stored on a user mobile device."

Using this method, the icon could also serve as an advertisement for a business. The included images show a company called "Rocket Java" informing the user about a special on dark roasted Jamaican blend.

Previous applications have also addressed the possibility of more dynamic home screens, with a location-aware system offering custom icons and data, such as weather, based on what town the device is currently in. For example, when in San Francisco, a "San Francisco" icon would appear on the screen, and take the user to a location-specific option.

A lot of this is just plain ridiculous. Mood sensing? What a load of crap.

There is no way to sense "moods" through technology. They should be embarrassed to publish such a patent.

Creative thinking, no matter where it leads or how unusual it seems is always preferable to the kind of uninspired meat-and-potatoes that permeates the industry.

New software could select music in response to a user's mood, through a system that would determine whether they are happy, sad, angry or something else.

The system would detect a user's mood through a capacitance sensor in a variety of manners. For example, a sensor could be a part of a device's touchscreen panel, from which it would gather data and compare it to information corresponding to a common set of moods from a sample sized population.

Hmmm . . . there might be several interesting ways this could be implemented? Mood or emotional state often manifests itself physically. Touch pressure, temperature sensing, speed of input. Depends on the capabilities of this "capacitance sensor."

Avie Tevanian recently commented that the prototypes for Apple's devices in the market today were developed by Apple years ago. Perhaps a few years from now such mood-sensing tech won't seem so unusual at all.

A lot of this is just plain ridiculous. Mood sensing? What a load of crap.

There is no way to sense "moods" through technology. They should be embarrassed to publish such a patent.

No, it could be possible to detect moods, for example using some type of brain imaging technology but to try to suggest a musical selection based on the results is the dumb part. I guess there will always be people who prefer not to think for themselves.

No, it could be possible to detect moods, for example using some type of brain imaging technology but to try to suggest a musical selection based on the results is the dumb part. I guess there will always be people who prefer not to think for themselves.

Well, it *may* be *possible* using not yet invented technology, but I'm pretty certain that it isn't actually possible today, or even for the foreseeable future.

All those shows on the Discovery channel where someone claims to be "watching thoughts" or "detecting emotions" using brain scans are completely false I can assure you. Scans just detect electrical activity or heat. In reality they are hardly different in concept from the old "mood rings" that used to be sold in the 70's. Those detected your body heat.

There is a big, big, big difference between "there's electrical activity in this part of her brain" and "she's depressed." The detection of the mood is a rather wildly subjective assumption. Anyone who tells you they can detect moods or emotions using technology is a quack.

If Apple is in any way shape or form investigating home automation technologies I'm all for it... The market as it stands now sucks pure and simple.

X10 -- Often cheaply made and unreliable devices.

Insteon -- Midlevel priced often unreliable devices that eventually get fixed...

Zigbee and UPB? -- Two other standards usually higher priced but have no 1st hand experience with them when it comes to reliability.. I know one was charging $5,000 just for their developer SDK and it only supported windows...

Yea the market sucks in a major way.

Unfortunatly it isn't exactly a market Apple gels with all too well...

Electrical Outlets and Wall Switched that need to be installed by an electrician or a home owner who knows what they are doing... Yea... thats WAY too much roll up your sleeve and get out the toolbox and make sure someone mans the breaker panel for Apple to even consider dealing with.

Could you imagine the lawsuits?!?!

Some Joe Sixpack buys a switch and goes to install it... and he EVEN turns off the breaker to the device that the switch controls (the man was using his brain!) and as he's installing it he gets a shock that knocks him on his ass...

What happened??

Simple... the switch box had feeds from more than one breaker going to it... (something that does happen on occasion)... Trust me, I speak form a great degree of certainty on this particular subject... (ouch!). One of those lessons you only need to be taught once and it sinks in for a very long time!

Anyway.. I'd certainly like someone to jump in and do to the HA industry what Apple did to the cellphone industry.

All you need is a camera with face detection software (which Apple already has in iPhoto) and some way to analyze facial expressions for things like furrowed eyebrows and narrowed eyes, along with a neutral mouth, possibly with clenched jaw, like you probably have on your face right now, because I just told you that you were wrong and called you "genius" sarcastically.

Multiplex is an online comic strip about the staff of a movie theater.

LOL ..I'm also not into the Mood Sensing crapola. I can barely tell the mood of my girlfriend and I've got almost 40 years of experience. I'm doubting Apple or anyone else will get this down anytime soon.

He's a mod so he has a few extra vBulletin privileges. That doesn't mean he should stop posting or should start acting like Digital Jesus.- SolipsismX

I don't buy the mood sensing portion but could see them dabbling in the power monitoring/metering, etc. We've seen a lot of companies that aren't specific to home automation entering that market in the last two years. There are already a number of software and software/hardware packages in the home automation market to do this so it will be interesting to see if they take it anywhere...

All you need is a camera with face detection software (which Apple already has in iPhoto) and some way to analyze facial expressions for things like furrowed eyebrows and narrowed eyes, along with a neutral mouth, possibly with clenched jaw, like you probably have on your face right now, because I just told you that you were wrong and called you "genius" sarcastically.

Nah, I'm making a face like this

Because you are wrong. what you are describing is facial expression detection software. Not mood detection. I could be suicidal but making a smiley face and it would be fooled. Also it would fail completely if I was a chimpanzee.

If Apple is in any way shape or form investigating home automation technologies I'm all for it... The market as it stands now sucks pure and simple.

X10 -- Often cheaply made and unreliable devices.

Insteon -- Midlevel priced often unreliable devices that eventually get fixed...

Zigbee and UPB? -- Two other standards usually higher priced but have no 1st hand experience with them when it comes to reliability.. I know one was charging $5,000 just for their developer SDK and it only supported windows...

Yea the market sucks in a major way.

Unfortunatly it isn't exactly a market Apple gels with all too well...

Electrical Outlets and Wall Switched that need to be installed by an electrician or a home owner who knows what they are doing... Yea... thats WAY too much roll up your sleeve and get out the toolbox and make sure someone mans the breaker panel for Apple to even consider dealing with.

Could you imagine the lawsuits?!?!

Some Joe Sixpack buys a switch and goes to install it... and he EVEN turns off the breaker to the device that the switch controls (the man was using his brain!) and as he's installing it he gets a shock that knocks him on his ass...

What happened??

Simple... the switch box had feeds from more than one breaker going to it... (something that does happen on occasion)... Trust me, I speak form a great degree of certainty on this particular subject... (ouch!). One of those lessons you only need to be taught once and it sinks in for a very long time!

Anyway.. I'd certainly like someone to jump in and do to the HA industry what Apple did to the cellphone industry.

There is some history between Echelon Corporation and Apple:

-- Mike Markkula, Apple Investor, Chairman and founder (along with Jobs and Woz) is the Founder and a major shareholder of Echelon

-- Peter Mehring, UMAX founder, later Senior VP of Engineering at Echelon left to join Apple as VP of Mac Hardware Engineering in 2004

When Markkula started Echelon, one of the things it was working on was to have each device in a building (home, factory, etc.) that was connected to the electrical grid uniquely addressable (monitor-able and controllable).

Last I looked, Echelon had some offerings for business, cities, etc. but nothing scaled to the home.

Recently, the mayor of SF used an iPhone to demonstrate how to monitor and control streetlights:

what you are describing is facial expression detection software. Not mood detection.

I didn't "describe" anything. The inventors of the mood detection software describe it that way. Why don't you Google the term "mood detection software" and try reading a handful of the 1,800,000 results proving you wrong?

Your "argument" is no different than say that "lie detectors don't actually exist, because lie detectors don't actually detect a lie; they just detect changes in heart rate, sweat and brain activity, and if someone said something false that they thought was true, it wouldn't work." Yes, no shit, that would be correct in some willfully obtuse technical way. But you're just avoiding the fact that that's the kind of thing this patent is talking about.

You. Are. Wrong.

Multiplex is an online comic strip about the staff of a movie theater.

> There is no way to sense "moods" through technology. They
> should be embarrassed to publish such a patent.

If anyone should be embarrassed it's the patent office. Their job should be to weed out the silly nonsense. Instead they now patent the sun coming up in the morning and every thing else anyone can figure out how to write down.

So I'm in a quiet, mellow kind of mood. How the %^&# does the computer know whether I want to stay that way? If so, do I want classical, lounge jazz or soft rock? If not, should it play hard rock, hip hop or swing?

I have to think that some of this is just intentional horse$hit to throw the hounds off the scent.

Quote:

Originally Posted by JSmith

> There is no way to sense "moods" through technology. They
> should be embarrassed to publish such a patent.

If anyone should be embarrassed it's the patent office. Their job should be to weed out the silly nonsense. Instead they now patent the sun coming up in the morning and every thing else anyone can figure out how to write down.

Maybe the patent application was meant as satire to protest all the seemingly silly patents for which Apple gets sued.

A lot of this is just plain ridiculous. Mood sensing? What a load of crap.

There is no way to sense "moods" through technology. They should be embarrassed to publish such a patent.

maybe, maybe not. but it might be the start of a system to detect someone entering the room and turning on the lights, playing music etc.

patents are often filed for technologies that don't play out the original way.

and if nothing else, anyone else that wants to try to create such a system could end up having to pay royalties to Apple. so still a win

Quote:

Originally Posted by gmcalpin

All you need is a camera with face detection software (which Apple already has in iPhoto) and some way to analyze facial expressions for things like… furrowed eyebrows and narrowed eyes, along with a neutral mouth, possibly with clenched jaw, like you probably have on your face right now, because I just told you that you were wrong and called you "genius" sarcastically.

"although you took very thorough precautions in the pod against my hearing you, I could see your lips move. "

Quote:

Originally Posted by JSmith

If anyone should be embarrassed it's the patent office. Their job should be to weed out the silly nonsense.

so they should be censors, deciding what is worthy invention and what is nonsense. and anything they deem stupid should just be a free for all that the original thinker gets no credit for.

so they should be censors, deciding what is worthy invention and what is nonsense. and anything they deem stupid should just be a free for all that the original thinker gets no credit for.

Actually, that's pretty much their job. In addition to making sure it hasn't been invented by someone else before. To be honest, none of these ideas in these applications seem "novel and new". Most have been seen in other applications in one form or another.

For example current home automation systems already allow you to define which components of the managed system should be turned off (or to low power) during high cost hours (even automatically receiving the hourly price from the utilities company). All apple is doing is saying "Hey, We can add our computers and iPods to that network as well to be controlled".

Do you think no other company has already defined interfaces for computers to be connected to a home control system? Mind you there are other computers besides Macs, PCs and the like. For example the first hit on google: http://www.openhas.com/index.php?opt...d=12&Itemid=18

Personnally I feel that even though these are good ideas of application of existing tech, they shouldn't be granted a patent. (mood playlists exist, mood sensing exists, combining the two shouldn't be patentable).

No, it could be possible to detect moods, for example using some type of brain imaging technology but to try to suggest a musical selection based on the results is the dumb part. I guess there will always be people who prefer not to think for themselves.