Category Archives: Microsoft Kinect

Microsoft plans ads that monitor your emotion

One of the fallacies of marketing is we “target” people as if they were static bull’s-eyes — you there, in the affluent demo, married with kids, PRIZM category mid-life crisis with SUV, intent to buy a red convertible — when really people contain multitudes. Today you’re an office worker. Tonight a mom. Later tonight, a Glee-watching high schooler. Much later, a sexy vamp. Whatever you’re into, you’re into different things, yet marketers fail to recognize your emotional and modality states.

Microsoft will change that. News percolated today that the Redmond giant has a patent for an ad system that would recognize your emotional state, and then match corresponding advertisements. The patent gives a hypothetical example: “For instance, OMG, Inc., is an advertiser that owns bowling alleys and lounges specializing in birthday parties…” OMG wants to serve ads that go “Bang!” with excitement, but kids or adults who are feeling sad don’t react well to such ads. So being smart, OMG sets up multiple versions of its advertising creative, and when the scanner/camera notices the digital viewer looks sad or stressed, either suppresses the ad (no whiz-bang party for you glumster) or could pitch an alternative (come relax in our chill lounge…).

Microsoft calls this “emotional targeting.” You may ask, how in the world could a company track our emotions? Well, your laptop has a camera pointed at your head; Microsoft owns Kinect, which uses body-monitor scanning to allow cool video games, and Skype, where you share videos of your face; in fact, every company working on a smart TV is embedding video cameras aimed directly at you.

In George Orwell’s 1984 the TV sets watch people. In one scene the protagonist moved out of the room, around a corner, to open a book or journal to try to have privacy, but the monitors caught him. Are we afraid of what could happen if the devices we love to watch start watching us back? Or is this a natural extension of marketers trying to personalize offers meaningful to us by moving beyond data trails to direct observation?

If you’re curious, here’s a list of the ways Microsoft says it might track you:



The client devices … include, without limitation, personal digital assistants, smart phones, laptops, personal computers, gaming devices, or any other suitable client computing device. In some embodiments, the client devices include image capture and voice capture devices. The image capture devices include cameras, video cameras, etc. The voice capture devices include microphones, recorders, etc. The client devices … include a user and system information storage to store user and system information on the client device. The user information may include search histories, cookies, user identifiers, online activities, assigned emotional states, and passwords. The system information may include Internet protocol addresses, cached Webpages, and system utilization. 

What to think of Apple’s coming 3-D

In an age where tech geeks get excited about every minor Facebook UX update, it’s easy to lose the forest of trends for the trees. So let’s take a look at Apple’s recent patent for a glasses-free 3-D system.

First, the tech. Current 3-D systems require some form of glasses that allow images to be slightly shifted between your left and right eyes; two eyes, after all, are required to see in stereoscopic vision. Creating the illusion of depth in an image has been around since the 1860s, when photographers would shoot two frames from slightly different angles and use gadgets such as stereoscopic viewers to show one unique image per eye. Today’s most-modern 3-D televisions use a rapid blinking approach, in which the left- and then right-eye image are flashed across the entire TV screen hundreds of times per second, synchronized to glasses which use LED shutters to simultaneously shut the images off from alternate eyes. The illusion is pure holography, with the images floating in front of you, a stunning achievement.

Trouble is, those nasty glasses. They scratch. They need batteries. Frankly, you look like a fool. Apple has found a complex way to remove the need for eyeware by using Microsoft Kinect-type motion sensors to track where your eyes are in relation to the screen, and then projecting images accordingly to each eye. In simple terms, the screen will watch you, and then focus the images on your eyes, even if you adjust yourself on the couch. The obvious technicality is how to track two sets of eyes, so we predict 3-D will appear first on Apple laptops — what a differentiator, and Apple needs a new one because it can’t really make its portable computers any thinner.

When UX changes, so does users’ behavior

OK, so you get it: Better 3-D is coming, and it will be freaky cool. Imagine the scene on airplanes as businesspeople play their silly iPad games by flapping their hands in the air. But beyond Angry Birds and cartoons, what could really change? Technology has a habit of shifting consumers’ behavior: The telephone supported long-term relationships, the automobile created 45-mile commutes, the airplane allowed businesses near-global reach out of small offices … what appears initially as a new way to see the world eventually changes the world in which we live.

So imagine a laptop that projects a full-color hologram before you, with sensors that also track your hand movements, so if you reach out and “touch” the image it changes shape or location. Now imagine cheap 3-D screens everywhere: On table tops, on mall walls, on your car dashboard, on your bathroom mirror. People could design or build in three-dimensions; modeling could lead to the simulation of touching another’s face; the porn industry (admit it, the leader in most visual gimmickry) will have a field day. You could wake up in the morning and have a virtual dentist help inspect your teeth as your brush. The real implication could be a verisimilitude heretofore unseen among humans. The separation of virtual reality from realty will become so complete, the labels may fall away.

Falling costs could eventually embed 3-D screens on fabric, say, your clothes or pillow case. Did we mention porn? Yikes.

The implications for marketers could be negative. L.L. Bean would surely like to show you its winter coats in three dimensions. But imagine the difficulty The New York Times will have serving ads against content that floats in 3-D, giving real impetus for you to play with it in the air. People may turn to content that acts like the tools of yore, vs. passive entertainment to wash over them with accompanying marketing messages. In that world, ads might seem like flies, nuisances buzzing in the air to be swatted away.

Real 3-D is coming. It will add unforeseen dimensions to our behavior, and like most new elements, the end usage will be surprising.