Sensory marketing – how companies use AR and VR to attract customers

When talking about AR and VR scenarios, marketing seems to be a very promising field of application. Especially sensory marketing moves in our focus as it is a specific approach to attract potential customers by using senses to affect their feelings and behaviour. As globally leading pinoeer, Prof. Aradhna Krishna coined the term “sensory marketing”.  She defines it as

aradhna krishna

Aradhna Kirshna – Sensory Marketing Lab Director

“marketing that engages the consumers’ senses and affects their perception, judgment and behavior (and suggests that) from a managerial perspective, sensory marketing can be used to create subconscious triggers that characterize consumer perceptions of abstract notions of the product (e.g., its sophistication or quality).”

via Relevant Concepts – Sensory Marketing Lab.

 

 

For a better unterstanding of sensory marketing, the following examples will show you various use cases of AR/VR in the domains of marketing and advertising.

1. Mariott Hotel’s VR honeymoon

sensorialmarketing

Mariett Hotel’s Teleporter view through Oculus Rift

To exemplify the combination of VR and sensory marketing, Mariott Hotel’s Teleporter has to be mentioned. Basically, the Teleporter simluates a virtual honeymoon and aims to seduce recently married couples to plan their dream vacation. By wearing the VR device Oulus Rift and a full-sized headphone, the user is “teleported” to the VR environment. This effect is further enhanced by the use of watersprayers and installed heaters that enable a multi-sensory experience.

Watch the following video to get an impression of Mariott Hotel’s Teleporter:

 

2. Häagen-Dazs’s AR timer

häagenHäagen-Dazs provides an AR timer for the purpose of “softening” the ice cream before use. To bridge the time gap, an AR violinist appears and plays a two-minute violine concert. Generally, the advertisment appeals directly to the emotions and senses of the consumer as the Häagen-Dazs ice cream is presented as a special delight and premium product.

By listening to the classical concert, the sense of hearing is activated and the violin sounds make the consumer feel sophisticated and culturally educated, Due to this subconscious positive association, the customer may be more willing to buy Häagen-Dazs ice cream prospectively.

Watch the full advertisment and let us know what you think about the AR app!

 

3. Jochen Schweizer’s AR Tour

jochen schweizer

AR treasure hunt by Jochen Schweizer

Jochen Schweizer shows how companies bring AR to the market. At the heart of the concept lies a kind of virtual treasure hunt similar to Geocaching. The general task is to free the parallel world “Avoria” from evil powers by using AR.

The participants use an iPad as a gateway to the AR reality and have to solve different types of riddles to save Avoria.

What do you think about the presented AR/VR use cases? Would you like to see more of it? We are looking forward to your comments and hope that you enjoyed the scenarios!

Moving (virtual) mountains – just with the power of thoughts

There is one thing all virtual or augmented reality devices like Microsoft HoloLens, Oculus Rift or others have in common:
Interaction with the virtual environments or objects requires usage of other peripherals or at least your hands. Fatigue, inconvenience or frustration may be a consequence.
But with the invention of a team of students consisting ofJuan de Joya, Victor Leung and Kelly Peng in the UC Berkeley chapter of ACM SIGGRAPH this could become irrelevant in the future: They have invented a virtual reality system where the virtual world can be controlled just with the power of your thoughts. It works like the following:

The project, called Mindscape VR, utilizes the Oculus Rift and the Muse brain-sensing headset to create an immersive VR environment where users can move objects with their thoughts and interact with their surroundings by simply thinking about doing so.

via ACM SIGGRAPH

To us the combination of virtual reality with electroencephalography (EEG) for interaction sounds really amazing. Even though there is not much detailed information available yet, this technology could have the potential to be the missing part for a convenient long time usage and thus the success of virtual reality devices in a large variety of application areas.

Kid using VR system

Kid using VR system – Photo from Mindscape VR team for/via ACM SIGGRAPH

The authors describe it as “gratifying and empowering experience” and give some pretty cool usage examples:

“In our first iteration of the project, we used one type of brain wave frequency to allow the user to levitate and collect pebbles in a simple fantasy world. While we disabled them at launch, we do have features where the user can call a dragon to appear, change night to day, summon fireflies and shoot fireballs depending on what type of brain frequencies the Muse is picking up.

We found that the simplicity of using one’s thoughts to do things is a pretty gratifying and empowering experience. We had a kid try it out at launch, and as he started levitating the rocks he brought up his hands as if he were a Jedi. How cool is that? It’s these kinds of seamless, easy-to-use experiences that underlie the potential of immersive VR as a medium.”

via Juan de Joya at ACM SIGGRAPH

If you are interested in trying it out for yourself the authors state that the system (first iteration) can be experienced at San Francisco Exploratorium’s Cognitive Technology Exhibit during February.

So what do you think about it? Do you like the idea of not having to actually “do” anything for a virtual reality experience or would you still prefer a traditional input device for a haptic experience? We would love to read your thoughts in the comments section.

Microsoft HoloDesk – The idea behind HoloLens

Can’t get enough of AR? Make sure you have a look at the following video.

According to WT VOX,

“HoloDesk is a novel interactive system combining an optical see through display and Kinect camera to create the illusion that users are directly interacting with 3D graphics. A virtual image of a 3D scene is rendered through a half silvered mirror and spatially aligned with the real-world for the viewer. Users easily reach into an interaction volume displaying the virtual image.

This allows the user to literally get their hands into the virtual display. A novel real-time algorithm for rep- resenting hands and other physical objects, which are sensed by the Kinect inside this volume, allows physically realistic interaction between real and virtual 3D objects.”

via Microsoft HoloDesk The

Apart from this, enjoy the amazing HoloLens model by xelus. The 3D models shows and explains each part of HoloLens – good job! Just one click:

https://sketchfab.com/models/e6247ba91c6845c2948cdc342dcf3481/embed

Microsoft HoloLens
by Sketchfab
on Sketchfab

HoloLens Reality Check

Are you tired of futuristic HoloLens visions? CNET‘s Cam Robinson provided a HoloLens Reality Check. According to CNET.com, “gaming is the number one most exciting potential use of the technology”.

Check out his video here: http://www.gamespot.com/videos/embed/6423294/

For those who prefer reading: Cam explains that HoloLens is about “adding things on top of existing reality” and emphasizes the follwing key features of HoloLens:

  • manipulation of digital holographic objects
  • construction of virtual objects (to be later 3D printed)
  • modelling in realtime 3D
oculus

Gaming: VR creating “feeling of presence”

On top of this, Cam compared HoloLens to its “VR cousins” (e.g. Oculus Rift/ Project Morpheus) that fulfil their intended purpose by creating “the feeling of presence”. They take you to a new virtual world and simulate the feeling of being a part of the game.

Especially Facebook has shown the great importance of next-generation technologies as Mark Zuckerberg announced the $2bn acquisition of Oculus Rift in March 2014 (according to theguardian).

Facebook, Sony, Google, Microsoft – they are all pursuing a long-term strategy to develop and improve AR and VR solutions. But what about Apple? The gossip factory is working overtime as Apple is hiring engineers and app developers with VR experience.

As long as there were no more details released, we have to be patient. Maybe we have to get ready for another pleasant surprise?

Feel free to leave your comments below and let us know what you think about the current development.

And do not forget to participate in our HoloLens survey above!

A single device, a million opportunities.

Some time has passed since Microsoft has announced its new gadget HoloLens, people had the chance to go through their daily lives with all of their visionary information in mind and thus one or another might have experienced some activities or situations where a device like Microsoft’s new gadget could appear desirable.

Microsoft HoloLens - Possibilities

Only one of a million possibilities Microsoft itself has shown in a marketing video

If you did not have had your “HoloLens moment” until now, maybe the article of columnist Jurica Dujmovic for MarketWatch may be an inspiration for you. From an economic point of view he sheds light on Hololens’ possible impact on the consumer market as well as media usage and points out where “the first augmented-reality device done right” could really be an improvement:

“HoloLens will impact multiple markets, ranging from home entertainment to mobile devices; virtually everything with a screen will likely take a cue from the technology within HoloLens. Your fridge will interface with it, showing you a see-through view of groceries, along with a visual representation of the expiration dates, and the option to “check mark” individual items and add them to your shopping list. That is, without opening the fridge.”

via Microsoft’s HoloLens actually could be a game changer

But his list of opportunities and possibilities does not stop at your fridge. He talks about:

  • Changing wall colors at your home
  • Seeing fantasy scenes when looking out of your window
  • Experiencing different real world places when looking out of your window
  • Transforming your child’s bedroom into an enchanted forest instead of a traditional good night story
  • Single- or multiplayer gaming in your living room as an alternative to classical board games
  • Integration of holograms into your car and your view of the outside
  • Surgeons that use it for complex operations (if you have a special interest in medical topics we recommend the article “Drone Surgery and HoloLens: Hello 2015”  by Zev Ginzburg, UX Research Copywriter at Codal Inc.)
  • Improving the tidiness of your office working environment
  • Creating impressive art installations on almost empty walls in almost empty halls
  • Enhancing education by visual breakdown and vivid demonstration of complex subjects

Finally the authors sums it up very accurately:

“Really, HoloLens has the potential to change the way we perceive the world around us, and to truly extend and augment reality. Depending on the final product and the limits of our imagination, we may reach, or even surpass, many elements of the imaginary “Star Trek” holodeck technology.”

via Microsoft’s HoloLens actually could be a game changer

So did you find your favorite HoloLens scenario? Or do you even see more than the author? Or do you disagree and do not see any opportunities for your life in Microsoft’s new technology? We would love to hear your opinion in the comments section.

HoloLens & Borderlands

borderlands

nick8807’s Borderlands mock-up for HoloLens

Latitude and creativity without limits – that’s what  Reddit user nick8807 might have thought when he created his own augmented Borderlands mock-up for Xbox One.

“Just an idea I had in my head. Off screen HUD and inventory that dims when your eyes focus on your TV. Rough mock up. Let me know what you guys think.”

via What HoloLens could be like on Xbox One… : xboxone.

Actually the mock-up is very similar to Tadgh Kelly‘s idea of AR used as an augmented screen. The mock-up shows a simplified method to choose weapons and to improve the overview and understanding of the game. In fact, the actual screen would be dedicated 100% to the game world.

Gamingbolt‘s Ravi Sinha thought about similar features adding that

“It’s interesting because it allows you to automatically select weapons from your backpack, listen to custom soundtracks or start a party – all without having to leave the actual game. Though it’s just a mock-up, it represents the potential of HoloLens for commercial games in terms of functionality, ease of use and even custom functionality.”

via Here’s What Microsoft’s HoloLens Could Be Like On Xbox One « GamingBolt.com: Video Game News, Reviews, Previews and Blog.

If you are interested in further comments about the mock-up, have a look at the complete Reddit post here.

Feel free to comment on the mock-up below and tell us what you think about all the ideas!

Holo Everywhere – Atheer developing new AR headset

HoloLens is all over the news. But let’s take a look at another interesting AR solution – Atheer’s AiR Smart Glasses 

atheer

Atheer’s AiR Smart Glasses

The Mountain View-based start-up Atheer regards itself as pioneer in Augmented interactive Reality (AiR™) and proceeds to combine the power of 3D augmented reality with natural interaction. According to Atheer, their AiR platform consists of the AiR Smart Glasses and the AiR OS.

Their new developer kit Air DK2 is available and can be ordered if you want to join the AiR Pilot Program.

 

 

When talking about core competences and how they differ from HoloLens, we have to consider the following aspects:

atheer31. Intuitive Precise Gestures

Build your apps & workflows with enhanced, field-tested gestures to Touch, Tap, Swipe, and Pinch and Zoom for a natural and productive experience.

via Atheer Labs.


2. Head Position Tracking

Access applications and visual content placed anywhere around you with complete ease for natural multitasking and an immersive visual experience.

via Atheer Labs.


3. 2D-3D Application Support

Combine the ease and familiarity of 2D Android app development with the power to display full stereoscopic 3D objects and models, giving your users the best of both worlds.

via Atheer Labs.


atheer34. AiR SDK

Create new experiences leveraging the full-featured AiR OS functionality and expand your existing apps through our simple yet powerful SDK.

via Atheer Labs.


 

Looks very promising so far. Besides this, Gigaom’s Signe Brewster shared an interesting article about Atheer and the  AiR Smart Glasses here. He describes his experiences as follows:

atheer3

                       Atheer CEO Alberto Torres                      Credit: Signe Brewster/Gigaom

“I pinched my fingers to zoom in and out on a 3D model of a heart and swiped through Google Maps. […] A new feature allows you to hold your hands up to make a square, and the headset will automatically take a picture. Many are abilities desperately needed in industries where your hands are too dirty to touch a tablet screen or it is monotonous to log item after item after item.”

via As HoloLens looms, Atheer plans new augmented reality headset — Tech News and Analysis.

All in all the progress in AR  development makes us even more curious. Actually, we have to admit that the use of AR goggles doesn’t seem to be too far from reality.

3D objects vs. holograms

We have already mentioned that HoloLens doesn’t create holograms by itself. The so-called holograms are actually 3D objects made entirely out of light. By using Microsoft’s special goggles, these virtual 3D objects are projected onto our field of vision.

In contrast, researcher Xuewu Xu and some of his colleagues  from Data Storage Institute in Singapore succeeded in developing a method to create “real” holograms.  Engadget’s Felix Knoke shared a German article about the topic here and attempts to get a demo video from Xuewu Xu and his colleagues. Basically, they explain their approach in the following way:

hologram“We propose a new approach to spatiotemporally multiplex sub-holograms and stream hologram data in parallel by using multiple spatial light modulators (SLMs) to increase the spatiotemporal resolution of holographic display system.

With the proposed approach, we have achieved a spatiotemporal resolution of 4.5 × 1010 pixel/s, as compared with 1.89 × 109 pixel/s of a single SLM. Each frame of computer-generated hologram video has a pixel count of 378 Mpixels and is divided into 288 sub-holograms, each of 1.31 Mpixels.

During the playback of holographic video, these sub-holograms are spatiotemporally multiplexed and streamed in parallel to form the integrated hologram within 16.67 ms, which enables full-color holographic video display with a 10-in. diagonal at a hologram data frame rate of 60 frames per second (fps).

New SLM devices with higher spatiotemporal resolution need to be developed in order to meet the data bandwidth requirement of about 1012–1014 pixel/s for future 3D holographic displays.”

via So gehen Hologramme richtig – Engadget Deutschland.

Nevertheless, HoloLens offers a great possibility to blend virtual objects into our physical reality. Even if HoloLens doesn’t create holograms by definition, Microsoft avoids negative connotations connected with AR and establishes best conditions for HoloLens to be accepted by potential customers.

Best Uses of HoloLens & Favoured Augmented Games

4 specific applications were presented at the Windows 10 live event. Apparently, there is a lot more to do with HoloLens as the potential of AR is increasing permanently.

Cnet’s Donald Bell thought about best uses of HoloLens and presented his TOP 5:

Especially augmented gaming is fascinating many people. But which games are actually suitable?

Steven Wong from Shacknews explored exactly this question and shared 9 games that hold great potential for augmented gaming.

Here are some of his examples:

1. The Sims

sims

The Sims 4

The Sim Creator from The Sims 4 is a perfect example. Imagine having a small 3D hologram of your Sim standing atop your desk as you use your hands to pull on arrows to manipulate its proportons. It would be like creating a virtual sculpture, with the added fun of it coming to life once it’s done.

via 9 Games Ready for Microsoft HoloLens Augmentation | Shacknews.

Visit the Official The Sims Site here.

 

2. Halo: The Master Chief Collection

halo

Halo: Master Chief Collection

Perhaps it could heighten the experience by allowing players to see more from their periphery. It could paint the floor and walls of your room with matching environment tiles, so it feels like you’re playing the game from wherever you are in the game. Lastly, if you get stuck or lost on a level, you could ask ask Cortana where you should go.

via 9 Games Ready for Microsoft HoloLens Augmentation | Shacknews.

Visit the Official Halo Site here

 

3. Alien: Isolation

alien

Alien: Isolation. Nostromo Crew

“You could use the HoloLens to scan through your house and its furniture. Then you would set the starting point and exit, place bystanders, enemies, and gadget parts in different rooms, and pretend (for the sake of the experience) that all other doors and windows don’t work.”

via 9 Games Ready for Microsoft HoloLens Augmentation | Shacknews.

Visit the Official Alien: Isolation Site here.

Do not forget to check out Steven Wong’s full article here!