Archive for the ‘Uncategorized’ Category

Mood app

Sunday, May 13th, 2018

If you could dial up any mood you wanted, at any time, would you do it? Or is the entire prospect of such a thing too dangerous for mere humans?

We have all experienced moments when we are filled with melancholy. And the reasons for such moments are often obscure, even to ourselves.

If, hypothetically, you had an app on your phone that you could use to set your mood, would that be desirable? I could certainly see ways it could be convenient.

There are situations where it is better for everyone if you are able to catch a certain mood. Perhaps a moment calls for you to be happy, or thoughtful, or amorous, or hungry, or receptive to a good laugh, or highly attuned to the feelings of others, to give just a few examples.

Yet I have a feeling that such an app would be highly dangerous. It would be offering a kind of false shortcut to a sense of enlightenment — one that would not have been earned.

And therefore, eventually, for many people it would become a drug. Perhaps it is good that we need to struggle with our moods, to negotiate with them and work through what they mean.

That struggle is an important part of who we are. If we try to take a shortcut around that, we may be removing something essential from ourselves, and we may end up losing far more than we have gained.

Dance VR puppetry

Saturday, May 12th, 2018

This evening I went to see end of semester student performances at the NYU Dance Department. One thing that really struck me was the way the dance students, who are all supremely talented, tried to push their bodies into new forms of movement that were beyond what we would usually think of as being within the range of human bodily expression.

Watching this, it occurred to me that these young artists could really benefit from combining their talents with the infinite possibilities of virtual reality. If they could think of the target of their expression not as the literal human body, but rather as a kind of unbounded puppetry that could be controlled by their physical movements, I feel that these brilliant young people would come up with new kinds of dance that would be beyond what we might generally consider possible today.

Of course it is impossible to say how such an art form would develop. But I am extremely interested in the possibility of our lab working with their department to explore the possibilities.

Rethinking 360o VR

Friday, May 11th, 2018

Since our lab’s research focuses on full room scale VR, I have generally not paid much attention to 360o VR. After all, why settle for being stuck in one place when you have the option to roam around freely in virtual worlds?

But with the introduction of the Oculus Go, I am rethinking my position. This device functions so well as a consumer level product that it is prompting me to think of fun things we might do with it.

As long as 360o VR was in its “early adaptor” stage, focusing on devices that tried to make VR happen by leveraging your SmartPhone, it was never going to be a really satisfying experience. SmartPhones are designed primarily to be SmartPhones, not components of a VR experience.

In contrast, the Go is so inexpensive and user friendly that for the first time I can imagine millions of people using a VR device without needing to think at all about technology. A lot of people I know are buying them for their non-technologically oriented parents, and their parents are really enjoying using them.

So instead of thinking of the 360o VR as a poorer cousin to room scale VR, I am now thinking of it as a larger version of IMAX. Imagine, for example, watching a chalktalk lecture where the blackboard is all around you. In fact, we’re starting to focus on getting my Chalktalk program to work with the Go in just this way.

Imagine a million students all remotely attending a lecture that they can see taking place all around them in glorious high resolution. It could be a very exciting way to think about MOOCs.

There are certain songs

Thursday, May 10th, 2018

There are certain songs that rip your heart out.

This is not a bad thing, and the songs that rip your heart out are not the same as the songs that rip my heart out. Each of us has our own unique song catalog, forming a sort of fingerprint of the soul.

For me, they tend to be songs that connect me with particular moments in my life, and personal connections that became bound up with certain songs.

Harry Nilsson’s version of Living Without You is one of those songs for me. A certain young woman named Janet somehow became entwined with that song, and now every time I hear it — all these years later — I still think of her.

You very like have songs that have circumscribed your soul in similar ways. I would be curious to hear what they are, if you would like to share.

New frontiers of artificial intelligence

Wednesday, May 9th, 2018

In our lab we’ve recently been working with the Lenovo Mirage Solo. It’s not officially out yet, but it’s available to play with if you have a research lab and Google likes you.

Unlike the GearVR or Daydream or Oculus Go, this is a true room-scale VR experience. When you move your head, it correctly adjusts your position in space.

Yet unlike the Vive or Oculus Rift, it is totally self-contained. The Mirage Solo uses the same sort of inside-out tracking technology as Google’s ARCore. Which is not surprising, since Google is the driving force behind this extremely cool headset.

We’ve been playing with it for several weeks now, building our VR projects to it, showing it to various and sundry visitors. And it has been working without a hitch — until today.

This morning we had a visit from a very high level executive at Facebook Oculus. Which, as you may know, is one of Google’s arch-rivals in the VR space.

One of our Ph.D. students trotted out our Mirage Solo, planning to use this nifty device to show our awesome VR content. And the headset didn’t work. It just flat out refused to function.

For the very first time since we got it, the Solo failed us. So now I am wondering.

Perhaps these fancy futuristic virtual reality devices possess a kind of advanced AI: They detect when you are about to show your cool demo to somebody from a rival company, and so they choose that exact moment to break down.

As our world becomes populated by ever more technologically advanced devices, this kind of strategically competitive dysfunction may very well be the new frontier of artificial intelligence. Or maybe I am overthinking this. 😉

Go ogling

Tuesday, May 8th, 2018

This weekend I bought the Oculus Go. So did a number of my friends and colleagues.

In one sense it’s not really new. After all, I first started using their GearVR in September 2015, and in theory this is the same sort of experience: A portable 360o VR device with high quality direction tracking.

But you know what they say about theory and practice: They are the same in theory, but different in practice.

The major difference is that the Oculus Go is designed from the ground up to be a VR device, rather than an add-on to your phone. Out of the box it just works — no need to stick a phone in it.

The visual design of the device is great, the quality and resolution of the VR image is spectacular, and the user interface is extremely well thought out. Even the hand-held controller is awesome. And for around $200 total this thing is very inexpensive for what it delivers.

Although I thought it needed a little character, so I stuck on some Googly Eyes. For good measure I also added a nose:

I feel my Oculus Go now expresses much more inherent personality. Although from certain angles it seems to look a little sad.

Maybe it’s just confused. After all, should something sold by Facebook really be wearing something called Googly Eyes?


Group blog

Monday, May 7th, 2018

Today at our weekly Future Reality Lab meeting I proposed that we all start a group blog. The idea is that we do a round-robin style of post.

On any given day, one person is responsible for putting up a single post, which can be on any topic related to what we’re doing at the lab. Then the next day another person posts, and so on, in a fixed cyclical order.

This arrangement gives everyone an equal opportunity to contribute. Since there are about a dozen people in our group, everybody will post about once every two weeks.

If they wish, people can choose to spend a lot of time on a post, perhaps preparing materials or demo videos days earlier. Or they can just wing it, and jot down their impression of things on that particular day.

The goal is to get a steady rhythm going of telling the world what we’re up to, without requiring any one person in our lab to do too much of the work. Also, of course, the hope is to get a nice diversity of viewpoints.

It was easy to convince our lab’s denizens that this would not be too much work. After all, they know someone who has been blogging every single day for more than ten years, all by himself. :-)

Rubber bands and chewing gum and fractal programming

Sunday, May 6th, 2018

I am currently working on a fairly extensive procedural animation system. That means there are a lot of different pieces which need to work together.

My procedurally animated characters need to step properly when walking, to correctly turn and look at things, sit down, stand up, reach for objects, pick those objects up and put them down again. All of which needs to happen in response to simple user directives.

The characters also need to be biomechanically reasonable. For example, when they stand and walk, their weight needs to be centered over their feet. And while all of that is going on, the characters should properly convey subtleties of mood, personality and intentionality through their shifting facial expressions and body language.

Like I said, lots of pieces. When I implemented my early prototype, I put in simple placeholders for some of those pieces — the algorithmic equivalent of rubber bands and chewing gum — and that was ok.

But now that the system is getting more sophisticated and I am demanding more of it, some of those simple placeholders are holding everything back. So in various parts of the system I need replace three or four lines of code that sort of worked by an entire carefully implemented subsystem which might take a hundred lines of code or more.

The replacement part serves the same purpose as the original. It just does it better and a lot more carefully.

When I see this sort of thing, it makes me think of any mature software system as a kind of fractal. At the most basic level software systems are pretty simple.

But then when you look further, you see that what seemed like a very simple thing (for example, in my case, how a character first places its foot when it starts to walk), might actually contain lots of complexity.

You don’t need to understand all the complexity to understand the system, and certainly not to use it. But without it being there under the hood, you just end up with rubber bands and chewing gum — a system that seems to work ok at first, but eventually just falls apart.

Working Saturday

Saturday, May 5th, 2018

Today is a Saturday, a day when many people take the day off, smell the flowers, chill out a bit. Yet today has been one of the most work-intensive days in our lab in recent memory.

I have been here all day working on procedural animation for our big forthcoming SIGGRAPH production. Meanwhile our students were working on a motion capture shoot for the same production.

Other students have been porting our VR experiences to various consumer level VR headsets. Still other students have been spending the day building virtual sets and animating characters.

I’m starting to think that being in a state of productivity is highly contagious. Of course, this is only a theory. :-)

May the fourth

Friday, May 4th, 2018

I really like the fact that there is this geeky little phrase that people say to each other on this day of the year. This morning, people I know greeted each other by saying “May the fourth be with you.”

It’s really stupid, but everyone smiles and feels like they’ve gone through a ritual of tribal bonding. Sort of, I guess, like being in the A.V. Club in Hawkins Indiana.

Two years ago today, some friends and I went to an “Escape the Room” experience in Stuttgart Germany. The operator, who clearly spoke English only as a second language, greeted us with a hearty “May the Fourth be with you!”

I love that we could so quickly bond with somebody from a different country, and even a different language. What I love even more is that it was done through a ritual that is so wonderfully, happily stupid.