Categorical

To me the most fascinating, and definitely most important, thing about the newly announced Apple Vision Pro is that they are aiming to connect people who are wearing with people in the same room who are not wearing, by showing the eyes of wearers to non-wearers when the wearer is in XR mode.

This produces a categorical difference, in a social sense, from previous VR efforts, since a characteristic feature of VR until now, which I believe has been the greatest factor in preventing mass adoption, has been the way it isolates wearers from non-wearers. After all, most consumers, other than dedicated gamers, do not want to be separated from other people when they are in the same room.

All information appliances that have achieved mass adoption, from phones to tablets to televisions to computers, allow us to remain aware of each other when we are in each other’s physical presence. This leads me to think that the Vision One is the first VR device that can speak to the general consumer.

Of course the price is very high now, and that is clearly deliberate. It makes sense for Apple not to do a large scale rollout until the second or third generation, so it can do iterative tuning within a limited market.

But the direction that Apple is aiming toward in the VR space is the first one which makes sense to me for a general audience.

Real-life replicator

What if the Star Trek replicator and transporter existed in real life? I don’t mean in the 23rd Century, but right now.

It seems to me that these technologies would be used very differently from the way they are used on the show. For one thing, many people would undoubtedly create infinite wealth for themselves.

This would immediately erase a large part of our current economic model, and replace it with something extremely different. The good news is that hunger would wiped out in one fell swoop.

Far more intriguing and troubling is the likelihood that many people would also opt to make clones of themselves. The very possibility of such a thing raises all sorts of deep and troubling ethical issues.

For example, if there are 10 of me, what rights to each of us have? Which of us, if any, is actually “me” — in any legal, moral or ethical sense?

It is interesting that these thorny ethical and existential questions do not dominate the Star Trek universe, even though these things are all quite attainable in that universe. Maybe the people on Star Trek are just better than we are.

Tradeoff

I’ve been trying to create a user interface that is very easy to use. And as I work on it, I keep running into the same problem.

The easiest way to make something easy to use is to limit the user’s choices. If you only give people simple options, then everything is clear and easy to learn, and in fact pretty much self-evident.

But once you start empowering the user, it’s nearly impossible to keep things simple. Which is a shame.

For example, it’s easy to give people one representative object (say, a chair or a dog). But it’s hard to give them an easy way to have fine control over exactly what chair or dog they will get.

Which isn’t to say that easy/simple is better or more complex/powerful is better. They are both good.

I think the solution is to know your customer. You need to understand what they really want to do, and why they want to do it.

Sometimes people need a fighter jet, and sometimes they just need a bicycle. And if what you really need is a bicycle, you’re not going to be happy with even the best fighter jet in the world.

When all the world’s in tune

When ground is lost, and hope is tossed,
And fate inscribed in pen
As seas may roil, our blood, full boil,
Bemoans the fate of men
We dine on fear, for now we hear
That faint satanic laugh
When light grows dim, we offer him
The sacrificial calf
But for God’s sake, know when to make
That leap up to the moon
Do not despair, I’ll see you there
When all the world’s in tune

Time is relative

May was such a long and difficult month for me that today seems like a miracle. At long last June!

From an objective standpoint, time is completely linear. Every day has exactly 24 hours, and the arrow of time proceeds at a perfectly steady pace.

Yet there are times, depending on what is happening in your life, when everything seems to slow down to a crawl. And for some terribly unfair reason, those times generally turn out to be the worst times.

Well, here we are at a fresh brand new month, an opportunity for things to start looking up and being wonderful. But just my luck, if that happens, the whole month will probably go by way too fast.

DIY

I like to write my own research software from the ground up. From a practical perspective, this can seem a little silly.

After all, there are very affordable software packages that embody thousands of person-years of work. A good game engine like Unity or UnReal can save you lots of time.

But if I want to explore interactive ray tracing, for example, I will lean toward implementing my own GPU ray tracer from scratch. Which means I need to do a lot more work.

Yet from a research perspective, this DIY approach has lots of advantages. You can only learn so much about cars by driving even the best car in the world.

But if you drive a car that you built yourself, you will learn a heck of a lot about cars. Even if your car doesn’t go quite as fast, and even if the ride is sometimes bumpy.

Alien landscape

Continuing the thought from yesterday, suppose you could, even for a few minutes, inhabit the mind of another person? What would that be like?

Our intuition, and most popular science fiction, tells us that it would be like cutting to another camera in a movie. We would just suddenly be within that person’s body, rather than our own.

But what if the truth is stranger? Each of us has developed countless neural pathways throughout our lives for interpreting reality, mainly in our early formative years. Those pathways, and the way they support cognition, are bound to be very gnarly and particular.

Being inside the mind of another person might very well be like being deposited in an alien landscape. Nothing is familiar, and nothing makes sense. Everything we thought we knew about vision, memory, reasoning, would no longer work as expected.

Even the simplest act or process or recall might be difficult, like operating heavy machinery without training. Things might end up getting knocked down, and it might not be pretty.

Throughout our lives we are presented with the consensual illusion that we all inhabit the same cognitive world, because we can discuss that world with each other and reason about it together. But it doesn’t follow that we are actually thinking and perceiving things in the same way.

If we were to somehow relocate our consciousness to the brain and body of another person, we might be very surprised at what that feels like. And maybe not at all pleased.

Parallel universes

As I walk down the street in NYC and take in the energy of all of the people walking past, I am struck by the fact that inside the mind of every person I see is an entire universe. Each such universe is vast and unfathomable in its depth and mystery.

There are billions of such parallel universes here on Earth. The sheer scale of it all is wondrous and astonishing, and it fills me with awe.