Cherish that

One of the wonderful things about live theater is that you are seeing something completely unique in the history of humankind.

No performance that took place before the one you are attending, or any performance ever again, will be the same as what you are experiencing right now.

Cherish that.

Real-time AI

Right now it takes at least a few seconds from the time you give a text prompt and the time you get an image back from one of the currently available generative A.I. programs. This is a limitation of the current technology.

But Moore’s Law keeps marching onward, in one way or another. With increased computational parallelism and newer semiconductor technologies, response time will gradually trend downward. In another decade or so the response will reliably arrive in a fraction of a second.

From the user’s perspective, this means that images and videos and simulated 3D scenes will appear even while you are describing them. But even more important, it will mean that you can edit those images and videos and simulated 3D scenes simply by continuing to talk. As you speak, the changes will happen right before your eyes.

When we get to that point, generative A.I. will truly become a fundamental new mode of human expression.

Drawing in the air

At some point everybody will be able to wear lightweight and affordable high quality XR glasses. A really good version of this is still some years off, but it’s fun to think about it now.

One of the things you will be able to do with those glasses is simply point your finger and draw in the air. Everybody who is in the room with you will be able to see your drawing, and they will be able to make their own drawings as well.

Of course all of this will be tied to artificial intelligence. After you draw something, you will be able to say things like “What would a couch look like right here?” or “Show me what this would look like as a real vase.” Your drawing will then come to life for everyone as something that looks realistic.

I wonder who just this one feature will change communication.

40 Years an Eclipse

Yesterday I posted an animated eclipse implemented as a procedural texture, in honor of that day’s great celestial event. It’s not a movie clip — it’s a live simulation running on your computer or phone.

Interestingly, this eclipse simulation is actually something that I created exactly 40 years ago. In 1984 I introduced to the world what came to be known as procedural shader languages, in the course of which I created lots of examples.

One of those examples was this procedurally generated eclipse. Originally it ran in my own custom shader language. Then around 18 years ago I re-implemented it in Java. More recently I re-implemented it yet again as a WebGL fragment shader.

But the design and the algorithm has never changed. It’s the same procedural eclipse that I created back in April 1984. Except that back then it took 30 minutes a frame to compute. Now it just runs on your phone in real time, thanks to the wonder of Moore’s Law.

In another 40 years, I wonder what simulations will run in real time that now take half an hour to compute. I can hardly wait!


It is said that when the pianoforte was first invented, many musicians felt threatened by it. Since it was a very expensive and therefore rare instrument, most musicians had no direct experience with it. But what they heard apparently frightened them.

Because of its highly polyphonal nature, musicians were concerned that it would replace the orchestra. As we know, that did not happen.

In fact, the piano became a great stand-in for the orchestra when rehearsing operas and other music written with orchestral accompaniment in mind. So in a way, the adoption of the piano actually helped to promote orchestral music.

Something similar seems to be happening today with A.I. People are worried that it will replace human creativity. But the truth is that today’s A.I. is less like an orchestra and more like a piano.

An A.I. on its own cannot produce anything that is highly creative. It is an instrument, which in the right hands can be used to produce something extraordinary. But during this process, the person in the driver’s seat is the human who is working with the A.I. — not the machine.

In the coming years, A.I. will be a great tool for trying things out, for creating rapid initial prototypes of an an artist’s new ideas. But they cannot replace the artist, any more than Adobe Illustrator can replace the creator of a document.

These are not people — they are tools designed to support you in your own creative endeavors. Play them the way you would play a piano.


Today, in particular, I am reminded by that wonderful line from Robert Frost’s Poem The Death of the Hired Man:

“Home is the place where, when you have to go there, they have to take you in.”

There are so many levels here, and that statement is many things. But most importantly, it is true.