Ken's Blog

In the mixed reality research at our lab at NYU we are starting to work with educational robot arms. One that we really like is the SO101. The robot provides continuous feedback about its position, is easy to work with, and is relatively inexpensive.

Another nice thing about the SO101 is that the people who make it provide all of the information that you need to 3D print your own parts, which also means that with a little bit of hacking, you can create your own digital double of the robot. A digital double lets us do research with the robot arm even if we don’t happen to have a physical robot arm handy.

So one of the first things I did was write a program to create an interactive visualization of the SO101 robot arm that runs in a Web browser. I managed to make it move around kind of like a dinosaur, and that looks very cool, so I thought I would share it HERE.

I gave an assignment this week to the students in my VR class that involved having them get an A.I. to create virtual worlds. So they are essentially being tasked with vibe coding.

What then is my relationship to the A.I.? I am specifying something to be done by A.I., but I am not actually communicating with any A.I. I am only communicating with human beings.

So you could say that if my students are vibe coding, then I am vibe vibing. I wonder whether that will become a thing.

Today I was hanging out with friends, and somebody asked if we liked oysters. I, being the vegetarian in the group, interpreted that differently from everyone else.

I said “I think we all like oysters, but I might like them in different sense.”

“What do you mean?” my friend asked.

“I mean I like for them to be happy.”

Today I showed Bruce Branit’s iconic short film World Builder to my VR class at NYU. Considering it was made nearly two decades ago, it is astonishing how prescient it is.

I think that’s because the world we are gradually entering, where A.I. does seemingly magical things for us, is actually an approximation of a world that had already existed. For millenia, designers and master have relied on assistants to help them realize their creations.

A.I. at its best will approximate that kind of relationship. The end goal of A.I. is to allow each of us to become a master creator, limited only by our own unique vision. That is the future we seen in Bruce Branit’s landmark film.

Which is why it resonates so profoundly. Also, it’s a really good film.

The offices of the animators at Pixar Animation Studios.

Those who know, know.

Today I am on a long flight. I am flying economy class.

If course it is uncomfortable.The seats are too small, there isn’t much legroom, and nobody is really happy to be here.

Perfect conditions, in fact, for getting programming done. The more you want to escape your immediate physical environment, the more motivated you are to escape into code.

I wonder, if you tally the productivity of programmers, and map it to where they happen to be, whether you would find a spike during long flights in the cheap seats.

Maybe, in their own way, the airlines are doing a service for our nation’s knowledge economy.

The act of livestreaming an execution, which the U.S. Pentagon has ordered for Dec 3, is of course beneath contempt. It seems like a deliberate attempt to position our government as a pack of savages, by publicly staging a pointedly disgusting and frankly vomit-inducing display of extreme violence porn.

But why would government officials debase themselves and our nation in this way? After all, this is just the sort of monstrosity that democracies find deeply offensive when it is done in such places as Iran and North Korea.

Maybe that’s the point. By now they realize that they have no chance of holding onto control of Congress in the midterms, given how thoroughly they have screwed up on every front. So their only remaining play is to flex their authoritarian muscles in preparation for what comes next.

The worry is that on November 4 they will declare the election that they just lost to have been rigged, and then begin the process of instituting martial law. By committing outrageous acts of public savagery now, they can signal that they will not let the normal rules of decorum get in their way.

It has often been said that is better to show rather than just to tell. In that spirit, sometimes I find it useful to put together little interactive visualizations on the Web to illustrate an idea.

Just this week I was trying to explain to some colleagues an idea I had about eyewear made from mirrors that lets you see to the left with your left eye, and to the right with your right eye. The question I was trying to address was how big your “visual aperture” can be. In other words, when is it like looking through a little peephole, and when is it like looking through a nice big pair of glasses?

Not surprisingly, the nearer you place the mirrors to your eyes (the “eye relief” of the device), the greater the visual aperture. But at some point the eye relief can become too small — if the mirrors get too near to your eyes it will make you uncomfortable.

The smallest comfortable eye relief is probably about 12mm (about half an inch). I created this little visualization to show how eye relief relates to visual aperture.

It was interesting that yesterday, when the Mayor of New York included sympathy for innocent Palestinians who have died during these last 3 years in his remembrance of those slain by Hamas in Israel on October 7th 2023, he was roundly criticized by Jewish leaders.

Then later in the day, when he attended a candlelight vigil in remembrance of the slain Israelis, he was loudly condemned by pro-Palestinian protesters.

Each side accused him of being a stooge for the other side. It seems that people on both sides were confused by this man. Apparently you are supposed to have sympathy only for one set of innocent victims, and no sympathy for the other set of innocent victims.

To have the courage to express empathy for innocent victims on both sides is so rare that to many people it seems alien, inexplicable, and just plain confusing. I guess we have lost our taste for political leaders who dare to show even an ounce of true moral courage and empathy.

Earlier this week, the U.S. president said, speaking about Iran: “They can take out a city. Let them take, let them take out Los Angeles; let them take out San Diego. That’s — this is a very small price to pay.”

That is an exact quote.

The next morning, the White House’s communications director explained what the president meant by those remarks: “He was clearly stating U.S. cities would have been threatened if a nuclear Iran hadn’t been stopped.”

Except that’s not what the president said. What he actually said, quite plainly, was that Iran blowing up a few large cities in the U.S. is a small price to pay for America winning the ongoing war between the two nations.

Which leads me to wonder about two things: (1) How many Americans agree with what the president actually said? (2) How stressful must it be to be the White House communications director — a job where you need to keep making stuff up and pretending that nobody will notice?