Author: admin

During one of the technical papers sessions at the recent SIGCHI (Special Interest Group on Computer / Human Interfaces) conference, two papers stood out for me because they represented perfectly opposite philosophies.

One paper looked for — and found — all the special cases where real world tools could be effectively mimicked by putting your fingers on a multitouch surface (eg: an iPad) as though you were using that tool. Some tools, like a tape measure, computer mouse, pen and eraser, can be mimicked very well on a tablet. Others, like scissors, cannot.

The authors found seven real-world tools that could be mimicked beautifully in this way, and after their live demo they got a big spontaneous round of applause from the audience.

But another paper took the opposite approach. The authors asked “what are the hand and finger gestures that are inherently powerful and expressive on a multitouch surface?” Essentially they game up with a grammar — a way of building an extremely large and extensible vocabulary of hand gestures that nobody had ever tried before.

The power of the first approach is that it is contingent: It works because there are particular real world tools that happen to map into finger positions on a multitouch screen. The power of the second approach is that it is generative: It builds from the inherent richness of what a hand and fingers can express when interacting with a flat surface.

The paper that relied on contingency was more of a crowd pleaser. But in the long run, my money is on the generative approach.

I was having a discussion with a colleague this week about common errors kids make in math.

Here’s one that was used as an example:

Mistaking:

A + B

C + D

for:

A/C + B/D

It’s an elementary mistake — the two expressions are actually very different.

But not always. What if we considered just the class of numbers for which those two statements always product the same results?

That might turn out to be an interesting set of numbers in all sorts of ways.

And what if we were to play the same game with other erroneous equations?

One of those equations could just lead us to some actual math — and maybe that actual math might be very cool.

During a discussion today about artificial intelligence, I had an odd thought.

People who study computer science know that any algorithm takes a certain minimum amount of space to write. Beyond that, you just can’t make the algorithm any smaller. Some algorithms are very simple and take up little space, whereas others are huge and complex, yet the description of any given algorithm can only be compressed so much, and no more.

But what if you used people to compress algorithms? Instead of writing out the algorithm in a formal program, so that a computer can execute it step by step, suppose you just describe the algorithm to another person, and then let them write the computer code?

The resulting description might be a lot smaller. Of course it’s not the same — we are now relying on human brains to fill in the missing bits. Fortunately, there are about seven billion human brains in the world, and many of them are quite good at this sort of thing.

For example, here is how I might describe a bubble sort to a friend: “Repeatedly go down a list, swapping pairs of items that are not in order. Stop when nothing is swapped.”

If my friend knows how to program, she can turn that description into code. She would need to add in lots of bothersome details (loop constructs, iterating variables, conditionals, array declaration, etc) — none of which were in my original description. But any decent programmer would know how to do that.

Wouldn’t it be cool if this leads to a simpler way to describe algorithms?

I had a lovely time spending a week in Toronto. The week before that, I had a nice visit to Stuttgart Germany. Now I am back in NYC.

The cultural difference between Stuttgart and NY was obvious. It’s not a question of “better” or “worse”, just an observation that the cultures are strikingly different. Even if there were no difference in language or accent, I would be able to very quickly tell which was which.

For example, in Stuttgart people follow rules quite strictly — even in cases where those rules make no logical sense. It seems that the idea of following a rule is more important than the reality of its effect in any particular case. Another way of saying this is that even informal rules appear to operate with the force of law.

Of course NY is completely different. People here will follow a rule only if they think that rule makes sense. In fact, a group of people will often collectively — not just individually — agree to break a rule (or a law) if they think the situation warrants it.

To my mind Toronto feels a lot more like NY than like Stuttgart. People approach situations, well, situationally. As people negotiate the city, a lot of common sense flexibility and reasoning goes on, and I like that.

Of course there are cultural differences between NY and Toronto. So I wonder, how long would you need to hang out in one of the two cities before you could tell which culture you were in (assuming you couldn’t cheat and use clues like famous buildings or differences in spelling or pronunciation).

Between NY and Stuttgart, this kind of “Turing test for cities” would be very easy to solve. Between NY and Toronto, I suspect it would take somewhat longer.

I wonder what would give it away first.

I’m fascinated by the way creativity within any one individual is triggered by interaction with other individuals. For example, You might encounter somebody and subsequently convert the emotional energy of that encounter into a play, poem, song, painting, sculpture or novel.

What I find most intriguing about this process is that the other person does not need to directly contribute in any way. Our human to human interaction can simply inspire one of us to rise to the occasion and create something new in the world — which in some cases may end up being shared and appreciated by millions of other individuals.

To be the muse in this situation is perhaps an odd thing. It may be gratifying to be forever associated with such creations as “Don’t Think Twice, It’s Alright” or “Walk Away Renee” or “Famous Blue Raincoat”, but as the muse you haven’t actually flexed your own creativity — you simply helped that process to happen in the mind of another, through some mysterious alchemy of human interaction.

On the other hand, I find it absolutely wonderful that we can have this sort of transcendent effect on each other — that our encounters with another can suddenly lift us out of the every day and give us a voice that can touch the hearts of millions.

This evening somebody raised a topic I’ve heard from time to time: As our cyber-puppets — such as the creatures you can see these days in computer games and electronic musical instruments — become ever more autonomous, will there come a point when we lose control of them, and of our own creative process?

My take on it was that there is nothing to worry about. Every time you see an entity in a computer that seems autonomous, it is actually an illusion. That “autonomy” is in fact a reflection of the creativity and ideas of one or more people, although they may be people that you have never met.

Just as theatre is a collaboration between actors and a playwright (through the medium of a script), and a guitarist collaborates with the luthier who made her instrument, so it goes with computer mediated procedural performance.

As a dancer interacting with an autonomously animated human-like figure, or a jazz saxophonist accompanied by a program that improvises counterpoint to your melody, you are always actually collaborating with other humans.

There are many variations on this. It could be that there are many other humans on the other end of that collaboration, and it could be that your collaborator is long dead. Still, in all cases the computer itself is merely an instrument, designed by people to channel human thought, emotion and creativity.

One day quite a few years ago I went to the corner Korean deli and purchased a tin of sardines. I didn’t think anything of it at the time (this was back when I was still an omnivore). It was just one more random purchase among many.

But then, that evening, feeling peckish, I opened the can, and something very odd happened — I smelled a smell I’ve never experienced before or since.

And then time seemed to jump forward.

In particular, I have no memory whatsoever of the several minutes after those first moments opening the can. My very next memory is of furiously scrubbing the floor, the sink, and every nearby surface, while the tap remained open full blast, although the contents of that can had long since been flushed down the drain.

I am pretty sure that what had happened was this: The contents of the can were not just “bad”, they were very, very bad. The moment I opened the can, the aroma of some sort of anaerobic bacteria had hit my nostrils.

And that was the moment at which ancient life-preserving instinct swung into action.

I suspect that there are certain deadly smells that our ancestors became quite sensitive to, through a process of Darwinian selection. In other words, if you were not highly sensitive to those smells, you would die, and leave no descendants.

So I have first hand knowledge that the right sensory stimulus — for example, a particular smell — can cause us to immediately cast off the thin veneer of our recent evolution, and become a creature of pure instinct, focused only on the deadly serious process of immediate survival.

So many people
Gathered together, and then
Scattering like leaves

In the spirit of yesterday’s post, last night a friend issued a two word challenge. I needed to spin something out from the words you see in the title of this post.

The following is what I came up with.

-KP

_______ 

MacDougal Street at 3am was quiet as a ghost. Stray trash littered the street, and stray thoughts littered the mind of Bobbie Sue as she strode from Third Street down to Houston, scowling, hands thrust in her pockets. She was late, and Draco didn’t like when you were late. Not when he was finally gonna let you deal some smack.

So the last thing she wanted to see was Eddie in his green hoodie, standing in the middle of the street.

“Hey, yo, Bobbie Sue, what’s shakin’?”

“Can’t talk Eddie, gotta go, got a connection to make.”

“Can’t you slow down for an old friend?” He smiled shyly — the same shy smile that had drawn her in all those months ago. Before she’d gotten wise.

“Man, really no. Business is business.” But even as she said it, she felt herself slowing, coming to a stop.

He looked serious for a moment. “You hangin’ with the punks these days Bobbie Sue?”

“None of your damn business,” she snorted. “You gonna get out of my way or what?”

“It’s just,” he said, “I’ve got something for you in my pocket…”

“Jeez Eddie.” Why the hell had she even bothered.

He dug into the pocket of his hoodie and took out an orange, “… and I thought you might wanna share.”

She gave the orange a long look, and then she gave Eddie an even longer one.

“Yeah, OK.” And for the first time in ages, she smiled.

This evening I was discussing with a friend a fascinating idea for a game.

Each of you gives the other two words. With the two words you are given, you need to spin out a tale, which can be fantastical, moving, suggestive, ridiculous, or heart-breaking. It’s entirely up to you.

The important thing is that you use those two words as random seeds to fan the fires of your own imagination.

What I like about this game is its perfect reciprocity. Each of you is providing the sand for the other’s pearl. Neither of you has any control over the spark that will light the flames of your creativity.

As games go, this one is pretty good.