Author: admin

We use differing metaphors when we do different things on a computer. At various times we interact with shared documents, video chats, ebooks, augmented reality environments, software development tools, 3D modeling/animation tools, computer games, science simulations, and so on, with each type of interaction implemented by another computer program.

At any given moment, your computer screen might contain a video chat, a Google doc, an eReader program, and so on, all implemented as separate programs. Because of this separation, interaction between these programs tends to be limited.

I suggest that this approach is ultimately a mistake. Once it has been decided that functionality should be split into separate bodies of software, many kinds of rich interactions between the underlying metaphors simply cannot be implemented.

Google Wave was a noble and ultimately unsuccessful attempt to be a single integrated environment — an all-in-one program that does everything. I suspect Wave may have been trying too hard to be capable of doing absolutely anything one could ever think of.

Suppose instead we were to approach such an integration first and foremost from the perspective of user-centered design. Rather than set out to build a software tool that “could do everything”, we might instead ask “what would the user of such an integrated tool actually want?”

We then let the answers to that question guide our software design choices.

Yesterday I saw the wonderful retrospective of the work of the Brothers Quay at MoMA. Like their predecessor Jan Švankmajer, they center much of their stop-motion animated filmmaking around puppets trapped in a dark and surreal world of rag-tag and seemingly found objects eerily come to life.

I think what makes this genre so arresting, more than any other single factor, is the gaze of the puppet. The puppet stares at its mysterious world, looking this way and that with fixed and intent expression, and in our minds we cannot help but project a Kafka-esque existential crisis into every frame.

For the puppet always seems to be trying, with tireless desperation, to make sense out of its circumstance, out of its very existence. Yet we know something the puppet does not: It is itself only a thing of borrowed life, a shell into which a soul has been breathed by an unseen force.

We also know it is only the will of the puppet’s master that animates this soul from one moment to the next. So the puppet’s gaze becomes something deeply affecting and tragic, as we watch it try so desperately to find the logic in an absurd existence.

For on some deep level, whether we care to or not, we know exactly how the puppet feels.

“Now the trees are bare
There’s sadness in the air
And I’m as blue as I can be”
– Hal David

How ironic that even as I was waxing rhapsodic about songwriters in my previous post, the greatest lyricist of them all passed away yesterday. I hadn’t mentioned him in that post because it would have been like name checking Picasso in a discussion of painters.

Hal David was co-writer of two of the songs I mentioned yesterday, “99 Miles From L.A.” and “To All the Girls I’ve Loved Before”, both written with Albert Hammond. He also contributed, over the course of his long and marvelous career, to the writing of more than 700 songs.

Among these, to name just a few of my favorites, are “24 Hours from Tulsa”, “Alfie”, “Anyone Who Had a Heart”, “Blue on Blue”, “Close to You”, “Do You Know the Way to San Jose”, “I Say a Little Prayer”, “Make It Easy on Yourself”, “Message to Michael”, “One Less Bell to Answer”, “Raindrops Keep Falling on My Head”, “The Look of Love”, “There’s Always Something There to Remind Me”, “This Guy’s in Love With You”, “Walk on By”, “What the World Needs Now is Love”, “Wishin’ and Hopin'” and “You’ll Never Get to Heaven (If you Break My Heart)”.

We are fortunate to have lived in a century that contained a talent of such magnitude.

“All the things that we felt
Must eventually melt and fade
Like the frost on my window pane
Where I wrote ‘I am You,’
On Second Avenue.” — Tim Moore

At his vocal peak, Art Garfunkel had a way of finding the most in a song of romantic yearning or lost love. But whose emotions are such singers actually channeling, and what other stories might be lurking at the source?

Out of curiosity, I looked up the writers of some of Garfunkel’s most iconic solo recordings, to see what other songs I would find. Not surprisingly, the song with the most achingly lovely melody — “Traveling Boy” — was written by Paul Williams, well known for many iconic songs, including “Rainy Days and Mondays”, “Evergreen”, “We’ve Only Just Begun” and “The Rainbow Connection”.

Similarly, Garfunkel’s biggest hit — “All I Know” — was written by the great Jimmy Webb, who also wrote “By the Time I get to Phoenix”, “Up, Up and Away”, “Wichita Lineman”, “MacArthur Park”, and many other wonderful songs. So far no real surprises.

But then we get to the more interesting cases. “99 Miles From L.A.” was co-written by Albert Hammond, whom I am embarrassed to say I’d never heard of, considering that he also wrote or co-wrote such songs as “It Never Rains in Southern California”, “When I Need You”, “To All the Girls I’ve Loved Before” and “The Air that I Breathe”, among others. You can see Hammond’s own performance of “99 Miles From L.A.” here. While he doesn’t have Garfunkel’s crystalline voice, I find his rendition more genuine and emotionally effecting.

Similarly, I had never heard of Tim Moore, the writer of “Second Avenue”, one of the most moving songs on Garfunkel’s Angel Clare album. While Garfunkel’s voice is lovelier, Tim Moore’s own recording is far more sad and moving. Alas, Art Garfunkel’s recording of this song, released shortly after Moore’s own version, knocked Moore’s recording off the charts, which arguably derailed Moore’s career.

Starting with almost any pop album containing songs not written by the singer, we can discover a vast web of talent, brilliant writers painting their own emotional landscapes in song. Most of us end up associating those beautifully painted landscapes with others — the well known singers who have built careers expressing the emotional tales of these writers.

I guess that’s just the sad way of the world. You can live your life in the shadow of such geniuses, bathed in their work, yet never be aware of their existence. After all, how many people do you know who have heard of Jane Espenson?

After talking yesterday about the limits of collaboration, today I’d like to share a conversation I had about the natural alliance of artists and scientists.

When you think about the energy people put into making things happen in the world, you find roughly two categories: People who do things because they deeply believe in them, and people who do things as a way to another goal (usually making money). The people who do things out of inherent passion for the thing itself often dress down, preferring black tee shirts to white shirts and ties. For this reason, these creative types are sometimes referred to as “black shirts”.

On the other hand, people who go to business school and end up in CEO or COO positions within a corporate hierarchy tend to value exactly those aspects of appearance that are anathema to the creative types, such as wearing a nice shirt and tie. These people are sometimes called “white shirts”.

Today in conversation somebody asserted that the “white shirts” have an agenda to keep different types of “black shirts” separate from each other. After all, he asserted, if the creative people — whether scientists or artists — were to all find each other and join forces, they might not need all those other people. They could just get together and do it on their own.

This might not even be a conscious agenda, he continued. It could be that the participants — both business and creatives — cannot imagine an organizational structure without a business focus at its core.

The image of black shirts and white shirts struck me as somehow poetic, even if the theory might be flawed. For example, It could be that creatives themselves just don’t want to be bothered with these aspects of running an organization. Or that, as an organization grows, its founders could simply be changing their black shirts for white. In any case, it might be something worth thinking about. Or maybe not. 😉

I was involved in a discussion about interdisciplinary collaboration with a very high powered group which included various people who create procedural characters, develop systems to compose interactive narrative, generate controllable language expression, and so forth.

We were discussing various ways we might all collaborate, when a professor of literature in the room asked “Yes, but what is the humanities research question?”

For a while that question stopped the discussion dead, and it took a while for me to understand why. The problem, I think, was that it was just the wrong question.

You can’t ask what the significance or cultural meanings are of work created in a new medium, until you’ve actually built the medium and somebody has created work with it.

The take-away lesson for me was that people who are creating new media should try very hard not to get pulled into conversations about what it all might mean. Rather, they should do everything they can to progress to the point where talented authors and creators can get their hands on the new tool.

Only then will the potential power (or lack thereof) of the medium come into view. And only then can the interesting cultural questions start to be asked.

Bob Dylan’s 1966 London tour led to a landmark 1967 D. A. Pennebaker film Don’t Look Back, in my opinion one of the greatest documentaries ever made.

The movie contains a fascinating scene in a hotel room with Dylan and Donovan. Donovan was a wonderful pop singer/songwriter, but (to paraphrase the late Senator Lloyd Bentsen), he was no Bob Dylan.

In the scene, Donovan plays a cute little song he wrote, after which Dylan performs “It’s All Over Now, Baby Blue”. The difference — between a mere entertainer and a great genius at the peak of his powers — is stark, and almost shocking.

Today I spent several hours talking with Bret Victor, during which we each shared our respective demos/prototypes and discussed thoughts and ideas for the future. The experience was wonderful and exhilarating.

And I felt like Donovan. 🙂

Today a colleague from Microsoft was bemoaning the fact that they can’t seem to get enough press around the cool history visualization project ChronoZoom that uses their zooming technology. Apparently, when the project was demonstrated at Berkeley, one blogger’s response was “Saw a cool demo at Berkeley. Google should do something with this” (Microsoft wasn’t even mentioned).

I told my colleague that what Prezi and Google Maps both have is a compelling use: People want to give presentations and to find places in the world. Prezi and Google Maps each provide a nice way to do something people already know they want to do.

As cool as ChronoZoom is (and it is very cool), if Microsoft wants to really push its zooming technology, it will need to bundle it with at least one driving application that speaks to some capability people already know they want. Without that, the technology — as wonderful as it is — will never grow beyond the “cool demos” phase.

Today I was watching Anne Balsamo using the Prezi zooming presentation tool to give a great talk about the way history forgets who actually created various technologies. She was speaking specifically about how women have been written out of much of the history of technological innovation, and her talk referred to research reports with titles like “Notes for a revised history of technology.”

The whole scene was eerie for me, because I and my students had done the first foundational research on zooming interfaces. Our research at NYU led to a whole bunch of useful things elsewhere, including Prezi and Keyhole (which eventually became Google Maps).

Ironically, Anne herself was not aware that I had anything to do with the history of the technology she was using.

A few people in the room realized the irony, and gave me knowing looks. Sitting there, I was mostly thinking of it as a great opportunity for a blog post. 🙂

I saw a great talk today by Brenda Laurel. She touched on many fascinating and evocative topics, but one phrase really jumped out at me:

“Cultural intervention is introducing new DNA into a cultural system without activating its immune system.”

There is a lot of meaning packed into these few words. On one level the thought may seem evident, yet at the same time it is very profound.

After all, you can scream at the top of your lungs demanding change, yet be heard by nobody. But if you understand something about the cultural system you are addressing, you might be able to pass right through its protective cell walls and get your message across.