Alchemical Musings

I suppose it was only a matter of time before I experienced something within Second Life that caught my interest. Though I work on and study social software, I haven’t been particularly giddy about metaverses (multiplayer, persistent, 3D immersive environments) for a variety of reasons - perhaps tracing back to the fact that I haven’t really enjoyed playing too many computer games.

As a free software developer I have participated in quite a few post-geographic projects where communication is managed quite effictively in 2D. While I recognize the value of ‘presence’ and synchronous communications, I doubted that an avatar added much additional value to a communicative experience.

This semester I am personally participating in a digital studio, where we have held some meetings inside Adobe’s Connect, but have found the experience cumbersome, adding little value over irc (or, at least, VOIP + text, like in skype). I usually dread video conferenced meetings, though its sometimes worthwhile to share a browser. At work, we helped set up a Global Classroom for the Earth Institute, which has been receiving rave reviews, but is mostly just a shared video experience (with a few live events). Prior to this week, I have visited second life on a handful of occasions as a guest, but mostly just been reading about it, watching videos, and hovering over other people’s shoulders while they play.

All this changed this week, after a chance encounter with a professor, Piet Hut, whose work I encountered years ago as an undergrad. His dialogue with Bas Van Fraassen on The Elements of Reality really helped me crystallize my thinking on a range of philosophical questions, and the perspective explored in this conversation may serve as an effective bridge between ancient and modern metaphysics.

Prof. Hut is an astrophysicist at Princeton’s Institute for Advanced Study (which now, more than ever, reminds me of the village) , and he takes phenomenology and mysticism pretty seriously. His interdisciplinary research is really all over the map and I dig his philosophies of science. His writing is usually clear and free of jargon.

I have not been keeping up with his work, but when I saw his name on the schedule at the CSSR Neuroscience and Free Will conference, I decided to crash his talk (and I figured there would be coffee and snacks).

In his talk he mentioned some of his latest work inside of virtual worlds, including new ways of conceptualizing (scientific) simulations and research. I was quite receptive to this topic, since I have been thinking a whole lot about how Technology is transforming Epistemology, which I have started writing about here, and hope to expand upon at the end of this semester (um… that’s in a few weeks!).

His latest project though is another trip entirely - (or, perhaps identical, from the inside-out ;-)). The project, Play As Being is described and tracked on that blog, and is a bit tough to explain in words - you sorta have to try it to understand/believe it.

So, I kinda had an enlightening experience inside of SL. I learned about the potentialities of virtual worlds as phenomenological laboratories. While I was there last night I was attentive to my minds restlessness (how weird is it that after 45 minutes I was compelled to stand my avatar up and stretch my “legs”?) and learned a few new RL practices. I brought the lessons back to meatspace today, and was much more mindful of my body and breathing. I’m not on the full 1% time-tax rhythm, but I am working on picking out mnemonic bells so I can introduce a bit more discipline into the flow of my experience.

In retrospect, I shouldn’t have been that surprised at the cognitive value of a 3D experience. I mean, I’ve read about The Loci Method in books like The Art of Memory. But the idea of using the environment as a Zen training studio really blew me away. I imagine you really need the right group for the experience to work, but I am quite impressed by this particular purposeful use of this instrument. It took a really good teacher(s), but I have a much better appreciation for effectively using SL as a space to practice mindfulness and contemplate Being.

Has anyone else heard of things like this happening w/in SL?

Filed by jonah at 1:02 am under air, metaphysics, playasbeing
No Comments

Since I am total flosstitute I do lots of my work on the beautiful OS X desktop, though the servers I administer are all linux, and on my new thinkpad laptop I finally bit the bullet and wiped the windows partition (it came with vista, so there wasn’t much deliberation). My only encounters with windows nowadays are through virtualization, so I feel like I have that demon safely caged.

One of the things I love about the mac are the little easter eggs you can find if you hunt around long enough (or more likely accidentally stumble upon).

One of these black-ops is the music visualization software that comes with iTunes (at least on OS X). I seem to recall something about a Christian fundamentalist writing it originally, right before joining the navy and serving on a submarine crew. Thing is, he couldn’t get this piece of software out of his head, and winded up leaving the military to work on this software full time. I think Madonna used to use early prototypes at her private parties, and one way or another he started working at Apple, apparently on the iTunes team. (this is all from memory, and I couldn’t find a source, in case anyone has heard this story also).

In any case, I occasionally remember to check in on this tool, and it’s gotten better with ever release of OS X. I think last year I discovered that if you run it in full screen mode it seems to use a much improved rendering engine, and maybe even a different algorithm.

None of this prepared me for the experience that I had Tuesday night. A few months back I learned about a wicked cool piece of software on Alexander Limi (the Plone founder’s) blog. The software is called nocturne, and is pretty friggin cool on its own. It’s not much more than a simple set of macros that invert the hues of your display - to either black and white, inverted color hues, or even submarine red. It’s really nice if you want to use your computer at the end of the day, but don’t want to deal with all the energy of a full backlight.

So anyway, I had this kooky idea (no drugs involved!) to turn on the iTunes music visualizer with nocturne in night mode, and I simply could not believe my senses. I was witnessing the audioloom - an idea I had begun to think about a few years back that originated with the simple question - can synesthesia be learned? I became very interested in the natural relationships between color and sound, noticing that both seem to come in octaves (think of the color wheel - a venn diagram defining 3 singles, 3 doubles, 1 triple, and the background, making 7+1… just like the western musical scale!).

I even remember what sparked this question. I was playing with a new set of Christmas lights, the kind with a remote control that makes the lights dance in different patterns. The important part of this experiment was leaving the lights ordered neatly in the box, instead of making a tangled mess. With this arrangement, when I played music, I could swear that the photons were dancing to the beat

In any case, I was intrigued by the possibility that there might be a fundamental ontological relationship between sound and color, but even with this foray into metaphysics, I thought there might be a natural mapping between these two types of sense data, one that might be empirically determinable.

I did some research on synesthesia, and read a great book called The Man Who Tasted Shapes. My idea began to take shape as a multi-phase project. Phase I was this screensaver on steroids, but Phase II is a musical instrument that plays light instead of sound. As with all fun ideas, there is nothing new under the sun, and many philosophers/inventors ranging from Aristotle to Newton to Benjamin Franklin have taken a crack at this problem (timeline), but the idea was ahead of its time… Until now.

So, back to Nocturne’s night mode. When I went full screen with non-monotone inverted hues, I swear to god it felt like I was entering a wormhole. Right out of that scene in Carl Sagan’s Contact, except without the extraneous seat that the stupid humans built.

I was transfixed, and will freely admit that on this first trip I spent a solid 2 hours staring at the screen and listening to my favorite tunes. Every time a song would end, I would wonder what another of my favorites would look like. I think the difference between day mode and night mode is that the visualizer outputs mostly dark. By inverting the hues, the screen explodes with backlit energy. Enough to keep your eyes working overtime. It was kinda like watching TV, except that instead of being hypnotizing, it was mesmerizing. I mean, I was grooving on my favorite music, but my eyes weren’t jealous of my ears - everyone had their work cut out for them.

Unlike TV, the audioloom experience requires active processing, as your brain frantically struggles to find patters in the sequences and segues. Since I don’t think the shapes and transitions are computed deterministically, there is an element of Art combined with the engineering mathematics displayed on the screen.

It made me wonder if this feeling would normally have required 10 years of devoted study in an ashram to replicate before this technology came along. One way or another, the experience was transcendental, and I just hope I haven’t stumbled upon the Videodrome, or the mysterious plot device in Infinite Jest…

In any case, I plan to continue my experiments and keep you posted with updates. It is quite a relief that I might not actually need to implement this invention one day. Just goes to show, ideas kept secret, go stale.

Filed by jonah at 6:52 am under aesthetics, air
No Comments

I haven’t posted much here lately, but I have been writing. I just finished my first semester as a doctoral student in the Journalism school and completed a flurry of term papers.

These two are from my pro-seminar with Michael Schudson, a class meant to introduce us to the history of the field and the faculty in the program. Our final assignment was to identify gaps in the field, which is a tough one, as all non-existence proofs are — especially in an interdisciplinary field, there will always be a fringe element occupying the gap.

People in the class interpreted the assignment in two ways — some chose to identify gaps, while other actually went out and tried to fill some. I took the opportunity to begin to pre-emptively answer the question I am sure to be challenged with in the years ahead - the ever-daunting methodolgical quetsion — what on earth am I doing and how am I am doing it?

Out of Thin Air: Metaphor, Imagination, and Design in Communication Studies

(and this was the midterm paper which got me thinking in this direction Transcending Tradition: America and the Philosophers of Communication).

I also took a wonderful class this semester at the New School taught by Paolo Carpignano (The Political Economy of Media - here is the syllabus). The class was all about the shifting relations between fabrication and communication, or more colloquially, work and play. We opened with Marx and Arendt and closed with Benkler and boyd. I took the opportunity to capture some of my experiences working on the Plone project before they fade from memory.

Fabricating Freedom: Free Software Developers at Work and Play

I am really glad to be done with the semester and am looking forward to a few weeks of “just” working full time!

Filed by jonah at 1:11 am under air, earth, epistemology, metaphysics
1 Comment

This week I saw a presentation given by a member of the Yahoo!/Berkeley research team.

At the talk, Dr. Naaman demoed this unassuming tool that his group has been working on:

TagMaps (live demo, description)

I am really glad I went to the talk, since the demo helped me understand how sophisticated this tool really is. I had a definite ah-ha moment learning about all the new flavors of semantic information soon to be mined from the massive amounts of memories we are collectively recording.

During the talk I was reminded of this recent essay on Evolution and the Wisdom of the Crowds which explains how counter-intuitive these emergent properties are to our everyday experience. But, this seemingly teleological construction of semantic knowledge naturally emerges from a rich enough system, as the flickr research demonstrates.

To clarify what you are looking at here, no humans tuned or trained the system to teach it which are the significant landmarks in these regions. The representation is computed using the aggregate processing of many, many tags. These tags are starting to provide enough information to disambiguate different senses of a word (based on the adjacent tags that are also present). Patterns are also discernible from the spatial-temporal information on these photos, and yearly events (e.g. BYOBW) have been detected and recognized by the system. Formerly unanswerable questions, like “What are the boundaries of the Lower East Side?”, now have a fuzzy answer of a sort, in the form of collective voting.

While the UI work here is neat, it pales in comparison to this Jaw-dropping Photosynth demo presented at TED this year (though it does beat the pants of the current UI of pink dots on a map which forces you to paginate over all the matching pictures in batches of 20). The widget is even available as web service which you can feed your own data into.

But, the real work here is going on behind the scenes. It’s being published and presented in CS contexts, just in case anyone thought this “social media” stuff was for just for kids.

How flickr helps us make sense of the world: context and content in community-contributed media collections

There is certainly lots to digest here. It’s one thing for an algorithm to decide on the most representative photographs of the Brooklyn Bridge essentially based on popularity (though its a shame that avat-garde art photos will be automatically marginalized through this technique), but its quite another to imagine other important areas of discourse being regressed to the mean - its an odd sort of leveling effect that is likely another manifestation of Jaron Laniers’ Digital Maoism.

The presenter did note that social media designers do need to anticipate feedback effects, as when they launch a new tool and users adjust to the new conditions and modify their behavior accordingly (or begin to “game” the system to take advantage of it).

We are a long way from 1960’s AI and its conviction that the world is best modeled and represented as a series of explicit propositions.

Filed by jonah at 6:19 pm under air, epistemology
1 Comment

Or, My Fancy Rationale for Indulging in Conspiracy Theories.

New Scientist just ran a story on The Lure of Conspiracy Theory. They claim that:

Conspiracy theories can have a valuable role in society. We need people to think “outside the box”, even if there is usually more sense to be found inside the box. The close scrutiny of evidence and the dogged pursuit of alternative explanations are key features of investigative journalism and critical scientific thinking. Conspiracy theorists can sometimes be the little guys who bring the big guys to account - including multinational companies and governments.

I strongly agree with this position, and consider the natural tension between dogged skepticism and flagrant bootstrapping to be a good methodology for fostering creative scientific thought.

But I think the NS story misses an important angle of conspiracy theories that I have been wondering about lately.

The question I have been wondering about is to what extent can group behavior can be understood or characterized as conscious/willful/intentional. How much ideology do members of a group need to share before their behavior can be understood (and perhaps predicted) as an intentional agent? Is postulating intentionality a useful heuristic for understanding group behavior?

I am not going to follow this idea too far in this post, but this position provides an alternative perspective on theories like the idea that all Peace Corp volunteers are CIA agents, and why theories like this become so popular. Our cognitive capacities are poorly equipped to percieve complex emergent behaviors, and postulating intentionality may serve as a natural (and useful) strategy for capturing these patterns.

I personally trace the philosophical genealogy of this idea to Daniel Dennett’s Intensional Stance, but a friend of mine pointed out that this idea can also be found in Madison’s Federalist Paper #10. The main idea behind Dennett’s intensional stance is that we can bracket the deep, hard, ontological questions about the nature of consciousness and simply observe how useful taking the intensional stance is as a heuristic for understanding other people’s behavior. We posit intentionality which yields reliable predictions about agents (philosophical agents, not the ones working for letter agencies) in the world around us. And we don’t limit the intensional stance to other people either - we regularly adopt this stance with animals and machines, often to great utility.

For whatever its worth, labeling something a conspiracy theory sometimes seems like a pejorative, non-rational critique. Heck, Al-Queda is a conspiracy theory (and an open source project, according to Bruce Sterling’s SXSW ‘07 Rant), but perversely, it’s the Power of Nightmare’s attempt to dispel this fabrication that is labeled the conspiracy.

But, I really want to live in a universe in which we actually landed on the moon.

Filed by jonah at 12:55 am under air, fire, metaphysics
2 Comments

My visits to the Informedia lab have consistently generated futuristic ideas (and corresponding posts), and my trip this spring was no exception.

This time I was thinking alot about what kinds of schemas will be employed after their prototype moves beyond watching grandma? When this kind of a system is inevitably rigged up to a school or a prison, or fed raw streams from live surveillance cameras?

My money is on the Diagnostic Statistical Manual of Mental Disorders, an instrument that is arguably becoming the de-facto catalog for the full range of human behavior and experience.

In some respects, this progression parallels the notion that nobody dies of old age anymore - they die of heart failure, cancer, or other diseases. And, as the title of this post cheerily states, we are all dying, we are all sick, and we are all crazy.

As crazy as it sounds, the DSM is poised to become the lens through which we interpret all of human behavior. Given its breadth of coverage, I challenge anyone to find me a normal, healthy individual. It’s ambition reminds me of William James’ Varieties of Religious Experience, except in our generation, the full range of human experience has been radically pathologized.

BTW - the folks who brought us Sexual Orientation Disorder are hard at work on V 5.0 of this catalog - and there is a call out for diagnosis suggestions.

Filed by jonah at 12:18 am under air, epistemology
No Comments

The Alchemist in me feels compelled to respond to the excellent documentary that aired on PBS the other week entitled Newton’s Dark Secret. The film profiled Sir Issac Newton’s fascination with the ancient art/science/craft of Alchemy.

Many of the experts interviewed regarded Newton’s Alchemical experiments to be shameful, perhaps reflecting more on our modern epistemic prejudices than on Newton. Contemporary experts seem threatened by the prospect than anybody in historical times understood things about the world that we don’t.

Beyond the shame of taking Alchemy seriously, they also considered Newton’s alchemy to be his greatest failure. Failure?!? During the period Newton was practicing alchemy he wrote the Principica Mathematica, and also catapulted his way into the power elite - he became knighted, was appointed the head of the Royal Society, and earned power, prestige and wealth beyond his wildest dreams. To this day one of the most respected chairs in physics still bears his name. From this perspective, his alchemical pursuits seem quite successful. Smashingly successful if you consider this blogs tagline “Aurum nostrum non est aurum vulgi” - Our gold is not ordinary gold.

The Alchemists understood metaphor, and it was essential to their theory and practice. Why do most modern thinkers insist upon interpreting the craft so literally?
My girlfriend shared a Bahá’í quote on a related subject.

“Should a man try to fly with the wing of religion alone he would quickly fall into the quagmire of superstition, whilst on the other hand, with the wing of science alone he would also make no progress, but fall into the despairing slough of materialism.” — Abdu’l-Bahá, The Fourth Principle

Or, to paraphrase, Religion without Science is superstition, Science without Religion is reductionism”

I have long believed that Alchemy is a framework which seeks to reconcile spiritual integrity with material wealth, or more broadly, science and religion.

Perhaps the ancients might have been on to something that modern science has truly forgotten. It is tough to challenge Newton’s genius - maybe his alchemical theories deserve a more respectful examination.

Filed by jonah at 6:44 pm under air, metaphysics
2 Comments

Well, I called it:

In in class I took with Eben Moglen I predicted in a class discussion that pictures on the internet would soon be indexed:

Re: video cameras (Feb. 11, 2005)

Many people in the class were skeptical…

Well, here it is, less than two years later:

Face Search Engine Raises Privacy Concerns

Of course, there are standard objections to the two primary critiques of surviellance “paranioa”.

1. If I am not breaking the law, why should I care?
2. There is so much informatoin being gathered, who could possibly sort through it all?

The responses to these objections should be well rehersed.

1. Pervasive Omniscient Surviellance will have an impact on the basic fabric of personal social and cultural interactions as we currently understand them.
2. The AI is coming, getting more powerful by the day.

Filed by jonah at 1:35 am under air, metaphysics
2 Comments

Monday night I went to the ITP’s end-of-semester show. A friend of mine is in the program and I went to check out the scene. ITP, the Interactive Telecommunications Program, is part of the Tisch School of the Arts at NYU. ITP has been around since ‘79, and lies somewhere concetually between the MIT Media Lab and Mary Flanagan. When I visited the MIT Media Lab this summer I began to understand how it was really operating as a pooled R & D lab for corporate interests (with plenty of military funding). I got the vibe that ITP is coming from a different place with different priorities, but I don’t really know the full back story.

Here are some of the highlights of the many many projects I saw the other night:

• The Stuff Project
• We Rock NYC
• Network Journaling
• Whales in the Sewer
• The ‘Is our machines learning?’ Machine
• Witness Human Rights Video Hub Pilot
• Turing Machine
• Action at a Distance
• Aura
• Solar Jelly
• Urban Sonar

Emerging themes continue to suggest that we are indeed embarking on a era that can be described as “The End of Forgetting“, and that epistemology itself is transforming beneath our feet. That is, the way we know what we know, the kinds of things that we know, and our relationship to knowledge is being transformed by shifts in memory, computational possibilities, simulation, and visualization. Going to a show like this really reinforces these bold predictions.

Filed by jonah at 5:45 pm under aesthetics, air, earth, epistemology
No Comments

Last weekend’s Cultural Studies conference reminded me of a viscous cycle that many humanities-oriented researchers are being subjected to. Disciplines such as educational research, ethnography, anthropology, cultural studies, sociology etc have effectively been colonized by the methodology of the social sciences and they are being forced to play a numbers game which they may not be suited for.

Many projects striving for credibility are subjected to the tyranny of statistics - forced to transform their qualitative information (interviews, transcripts, first person accounts) into quantitative information through the process of coding. This reduction forces the data into buckets and creates a significant degree of signal loss, all in the name of a few percentages and pie-charts.

Perhaps we have lost sight of the motivation for this reduction - the substantiation of a recognizable, narrative account of a phenomena, supporting an argument. Arguably, the purpose of the number crunching is to provide supporting evidence for a demonstrable narrative. Modern visualization techniques may be able to provide one without all the hassle.

True, this is not always the only reason that qualitative is transformed into quantitative data, but advanced visualization techniques may provide a hybrid form that is more palatable to many of the researchers active in this area, and is still a credible methodology. It seems as if many people are being forced into coding and quantification, when they aren’t thrilled to be doing so. But the signal loss that coding is responsible for, all in the name of measuring, might be unnecessary if people think about using data visualization tools, that comprehensibly present the data, in all of its richness and complexity, as opposed to boiling it down to chi-squared confidence levels (and does this false precision actually make any difference? Does a result of 0.44 vs. 0.53 tell significantly different stories?)

In a thought provoking post on the future of science, Kelly enumerates many of the ways new computing paradigms and interactive forms of communications might transform science. The device that I am proposing here might lead to some of the outcomes Kelly proposes.

For a better idea of the kinds of visualization tools I am imagining, consider some of the visualization work on large email corpora coming out of the M.I.T. media lab, or the history flow tool for analyzing wiki collaborations, but even the humble tag cloud could be adapted for these purposes, as the power of words and visualizing the state of the union demonstrate.

Crucially, tools analogous to Plone’s haystack Product (built on top of the free libots auto-classification/summarizer library) might help do for social science research what auto-sequencing techniques have done for biology (when I was a kid, gene sequences needed to be painstakingly discovered “manually”).

The law firms that need to process thousands of documents in discovery and the commercial vendors developing the next generation of email clients are already hip to this problem - when will the sciences catch up?

For any of this to happen the current academic structure needs to be challenged. The power of journals is already under attack, but professors who already have tenure can take the lead here and pave the road for their students to follow.

Filed by jonah at 11:25 pm under air, epistemology
2 Comments