Technology

Audio experiments and the rise of Scuttlebutt

Audio experiments and the rise of Scuttlebutt

by Jonah Bossewitch and Rob Garfield

ouroboros_Michael_Maier_Atalanta_Fugiens_Emblem_14While chipping away at my dissertation this summer I found myself faced with the daunting task of transcribing about a dozen hours of video. I desperately wanted to believe that, in 2014, transcription was a machine’s task, so I took a minor detour through the state of the (consumer) art in voice recognition.  One of my computers runs OSX which includes Dictation (since Mavericks), the same voice recognition software that powers Siri. Following these instructions I used the Soundflower kernel extensions to send the audio output from Audacity into Dictation’s input. Dictation did such an awful job understanding my video that I actually found it easier to transcribe the videos manually rather than edit Dictation’s vomit. I found some decent software called ExpressScribe to assist in the manual transcription.  ExpressScribe makes it easy to control the playback speed, and can be configured to play a segment, automatically pause, and then rewind the video to moments before it paused.  The pro version can be rigged up to foot petal controls, but I was able to do my transcription using the crippleware. This summer I visited my friend Rob’s country house, affectionately dubbed Snowbound and located on the transcendental Baptist Pond, NH. Rob was gracious enough to invite me up for a writing retreat, though we managed to fit in some canoeing, hiking, cooking and drinking. We also gave birth to one of the most creative constructive procrastinations of my dissertation*—Scuttlebutt. After all that time playing with transcription tools we began to wonder if OSX could understand itself.  For years, OSX has been able to turn text to speech, and even ships with dozens of voices, with names like Vicky and Alex.  What would happen if we fed OSX’s text-to-speech into it’s own Dictation software? Dealing-with-Workplace-Gossip6Originally we thought Scuttlebutt might analogize and highlight the way that we humans misunderstand, mishear and misremember, in particular, the lightning quick messages that we receive on a daily basis through personal interaction, social media and email—*often deeply changing the message, generalizing it, and recontextualizing it.  Although voice recognition software begs us to “train” it, we thought we might have better results interacting with its infant state. We needed a reliable benchmark and settled on the first chapter of Genesis. We were curious if the voice recognition software would improve, with successive iterations of feeding it it’s own output back to itself using text-to-voice. There was one way to find out.

peddling platforms

peddling platforms

7175132773_dc83a2d1f2_bNew York City’s bike share program is flourishing, and I recently signed up for a membership even though I live outside the range of any Citibike stations. I find it convenient and fun to use the bikes to cross town, as well as zip from place to place when I am downtown. Since my first ride on the Parisian Vélib’, I’ve become a huge fan of bike shares, and have enjoyed rides in Paris, DC, Denver, Miami, and Toronto. The other month I had a great conversation with a local bike shop owner about the new program, and he conveyed the anxiety that many bike shops are feeling around Citibike. Understandably, many are concerned that the bike share will cut into their rental and retail sales, although I think it is likely that an increase in  biking will generate more interest and awareness, and generally increase the demand for bikes and bike services. Our discussion helped me recognize was how the city bike shares can be viewed as a platform for innovation, in the same sense that the iPod/iPhone is platform. And, just as the iphone-as-platform enabled a large ecology third-party  hardware and software businesses, bike shares present an analogous opportunity to creative entrepreneurs. Platforms can support entire ecosystem, and city bike shares provide an opportunity to build a new ecosystem around them. Cases and Chargers Let’s start with the hardware. I don’t need an MBA to understand that the real money in retail is made by selling accessories. For the iPhone this includes cases, cables, and a range of other devices, but retailers like Amazon and Best Buy have invested in incredibly complex systems to track the relations between products and their compatible accessories. Consider this. What New Yorker wants to be mistaken for a tourist while riding their Citibike? What they need is a way to (fashionably) express themselves, and make the generic bike their own. Starting with an appropriate pannier bag, Citibikers need an easy way to transport their helmet, gloves, music, and personal belongings. Bike shops currently have entire walls devoted to these kinds of accessories. With some focused curation bike shops can begin assembling “MyCitiBike” kits that are segmented and suitable for the demographics of their customers, no custom manufacturing required. Bags and accessories are just the start. Helmets should be as ubiquitous as umbrellas—inexpensive ones sold by street vendors, and maybe more durable ones available in vending machines, for a refundable deposit. You would just need to bring your own liner, which you could conveniently stash in your pannier bag. Turn on the lights Consider the explosive proliferation of bike lights that are poised to transform New York City into Black Rock City. Bike lights are being sold in  increasingly dizzying arrays of frequencies and patterns, but the arms race for visibility and attention may soon devolve into visual noise and distraction as the density of bikers grows. Imagine you are a biker who wants to communicate your intentions to a motor vehicle. During the day, there is a system of hand signals for signaling your intent. But currently are are’t any well established  standards for bike lights, other than white in the front and red in the back. Some of the standards that could help are obvious—more red when I’m braking, and left and right blinkers when I’m turning.  Others, like wireless control of helmet mounted lights, still need to be worked out. Some European bike manufacturers have begun introducing signaling innovations, but without standards these efforts will likely stall. Standards can emerge from the top-down, by mandate or regulation, or the bottom-up, by convention and adoption. I believe that bike share fleets present a powerful opportunity to innovate on bike safety and standards in a way that could lead the rest of the market.  Admittedly, it would be difficult to convince municipalities to devote the resources to underwrite these features. However, I dream of a day when stakeholders such as Transportation Alternatives and Critical Mass work with the Mayor’s office to hold Citibank’s feet to the fire. Instead of just a marketing campaign designed to whitewash their reputation, the Citibike program could be used to spearhead safety initiatives, such as lighting standards and open APIs, that could eventually make their way across the rest of the biking industry. Computational Cycles The iPhone has the app store, and bikeshare apps could be just as expansive. From quantifying yourself for fitness and health, to turning the city into one big arcade game, the possibilities are really wide open. It’s easy to imagine apps which bring traditional “pedal-for-charity” campaigns into 21st century, as well as casual team games like capture the flag or even frogger.  Some of these games could be powered by apps that run on smartphones, or fitness trackers (e.g. fitbit),  but once again, the bike-share platform offers an opportunity to standardize data formats and open apis for ride tracking. RiderState is an early example of a competitive social game for bikers, but more will surely follow.

RIP Aaron. You are not alone

The corner of the internet that I hang around in has been mourning all weekend with tributes, eulogies, and heartfelt sharing about the untimely death of Aaron Swartz. I don’t remember meeting Aaron personally, but I have heard him speak, am friends with many of his friends, and was very aware of his work and activism. I am furious and sad to hear that he took his own life. I have lost a few friends and relatives to suicide, and years ago wrestled with some of these demons myself. Honestly, I am not sure how I feel about politicizing this moment. There are strong arguments on both sides. Being persecuted by the state is horribly stressful and isolating, and I also feel strongly about many of issues that Aaron advocated for. But, I am concerned about responses that reduce and simplify Aaron’s complex decision. This post about suicide reporting on the internet raises the concern that sensational reporting causes an increase in suicides in the wake of the coverage. What I want to contribute to this conversation is an important message to any geeks, hackers, or activists that are struggling with isolation, alienation, depression, or even suicidal thoughts. You are not alone. And, sometimes it takes alot of courage to decide to stay alive. For the past 10 years, radical mental health groups like The Icarus Project have been developing support materials for activists that provide alternative ways of thinking and talking about mental health. Take a peek at their forums, publications, podcasts, documentaries, and more. They have really helped so many people rewrite their own narratives, and connect with others struggling with similar emotions. In the past year or two especially, I have seen more and more geeks/hackers who are attempting to organize around these issues, eliminate stigma, and provide peer-support outside of the mainstream psychiatric paradigm. Geeks, hackers, and activists are especially suspicious of authority, and habitually question systems of power.  They are justifiably mistrustful of psychiatry, but need a place to turn to for support. I don’t know the state of all of these projects, but they seem like a good place to pick up the conversation for how can we take better care of each other and provide kind of compassionate support we all need so horrible tragedies like Aaron’s, Ilya’s and countless others can be averted in the future.

Yelling it like it is

Adrianne Jeffries is a journalist on the tech beat who just published a pretty hot story in The Observer detailing how banks are mining social networking data to calculate credit scores. The article, As Banks Start Nosing Around Facebook and Twitter, the Wrong Friends Might Just Sink Your Credit, describes how startups like Credit Karma and Lenddo are convinced that deadbeats flock together, and are harvesting our data-exhaust and feeding it into FICO scores. Having friends who default on their loans may soon negatively impact your credit worthiness. Following standard journalistic convention, Jeffries contacted privacy experts for their take on the issue. She reached out to Eben Moglen, a Columbia Law professor, social justice advocate, and director of the Software Freedom Law Center. Although Moglen is a vocal defender of personal privacy and liberty, he refused to provide her with the ease-to digest soundbite she came looking for.  Instead, he takes Jeffreies to task for her hypocrisy, accuses her of contributing to the problem she claims she wants to fix, and for failing to fulfill her responsibilities as a professional journalist. Jeffries is stunned by this reaction, and published the complete transcript of her interview with Moglen, even though she did not use any quotes from him in her story. As I read the transcript of Moglen eviscerating professional journalism, I initially cringed in empathy for the journalist on the receiving end of Moglen’s brilliant tirade. Why would Moglen treat a journalist this way instead of giving her the harmless pull-quote she came looking for? The easy answer is that Moglen had a bad day, is a fool, or a jerk. However, in my experience, Moglen’s communications are usually purposeful and deliberate (although ’tender’ is not the first adjective I would associate with him :-) ). I think it is worth giving him the benefit of the doubt, and speculating on possible deliberate motivations for this response. Was Moglen trying out a new media strategy? Was this a calculated publicity stunt? A performative critique of journalistic conventions? How effective was it, for both Jefferie’s career and Moglen’s message? I think this incident deserves a close study, as it raises and reveals many important meta-questions about the shifting roles of journalism and activism, in addition to exposing the sad disarray of the nascent privacy movement. On the substantive issues covered in the story, Jeffries did a pretty good job researching the specifics and the underlying issues, and the piece is smart, witty, and provocative – with decent odds of capturing the attention of a few passing of eyeballs. The story conforms to the standards of the genre, and she quotes CEOs, venture capitalists, and a activist/public intellectual, Doug Rushkoff. The trouble is that over the years there have been countless stories detailing the pressing dangers of corporate surveillance, and the public does not seem to care (many have been covered on this blog, including a story about medication compliance factoring into FICO scores). After decades of trying to educate and advocate journalists and the public about these issues, I can easily imagine Moglen losing patience for the ineffectual conventions of mainstream journalism. U.S. journalists continue to water down their responsibility for truth-telling, speaking truth to power, and taking responsibility for being agents of change. The stilted genre of fair-and-balanced soundbites is even more absurd in the digital age when stories can be supported by providing long-form context and elaboration. Instead of pandering to the decontextualized soundbite, Moglen responded in a manner that demands all-or-nothing coverage. Similar to Emily Bell’s analysis of #occupywallstreet’s success, where the protester’s refusal to conform to soundbites and slogans helped them gain mainstream media cycles, Moglen’s response to Jeffries rejected the soundbite and resulted in her publication of their complete interview. For all we know Moglen has responded this way to other journalists, and this is just the first time the interview has been published. But, I think that activists should consider this response and weigh its relative benefits. Would the privacy movement have gained more any more credibility if Moglen had produced an easily digestible soundbite?  Perhaps, although privacy has proven itself to be such a complex issue that another round of he-said/she-said warnings/reassurances are unlikely to truly educate or persuade. I think the real challenge posed my Moglen’s response speaks to journalism’s failure to embrace the possibilities of hypertext, and grow beyond the conventions that dead-tree publishing imposed.  Why don’t stories regularly include links to the expert  interviews, in their entirety? Or, if the interview is sloppy or inaccurate, links to the experts relevant work. Moglen has spoken on numerous occasions warning about the dangers of corporate surveillance, an Jeffries easily could have quoted Molgen in her article, and referred readers to talks like Freedom in the Cloud or Navigating the Age of Democratized Media. Her interviews with him should have started with these talks as a baseline, not require him to rehash privacy 101 for the umpteenth time. The comments to the interview are also rich with perspectives on the responsibilities of journalists, though not many commentators engage in the critique of journalism that Moglen advances.  Jeffries herself often engages, defending her response on the grounds that “The reporter’s responsibility is to report the truth. I’m not an activist or an advocate”, and branding Moglen a “digital vegan”. The polar extremes portrayed in this exchange indicate just how desperately the privacy movement needs to develop more nuanced models of strategic agency, as “going off the grid”, or giving up and “promiscuously broadcasting” are the only choices most people think are available to them. My research on the The End of Forgetting outlines alternatives that expand our range of choices and might help advance the terms of this debate beyond - unplugging vs. sticking our heads in the sand.

The People's Drones

In May ‘06 I visited New York’s annual Fleet Week and personally met a few drones who were sleeping below the flight deck of a U.S. warship. In the 5 years since, “unmanned aerial vehicles” have reproduced explosively, and are rapidly changing the parameters of war and American foreign policy. Glenn Greenwald describes the “Drone Mentality” that renders victims invisible and enables risk-free aggression and violence. Public anti-drone outcries are spreading, though media coverage of the effects of U.S. drone attacks is glaringly absent. My friend Madiha Tahir has been reporting and researching these attacks in Pakistan and the accounts she has gathered are quite horrifying. But the U.S military isn’t the only outfit with access to these technologies. Rupert Murdoch’s News Corp (!) is using a drone to capture footage (and who knows what else), and Polish protesters in Warsaw used a drone to capture footage of riot police attacking them. Last year some hobbyists buzzed the Statue of Liberty with an unmanned aerial vehicle, and didn’t even get fined. Drone technology is advancing very rapidly, though to the average observer the technology might not look that much different from 70’s-era remote control planes. Most of the advancements are happening in software, which is invisible to the casual observer, and also more difficult to prevent from proliferating. If you haven’t seen any of the amazing footage of quadcopters in action, take a peek. These machines are much simpler to pilot and steer than a helicopter, and are quite inexpensive. There are quad-rotor open-source hardware/software projects, like the aeroquad (complete kits $1.5k), and the high-end is quite affordable (< $10k) for news companies and local police departments. At the moment, the regulations around flying these drones is ambiguous. But the FAA is currently reviewing regulations, and a government agency predicts there will be over 15,000 civilian drones operating in U.S. airspace by 2018. Drones are already in use patrolling the US/Mexican border, and the Department of Homeland Security is helping local law enforcement agencies obtain them. When I saw the video of the Polish protesters (via @MutualArising), I began wondering why local news companies were still flying manned traffic and news copters, and then I ran across the story (via @jonathanstray) about Murdoch’s drones. From my limited research, I believe that non-commercial hobbyists are allowed to fly these vehicles below 400ft. I propose that Occupy Wall Street should fly drones at every protest, to counter Mayor Bloomberg’s egregious attempts to suppress journalistic coverage of the protests. It seems clear that a robotic arms-race is underway, and my friend Peter Asaro, a robo-ethicist who serves on the international committee for robot arms control (icrac), worries about an arms race where everyone from drug cartels to the paparazzi all begin abusing drones. I remember Eben Moglen predicting that it won’t be long before every self-respecting dictator has full regiment of killer robots. Unlike human police, robots aren’t likely to hesitate when ordered to fire upon civilians. The right to bear robots? I am not convinced that drone-control is the best response to the asymmetrical power drones deliver (at least when it comes to surveillance drones, not armed drones).  I think they best way to counterbalance this power is with  open-source drones.  The people’s drones. Update: As per @MutualArising’s comment below,  OccupyDrones has taken off!

Pick a world... any world...

abandon_despairLast week I attended the second half of the US Social Forum - not exactly a conference, but more of a convergence or a process, where 20,000 people gathered in Detroit to build coalitions, alliances, and movements. The World Social Forum began as a response to the World Economic Forum - Why should the power elite be the only ones planning humanity’s future?!? The USSF web site and the People’s Media Center (made possible by some righteous radical techies, the Design Action Collective, riseup.net, and May First/People Link) should give you a flavor of what the event was all about. But, be aware that the streaming video and social media barely scratches the surface of the experience. The forum is organized around 2-hour long workshops, and over 100, 4-hour long People’s Movement Assembly’s.  The sessions were in depth and quite intensive. The format is designed to encourage small group interactions and for people to connect and get to know each other. The assemblies were geared around crafting resolutions and actions - I attended parts of the transformative justice and healing PMA, and it was really well facilitated. During the closing ceremony the assemblies synthesized their resolutions, scheduled actions, and asked for commitments of solidarity around their issues.  I don’t think that this forum represents the Left’s answer to the Tea Party, but I did gain a much better appreciation for the scope of issues comprising The Agenda(s). And, considering that anyone passionate about an issue was welcome to participate, the assemblies offered an authentic glimpse into everyone’s priorities. It felt like a determined effort to take things into account, and put them in order. Here are some of the resolutions that emerged from the Progressive Techie Congress Principles and the Transformative Justice and Healing assembly. Collective Liberation and Radical Mental Health The main draw for me to the conference were the Icarus Project workshops and the convergence of Icaristas, in person. We took over and transformed a house in a Detroit suburb, and mad dreaming and plotting ensued. The place was quickly transformed into a safe space for people to brilliantly  navigate the madness of the forums, and it was quite amazing to spend quality time, face to face, with friends and allies. I gravitated to the heath tracks, taking up issue of self-care, mutual aid, and wellness.  I also caught some great music, ate some amazing homemade food (and not bombs), visited some incredible collective living spaces, and was pretty inspired by everyone who cared and showed up. This Icarus workshop I attended (there was another that I missed, plus a screening of Crooked Beauty) was eagerly anticipated and well attended - the participants were open and receptive to the core messages, and there was a palpable desire to embrace these issues locally. The session leaders shared their personal stories and modeled peer-support as we broke into groups (photos, highlight reel to be posted shortly). People shared details of their individual and organizational neuro-diversity and how dysfunctional feedback loops undermine many organizing efforts. The relationship between personal and collective liberation emerged from the workshop and will travel far beyond Detroit’s (shrinking) city limits. Detroit is pretty beat up - we stayed two blocks away from a refinery that belched flames into the night sky - but there are some wonderful people and projects that were really cool to experience. It’s also the only city I have ever been to that has a monument to organized labor. If I can’t dance, I don’t want to be part of your revolution - Emma Goldman, Radical Feminist

Freedom of the (hyperlocal) Press?

Viral PoliceHeh.  I enjoy a nice long weekend off, and a few of my worlds collided while I was away… This weekend msnbc.com snatched up the Knight Foundation funded everyblock.com project, and now a bunch of people I know - from  journalism, free software, law, and software development are all talking about the ethics and implications of choosing different Free/Open Source licenses for grant funded projects and experiments in sustainable journalism ;-) The Knight Foundation has been funding innovation in technology and journalism for a few years, and lately has been mandating open licenses for all the code and content they sponsor.  Knight is not alone. Mellon, Hewlitt, OSI, NSF, NIH, and other grantmakers have all begun to encourage that the IP they fund be as open as possible (to varying degrees).  Seems obvious.  If you want to maximize your philanthropic ROI, make sure that the future can extract the full potential of the work you fund - not be shackled, stifled, or duped by the misapplication of intellectual property. I continue to be hopeful that pressure from funders might represent a tipping point for openness.  Many organizations need bunches of carrots to overcome their knee-jerk institutional momentum to horde - even if sharing costs them nothing (in dollars, labor, or resources, although sometimes transparency can take its toll on egos). But is all openness created equal? No way am I going to attempt to recreate the great BSD-GPL wars in this post, but I will say that it stings every time I hear someone accuse the GPL of being viral (are vaccines viral?).  I also wince every time I see a vibrant open source community make an argument against the GPL - I have seen this happen around Sakai, OpenCast, and even lately around around Plone and its plugins. [From my perspective, its the purportedly unencumbered communities that are really viral, as they continue to ratchet down GPL communities to lowest common denominator licenses, by whining about how they can’t use GPL code (which they can, provided they share-alike).  But don’t take my word for it - ask Zed why he (A/L)GPLs.] To me, first and foremost, the GPL signals trust. As I understand it, this legal instrument has helped enable institutions and individuals, large and small, to trust each other, without fear of being stabbed in the back or being taken for a sucker. In the end, the GPL is just a license, and while it has been increasingly taken more seriously, enforcement is never fun (except for lawyers, I guess). Eben Moglen is the founder of the The Software Freedom Law Center and also the author of GPL, but their firm can’t officially shill for the GPL. They care enough about freedom to continue to help any open software communities in need, but I sometimes wonder how they manage to bite their tongues and not scream We told you so or We warned you. Some of these same communities who have scorned the GPL have had to turn to the SFLC to bail them out when they got attacked by patent sharks. Perhaps the Everyblock story will serve as a cautionary tale, and people will learn to start taking the SFLC’s legal advice seriously. I believe that history will show that it was the GPL that ultimately averted Microsoft’s monopoly - no license could have accomplished this without the boundless energy and will of the open source developers, but the GPL was the pentagram restraining a very bad actor. But not everyone sees the world this way, and there are other valid perspectives.  In conversations I have had with Jacob Kaplan-Moss (who co-founded Django, alongside Everyblock’s Adrian Holovaty) Jacob voiced a strong conviction that transparency, openness, and sharing are better ways to develop software, and that those values ought/need not be legally mandated. He prefers to participate in a community where those values are understood and shared.  Some might call his perspective slightly naive (while others might trace some of these attitudes to the roots of Django and the proprietary journalistic corporation that birthed it), but James Vasile makes a very similar point:

Prophetic Fulfillment

It is virtually uncontested that the McCain campaign has attempted to divisively identify Obama as the Anti-Christ through a systematic campaign of allusions and coded associations. This innuendo was largely missed by people who don’t believe in the literal reading of Revelations, but the sophisticated tactics make it unlikely the multitude of associations were coincidental. “The One” advertisement alludes to the cover art and even the title fonts of the popular “Left Behind” series, and there are numerous biblical associations as well. But, what confuses me is that by the logic of fundamentalist Christianity, if Obama really were “The One”, wouldn’t they be obliged to vote for him to fulfil prophesy and usher in the rapture? Isn’t this the logic behind the Christian right’s support for Israel? Kinda reminds me of seating Jesus on a white donkey, but really, whatever it takes to bring about a change we can all believe in…

Tigers and Teachers

Last week I went back to ‘ol Nassau and attended the annual New Media Consortium conference, held this year at my alma mater. The conference was very engaging, especially since I don’t think I have ever attended an event geared specifically towards the kind of work we do at CCNMTL. Typically, whether its developer, librarian, technorati, activist, or academically oriented, our work shares aspects with other attendees, but usually not a similar overarching mission. I was reminded how special our organization’s niche is - we should take pride in our projects and values. I also gained a better understanding of how privileged our situation is. While no two university’s I have ever encountered share the same organizational structure, many now support groups whose primary mission is helping the faculty use new media & technology purposefully. I was astounded at the constraints, and corresponding resourcefulness, these groups exhibit. Most of them have a much smaller staff than ours, and very few actually develop custom software. A Wordpress or Mediawiki plugin is about as complicated as many of them can attempt. And yet, they forge ahead, scraping together whatever tools they can wrap their minds around - and in the era of mashups, the possibilities are growing daily. It is interesting to contrast this resourcefulness with corporate, and even non-profit, technical efforts I have been involved with. Many of these groups have gourmet taste in technology, and initiatives are often paralyzed until the right tools are developed. The educators show how far a healthy culture of use can go in trumping system constraints. Overall, many groups are still working with the faculty to get beyond the allure of the media, and demand a greater educational return than “mere” excitement and motivation. Critical engagement must go beyond supplemental materials, as it is decidely difficult to follow through on the promise of a demonstrated educational value. There were many projects that clearly helped the students feel good about their learning, but it is incredibly hard to design a curriculum where these new media objects become a central component in a student’s analysis. In our work we try, and occasionally succeed, to help push the faculty to design assignments where the new media elements are an integral part of the critical analysis - where the learners deeply engage with the media, and bring these elements into play as evidence in support of an argument. These aspirations place the bar quite high, and often require faculty to develop an radically new teaching style. Additionally, none of us learned this way, though we all seem to be convinced these new styles are superior to the ways we were taught. Consequently, there is a great deal of experimentation and research involved in educational technology. It was really great having these kinds of conversations all weekend long - sharing and exchanging perspectives with the others grappling with similar concerns. Some of the highlights I learned about included:

No more pencils...

Well, summer vacation is finally upon me - now I only need to work fulltime. My first year in my PhD program I found myself thinking alot about methods. Not all that surprising, given that one day I will have to defend my methods along with my ideas, but a pretty abstract space to be preoccupied with, nonetheless. This spring I wrote a paper about all the techniques that the Social Sciences really need to be borrowing from industry and the hard sciences: