Google+ Search API Weirdness

I’m doing some testing with the Google+ Search API, and it seems like it’s completely broken. Can anyone else confirm?

Try searching for something popular using the Google+ API, ordered by recent. Here’s a test for ‘iphone’. For me, the most recent result was 25 minutes ago. (Your results may vary, depending on time.)

Now, do the same search on Google+ itself, and click the “Most recent” link to only show recent posts.

At first, Google+ shows the same sparse results of relatively outdated posts… Then, slowly, it populates with newer posts from the last couple minutes.

Unfortunately, I can’t figure out a way for the Google+ API to show those newer posts. Any help? Any Googlers out there able to help out?

Introducing XOXO

On Tuesday morning, Andy McMillan and I launched XOXO, an epic festival and conference about disruptive creativity — bringing together artists and makers bypassing traditional middlemen to do what they love for a living, with the technologists building the platforms to make it possible.

If you haven’t already seen it, take a look at the video we made, which pretty much explains everything:

We’d confirmed most of the entire lineup by Monday, including the founders and CEOs of Etsy, Kickstarter, Metafilter, 4chan, Canvas, Simple, VHX.tv and The Atavist, and the creators of World of Goo, MakerBot, Indie Game: The Movie, Star Wars Uncut, Diesel Sweeties and Black Apple. And Julia Nunes! (This is as close to WaxyCon as you’re ever going to get.)

Andy and I debated back and forth about whether the project was ready to announce, and both of us were nervous. It’s a unique project for Kickstarter, and we didn’t know if we’d provided enough detail to convince people that we’re working on something really exciting. We’d run all the numbers, and to do everything we wanted without cutting corners or selling out, the tickets would cost around $400. Was that price too high? What if only business and marketing types sign up? Is the festival too long, too short, too far to travel?

So many doubts, so many fears. We were betting it all — pre-selling every single ticket with a $125,000 goal. And we were serious: if it came up short, we’d walk away. Months of planning would be wasted, but at least we wouldn’t have lost our shirts.

Until the last minute, we were debating whether to push it yet another week out to polish things up. Finally, we bit the bullet, cleaned up some final issues, and launched at 11:20am on Tuesday.

The reaction was explosive and immediate. In fact, I’d fully intended to write about the launch on Tuesday morning, but within 30 seconds of posting the Kickstarter project, my inbox exploded. I knew that Kickstarter’s new social features were powerful, but this was intense. Before I’d even tweeted it myself, 20 people backed the project.

Less than two days later, it’s passed $110k raised with over 60% of the tickets sold. (Update: It sold out completely in 50 hours!)

The list of speakers we’ve put together is great, but the list of attendees is amazing. We could easily do five more conferences just from the current attendee list. Some of the smartest and most creative people in the world are coming to XOXO, and almost every time I search a name I don’t recognize, I’m impressed. Putting all these people in one room is going to be something special.

As far as I know, XOXO is also the biggest event ever funded on Kickstarter. When I first started working with Kickstarter in 2008, the idea of funding events came up regularly. Kickstarter was originally inspired by a concert that Perry wanted to throw in New Orleans back in 2001, but didn’t want to deal with the up-front risk. I’ve always thought it was a perfect use for the site, but up until this point, barely anybody’s tried to fund their entire ticket sales on it. I think this really validates Kickstarter as a tool for funding events.

There are a million things to do and we’re just getting started. But, for now, I’m just grateful that everyone got it. We’re at the very start of a Cambrian explosion of creativity, made possible by technology. Everything is awesome.

Tonight, I watched Neil Gaiman’s commencement speech to this year’s graduating class of the University of the Arts. All of it’s worth watching, but this part of the speech (at the 17:20 mark) resonated with me.

We’re in a transitional world right now, if you’re in any kind of artistic field, because the nature of distribution is changing, the models by which creators got their work out into the world, and got to keep a roof over their heads and buy sandwiches while they did that, are all changing. I’ve talked to people at the top of the food chain in publishing, in bookselling, in all those areas, and nobody knows what the landscape will look like two years from now, let alone a decade away. The distribution channels that people had built over the last century or so are in flux for print, for visual artists, for musicians, for creative people of all kinds.

Which is, on the one hand, intimidating, and on the other, immensely liberating. The rules, the assumptions, the now-we’re supposed to’s of how you get your work seen, and what you do then, are breaking down. The gatekeepers are leaving their gates. You can be as creative as you need to be to get your work seen. YouTube and the web (and whatever comes after YouTube and the web) can give you more people watching than television ever did. The old rules are crumbling and nobody knows what the new rules are.

So make up your own rules.

I couldn’t have said it better.

So, go check out the project, watch the video, and check out the speaker lineup. If you want to, back it. And I hope to see you in September!

The Final ROFLCon and Mobile's Impact on Internet Culture

A little late on this, but wow, ROFLCon III was amazing. I was there to moderate a morning keynote panel on the supercut meme with Rich Juzwiak, Duncan Robson and Aaron Valdez, three of my favorite supercut creators. It was a privilege to share the stage with these guys, who are all amazing at what they do. It ended with a debut of Duncan’s Three Point Landing, which the audience adored. Here’s the whole thing.

Every talk I saw was amazing. All the sessions are making their way onto YouTube, and are all worth checking out. I posted some of my personal highlights on Twitter, but if you missed them, here are my favorites:

Jonathan Zittrain’s introductory keynote was thoughtful and inspiring. Jason Scott’s solo talk on the Mysterious Mr. Hokum is a crazy story of a pre-Internet scammer. Flourish Klink’s panel on fangirl culture was eye-opening, a glimpse into a massive subculture of the web I know far too little about.

The most entertaining, hands down, was Craig Allen’s behind-the-scenes story of the Old Spice campaign, with a surprise Skype cameo by Isiaiah Mustafa.

The most underseen and misunderstood session was Wonder-Tonic’s pitch for Localoffrly.biz, a douchebag startup turned into comedy performance art. (Bonus points for actually launching a site.) Hard to believe, but some people in the audience weren’t sure whether it was a joke, and started to get frustrated when they stopped the gamified talk between each “level.” Brave.

And, of course, Chris Poole’s solo talk, which ended up inspiring my Wired column that was published last Wednesday. I reprinted it below, hope you enjoy it.

Early this month, the Internet invaded the MIT campus for ROFLCon III, the biennial two-day conference that brings together the subjects of net memes with those who study and adore them.

Among the meme celebrities — Tron Guy, Paul “Double Rainbow” Vasquez, Antoine Dodson, Scumbag Steve and Chuck Testa all attended — were those who are deeply invested in the future of Internet culture, both emotionally and financially. Founders of community sites like Reddit and 4chan, academics studying memes, and the cottage industry that’s capitalized on them, most notably the Cheezburger Network’s Ben Huh. And, of course, the whole audience participated in their propogation.

From the moment I boarded the plane to Boston there was an undercurrent of change running through the conference. I sat next to Whitney Phillips, a University of Oregon doctoral student speaking on a panel about her research on troll culture. She’d attended every ROFLCon since 2008, and realized that she’d have to revise her thesis in the next month — the meme landscape is in a transitional period, but it’s not clear what it’s transitioning into. She echoed something I heard repeatedly over the weekend: “It just feels different.”

It felt apropos that this was the last ROFLCon, with the organizers “putting this trilogy to bed and riding out into the sunset.” Or, at least, until “we can figure out how to continue doing it great justice.”

The Internet is still spawning memes at an accelerated rate — and they’ll never go away. But there are some major shifts under way that may fundamentally change the way they’re created.

Every meme, like folklore, shares two common characteristics: It must show reproduction (the ability to be copied) and variation (the ability to mutate).

These days, memes spread faster and wider than ever, with social networks acting as the fuel for mass distribution. But it’s possible we may see less mutation and remixing in the near future. As Internet usage shifts from desktops and laptops to mobile devices and tablets, the ability to mutate memes in a meaningful way becomes harder.

From the Interest Web to the Social Web

Over the last few years, we’ve seen a fundamental shift away from discussion forums and other niche communities to social networks and aggregators. In a 20-minute talk at ROFLCon, 4chan and Canvas founder Chris Poole characterized this as a shift from the interest-based web to the friend-based web.

Poole is concerned that the web is losing its emotional depth, a richness that comes from lurking, failing and learning before finding your place in a community. The difficulty gave it more meaning, and the resulting communities added far more value to the web than they extracted.

Now, aggregators like 9GAG and Cheezburger are ridiculously popular, but memes rarely originate there. Unsourced images are posted and watermarked by their new hosts, muddling their origins and diluting the context of the original image. As Poole said, “It’s hard to feel emotionally invested in 9GAG.”

To me, this is part of the natural expansion of online community. Reddit users hate 9GAG for stealing their memes, but 9GAG is popular because it’s easier to use, making it more inclusive to Facebook users than Reddit’s sprawling subgenres and somewhat esoteric community norms. It’s the same reason that, for years, 4chan users hated Reddit for stealing their memes and bringing them to a community that was much easier to understand.

Unlike social networks, each successive community doesn’t seem to cannibalize its predecessor, but instead simply finds a larger, newer audience. The original community stays largely the same, which feels like stagnation relative to the “next big thing.” With each new site, the mainstream base and shared knowledge we call “Internet culture” converges into a mixed cultural heritage.

But there’s one potential risk that affects the cultural production of memes.

Meme Mutation

Ever tried using 4chan on a iPhone? It’s completely impossible to upload images from an iPhone or iPad, immediately limiting your contribution to the community to commenting alone. Sites like Reddit let you post a URL, but modifying and uploading images to a public URL from a mobile device is, for the moment, not easy.

Also for the moment, it’s extremely rare for mobile apps to allow community remix and sharing. In fact, I could only find two iOS apps that supported posting your own remixes to a public community space: Mixel and Make Pixel Art. (If you know more, leave them in the comments.) All others only support sharing to your contacts or your own social network, but not the public, unmediated space that memes thrive in.

It’s not surprising, then, that the only memes that seem to originate on smartphones are text-based — autocorrect fail, iPhone whale, and texts from last night.

It feels like we’re on the verge of a breakthrough to unleash the creative potential of these devices, but mobile developers are limiting our options to mild tweaking, at best. Instagram’s filters made the simplest cosmetic changes, and you weren’t able to modify anybody else’s work. Draw Something let you draw, but only with a single person and no shared history. Where’s the Canvas, Polyvore, deviantArt, and YTMND of the app world?

In the absence of good remix apps, image macro generators like Meme Generator and Quick Meme have filled the gap, making it possible to instantly generate a new meme from a mobile browser in seconds. No tools, or time investment, required.

This is incredibly empowering, but also limiting. Your imagination, and the scope of the meme’s breadth, is limited to the capabilities of the meme generator.

It’s reasonable to think the shift from desktops and laptops to mobile and tablets will continue, especially for the new generations of young Internet users that typically generate memes. If the app ecosystem doesn’t grow to accommodate it, we may see remix participation drop, largely substituted by the lightweight interaction of likes, favs and comments and lightweight prebuilt memes from generators.

In his talk on Saturday, Poole said, “Memes are the instruments with which we play music. The way things are going, we’re going to lose our song.”

Memes may not go away, but I’m worried we may lose the concert venues where the music is performed — the quirky, difficult communities that foster creative expression and make it meaningful.

Criminal Creativity: Untangling Cover Song Licensing on YouTube

We all break laws. Every day, millions of people jaywalk, download music, and drive above the speed limit. Some laws are obscure, others are inconvenient, and others are just fun to break.

There are millions of cover songs on YouTube, with around 12,000 new covers uploaded in the last 24 hours. Nearly 40,000 people covered “Rolling in the Deep,” 11,000 took on “Pumped Up Kicks,” 6,000 were inspired by “Somebody That I Used to Know.”

Until recently, all but a sliver were illegal, considered infringement under current copyright law. Nearly all were non-commercial, created out of love by fans of the source material, with no negative impact on the market value of the original.

This is creativity criminalized, quite possibly the most popular creative act that’s against the law.

I don’t think it’s an act of civil disobedience; nobody’s making a statement. Most people don’t know that cover songs need a synchronization license, and even if they did, trying to get one is a confusing and expensive proposition. Unlike the mechanical licenses used to release a cover song on an album, video sync licenses don’t have an affordable flat rate and require the publisher’s explicit permission.

Even as YouTube forges agreements with publishers to handle the synchronization rights for cover songs, it’s nearly impossible for musicians to tell whether their songs are covered or not.

This week, I set out to answer a seemingly simple question: when are YouTube cover songs legal, and how can we do this better?

Conflicting Information

Even trying to determine if a cover song is legal can be confusing for most musicians. There’s no shortage of answers online, but most of them are conflicting. Publishers, musicians, and lawyers all give different answers, none of which are totally accurate. Even YouTube’s own FAQs are incomplete, made inaccurate by recent settlement agreements.

Like any area of copyright law, there’s no shortage of armchair lawyering on blogs and discussion forums about cover songs. A common belief is that cover songs fall under the “fair use” provisions of the Copyright Act, but the question of whether a non-parody cover song could fall under fair use is untested in the courts. Despite this, over 60,000 cover songs on YouTube cite “fair use” in their title or description. (Whether uploaders actually believe that or are preemptively using it as a defense is anyone’s guess.)

Content ID detects one of Adrian Holovaty’s cover song

While they happily encourage fans to upload covers, YouTube makes it clear that users must have the rights to all content they upload. “We tell users they must own the copyright or have the necessary rights for any content they upload,” said a YouTube representative. “It’s ultimately their responsibility to know whether they possess the rights for a particular piece of content.”

Their only specific guidance for cover songs is in their Copyright FAQ, which says, “Recording a cover version of your favorite song does not necessarily give you the right to upload that recording without permission from the owner of the underlying music.”

But this answer isn’t fully accurate. YouTube’s negotiated blanket synchronization licenses for its users from thousands of publishers, most notably the settlement with the National Music Publishers Association last August. This agreement allowed publishers to opt-in to a program that let them take a cut from a $4 million advance pool and up to 50 percent of the advertising revenue from any cover song they own the rights to.

Frustratingly, we have no idea which publishers have signed on. The NMPA doesn’t publish the list, making it impossible to figure out whether your song is covered by the agreement or not. (I contacted the NMPA, but a spokesperson confirmed that information appeared to be unavailable, but was looking into it.)

Begging for Forgiveness

In reality, the only way to tell whether a song is legal is to risk breaking the law and losing your YouTube account — by uploading the video and waiting for copyright notices.

In the last few months, YouTube has quietly expanded Content ID beyond original recordings to detect cover versions and live performances using the underlying melodies. A YouTube representative confirmed with me, “Content ID’s technology allows us to identify works in an original sound recording, or in a cover version (by identifying the underlying melody of a song), using information provided to us by the publishers.”

YouTube hasn’t talked much about its melody matching technology, but it was in the news recently after a drunk Edmonton man belted “Bohemian Rhapsody” in the back of a police car. After the Content ID identified the song, EMI initially decided to take the video down, but soon changed its mind and authorized it with advertising.

Adrian shared a screenshot of his copyright disputes page.

Everyblock founder Adrian Holovaty is well known on YouTube for his acoustic guitar covers, which have amassed millions of views. I asked him if Content ID identified the melodies in any of his videos. So far, seven of his videos were identified, with all but one rights holder choosing to leave the video online and collect the revenue. Only one video his cover of the Village People’s “YMCA,” was taken down by the songwriter, leaving Adrian with a “copyright strike” on his account. YouTube’s policy allows three strikes before the account is terminated and all videos removed.

The Flaws in the System

The system’s not perfect, though. Unscrupulous individuals are routinely using Content ID to claim content they don’t own to harvest ad dollars from unsuspecting users. For example, two of Adrian Holovaty’s disputed tracks are Django Reinhardt songs from the 1930s, claimed by an obscure company named “Social Media Holdings.”

Other copyright claims may be accidental, as material they don’t actually own finds its way into the Content ID database, like this poor guy who’s received eight consecutive claims from companies claiming to own George Romero’s public domain Night of the Living Dead.

And Content ID isn’t immune to false positives, like the bird calls misidentified as music. Worse, for all these case, disputed Content ID claims bypass the DMCA process for counter-claims entirely, as I wrote about in February.

How can a musician decide what’s legitimate or worth fighting?

Still, YouTube’s Content ID is pushing publishers and rights holders into the modern age. It’s an ingenious approach for an otherwise dysfunctional copyright system that’s too hard for amateurs to navigate, making money for everyone involved while still allowing free creative expression.

The Need for Change

But there’s something strange about this begging-for-forgiveness approach to copyright. It’s like driving without traffic signs, only finding out you broke the law when you’re pulled over.

The real question: Why is it illegal in the first place?

Cover songs on YouTube are, almost universally, non-commercial in nature. They’re created by fans, mostly amateur musicians, with no negative impact on the market value of the original work. (If anything, it increases demand by acting as a free promotional vehicle for the track.)

The best solution is the hardest one: To reform copyright law to legalize the distribution of free, non-commercial cover songs.

Copyright law was intended to foster creativity by making it safe for creators to exclusively capitalize on their work for a limited period of time. Cover songs on YouTube don’t threaten that ability, and may actually prevent new works by chilling talent that could go on to do great things.

As we’ve seen with countless breakout artists from YouTube, budding musicians have built their careers from cover songs that evolved into original material. Karmin, Pomplamoose, Julia Nunes, Greyson Chance…. Even Justin Bieber started with covers of Chris Brown and Nee-Yo before getting discovered.

Now, the next generation of budding pop stars are covering Justin Bieber, with about 216,000 of them so far. It’s all part of the virtuous cycle of culture: We take from it, build on it, and then give back in return. The law should help that along, not hinder it.

Update: I originally published this column over at Wired on May 2. The woman I spoke to at the NMPA confirmed the list of publishers appeared to be unavailable, but promised to look into it. I haven’t heard back, so I followed up again. I’ll update here if I hear anything.)

In a Rigged Game, Twitter's IPA Lets Developers Rewrite the Rules

Last month, in response to Yahoo’s wrongheaded patent infringement lawsuit against Facebook, I wrote about my experience filing patents at Yahoo. Patents I helped to file, ostensibly only for defensive purposes, were turned into blunt weapons to thwart innovation and extort money.

As I said, “I thought I was giving them a shield, but turns out I gave them a missile with my name permanently engraved on it.”

This week, Twitter announced their Innovator’s Patent Agreement, an open source contract intended to guarantee patents will only be used defensively, even when sold. The IPA seems to directly address the issues raised in my article.

Adam Messinger, Twitter VP of Engineering, wrote that, “With the IPA, employees can be assured that their patents will be used only as a shield rather than as a weapon.”

Every one of Twitter’s existing patent filings, including Loren Brichter’s famous pull-to-refresh patent, will fall under this agreement later this year.

Still, the IPA isn’t perfect, and it needs work to protect the intentions of designers and engineers. Instapaper founder Marco Arment pointed out that the contract’s definition of “defensive” is overly broad, allowing an unethical company to initiate a lawsuit for a range of reasons without requiring the inventor’s permission.

Hypothetically, if Yahoo had adopted the IPA, would it have prevented them from later suing Facebook for patent infringement? Maybe not. Facebook’s threatened several startups over trademark name issues in the past, including Lamebook, Placebook, and Teachbook. If any of them were also users, customers or affiliates of Yahoo, then Yahoo could bypass the Patent Agreement and file a patent lawsuit. (Though, if they did, the inventors could choose to sublicense their patents directly to Facebook.)

These problems are correctable though, and Twitter should be commended for taking this important first step. In a deeply broken patent system, it’s heartening to see an established company proactively try to work around its flaws. I hope agreements like these find wide industry adoption.

But this isn’t a real fix. Union Square’s Fred Wilson dubbed it Twitter’s “Patent Hack,” and that’s exactly what it is — it’s duct tape to patch a broken system, but it doesn’t solve any of the underlying problems.

The ideal would be patent reform, or if the system’s beyond reform, the abolition of business method patents entirely.

Marco Arment wrote, “A truly innovative stance would be for a large technology company to avoid filing patents, and to lobby aggressively for progressive patent reform to make that a practical choice for every technology company.”

Like I did last month, Marco vowed not to file any patents. “I fundamentally disagree that software patents (and many other types of patents) are a net gain for society, and I can’t participate in that system in good conscience.”

After all, if you only use them defensively, why do you need patents at all? Publish your work and establish prior art.

Sadly, prior art only works in an ideal world. As we’ve seen, the U.S. patent office routinely grants patents even when prior art exists. The recently passed reforms to the patent system, switching from a first-to-invent to a first-to-file system, make this more likely than ever.

For the moment, avoiding patents entirely isn’t a realistic legal strategy for large companies. Maintaining a patent arsenal won’t ward off shell company-style patent trolls, but it can protect you from competitors by allowing cross-licensing settlements. But all of that feeds into the “cold war” mentality of stockpiling patents you never hope to use.

Until we have real reform or abolition, ethical tech companies are forced to play the patent game, but at least engineers and designers now have a way to rewrite the rules in their favor.

Memeorandum Colors 2012: Visualizing Bias on Political Blogs

I don’t watch sports, but every four years, I lose myself in the horse race of the U.S. presidential elections. That competition kicked off in earnest Monday, as Gallup started its daily tracking polls for the general election between Barack Obama and Mitt Romney.

In 2008, I was hooked on one drug for my daily fix: Memeorandum, a completely automated aggregator that surfaces popular stories from political news sites, often within minutes.

As you’d expect, the universe of political blogs is largely split in two, with conservative and liberal blogs rarely covering the same stories or linking to the same sites. But it can be very challenging to tell their political leanings at a glance, especially with names like “Balloon Juice,” “Weasel Zippers,” or “The Volokh Conspiracy.”

So, four years ago, I launched a project with Delicious/Tasty Labs founder Joshua Schachter to visualize the linking biases of various political blogs on Memeorandum by looking at their past behavior.

Using singular value decomposition, the linear algebra at the heart of your Netflix recommendations, we reduced the entire matrix of blogger-to-article relationships to a single dimension. Imagine a single line grouping like-minded blogs together based on the diversity of the stories they cover, with hardcore left- and right-leaning blogs on opposite sides of the spectrum.

Using those precalculated values, we load the data from Google Spreadsheets and color the links on Memeorandum, based on where they fall on the spectrum. The brighter the color, the more frequently they only cover stories by their counterparts.

This simple visualization leads to some interesting insights. Compare these two articles, which were trending on Memeorandum at this writing:

Seeing each site’s potential bias provides the context for understanding how news is spread. Right-leaning blogs are eager to point out new evidence that George Zimmerman was hurt the day he shot Trayvon Martin, but left-leaning blogs aren’t covering that story. Likewise, only left-leaning news sites appear to be covering the news of Ted Nugent’s threatening remarks to the president, but conservative blogs aren’t. This visualization also makes it easy to spot outliers, the sources that are breaking away from their past behavior to link to something beyond their usual circle.

This browser add-on is free and open source on Github. We’ve updated the data sources for the first time since 2008, and Memeorandum Colors now works natively in Chrome, in addition to Firefox.

You can try the browser add-on by following these simple directions.

Google Chrome

  1. Click the memeorandum_colors.user.js link.
  2. In the warning dialog at the bottom of Chrome window, select “Continue.”
  3. Visit Memeorandum and wait a moment for the links to color.

Firefox

  1. Install Greasemonkey.
  2. Restart Firefox.
  3. Click the memeorandum_colors.user.js link, wait three seconds, and Install.
  4. Visit Memeorandum and wait a moment for the links to color.

Four Years of Data

Along with this release, we now have four years of historical activity to work with. The collected scores are on Google Fusion Tables, and I’ve included a dump of the activity in Github.

Looking at historical activity can reveal some interesting trends, especially in how attitudes have shifted since the last election.

For example, Little Green Footballs is a long-running political weblog started by Charles Johnson, a web developer who aligned himself with the conservative right wing after the World Trade Center attacks. In late 2009, he publicly parted ways with the right.

That shift away from conservatism was reflected in his linking behavior at least a year before his public statement. If you look at the timeline below, you can see that Johnson started linking to a wider variety of stories outside the conservative conversation, until his activity was mostly neutral in early 2010. Now, his activity tends neutral but slightly favors articles popular in the liberal blogosphere.

Bias In Linking, Not Beliefs

Memeorandum was created by San Francisco developer Gabe Rivera, who followed its introduction with aggregators for media, celebrity gossip, and baseball news. The most popular of these is Techmeme, a daily destination for tech industry watchers.

A month after Obama’s election, Rivera announced he’d hired a human editor for Techmeme to help prevent inaccurate results from the algorithm. This editorial oversight would affect any link-based analysis on Techmeme, but he confirmed that Memeorandum is still completely machine-driven.

This automated analysis is not a commentary on the personal opinions and beliefs of any blogger — no amount of linear algebra can prove that. What this shows is the biases in their linking behavior: the stories that each site chooses to cover, or not cover, and their similarity to others like them.

If you’d like to learn more about the math behind how this works, there’s more detail and links to tutorials on my original blog entry.

Let me know if you have any questions and I’ll try to answer them in the comments.

Waxy.org Turns 10

Ten years ago, I started this site with three simple rules: no journaling, no tired memes, and be original. 18 months later, I added a little linkblog.

In those ten years, I’ve posted 415 entries, including this one, and over 13,000 links.

The decision to start writing here regularly changed my entire life. It’s given me exposure, a place to share my projects and crazy experimentation with technology. It’s created new opportunities for me, directly or indirectly responsible for every major project I’ve gotten involved in. It’s a place to play and experiment with ideas, some of which led to big breakthroughs and passions. And it connected me to people who cared about the things I did, many of whom became lifelong friends.

Personal homepages and weblogs have long since faded from the popular trends. They’re no longer hip and nobody’s launching the hot new startup to reinvent them or make them better.

Most of the interest in writing online’s shifted to microblogging, but not everything belongs in 140 characters and it’s all so impermanent. Twitter’s great, but it’s not a replacement for a permanent home that belongs to you.

And since there are fewer and fewer individuals doing long-form writing these days, relative to the growing potential audience, it’s getting easier to get attention than ever if you actually have something original to say.

Carving out a space for yourself online, somewhere where you can express yourself and share your work, is still one of the best possible investments you can make with your time. It’s why, after ten years, my first response to anyone just getting started online is to start, and maintain, a blog.

And now, just for the hell of it, some of my favorite posts from the last ten years. 🙂

2002

Tracking the All Your Base Meme with Usenet. The first chart appears only two weeks in, setting a precedent for the next ten years.

Dar Kabatoff’s In Town. My first deep-dive into Internet kookiness, an amazing example of Usenet lunacy that eventually led to my first stalker. To this day, people still link to this on various forums that Kabatoff appears in.

Spamming Weblog Comments. Where I casually predicted the rise of blog spam and Bayesian filters designed to stop it.

Steve Martin Fans. Another exploration into a sad, weird corner of the Internet, a prolific stalker turned suicidal in a Steve Martin fan forum.

October 2002 Dictionary Domains. I used to periodically run a script, check for the available of dictionary word .com, .org and .net domains, and post the results. Note the last one in the list, which I later snatched up for myself.

2003

Eldred, Shared Culture Loses. My first mashup landed me in the New York Times and Boston Globe, my first real press coverage ever. Soon after, a Disney exec bought a print of the comic from me, with the sale facilitated by Larry Lessig himself!

NYT and Lost Friends. Two weeks later, I was in the NYT again for my Lost Friends page. This was very new to me.

Google Buys Blogger. I was sitting front and center at the Blogosphere panel in Los Angeles when Ev announced Google bought Blogger, and was one of the first to report the news.

Bias Affects Story Updates on Political Weblogs. My first controversial tech exposé, manually analyzing sites to understand linking behavior. Most of these sites found my article from their referers, leading to some very upset bloggers. People don’t like to be accused of bias.

Typo Popularity Tracking with Google. I feel like I started to hit a stride with posts like these, doing some simple analysis to find entertaining results.

Star Wars Kid. The post that launched a meme, melting my server and the servers of most of my friends. I later tracked him down, interviewing him with Jish’s help and doing a fundraiser to buy him a newly-introduced iPod. Later, I reported on the lawsuits. Years later, I wrote a final summary of the whole thing, along with the logs for that period.

Santa Monica Farmer’s Market Tragedy. My personal reporting from a freak car accident that killed nine people outside my office led to coverage in the BBC. Horrifying.

Upcoming.org Launch! The side project that changed my life.

2004

Researching the 2004 Oscar Screeners. Inspired by a delusional film industry, I sat down and tried to figure out exactly how often Oscar screeners leak online. Eight years later, I’m still doing it every year.

Waxy v2.0. Announcing our pregnancy and, a few months later, the birth of our son.

Danger Mouse’s The Grey Album. I was the first person to put the Grey Album on the web, leading to the first takedown request from EMI, which spawned the Grey Tuesday protests.

InfocomBot for AOL Instant Messenger. One of my favorite hacks ever, it let you play classic and modern text adventures over AIM.

Nanniebots: Hoax, Fraud, or Delusion? I helped Ben Goldacre and Cameron Marlow debunk a ridiculous hoax, someone who claimed he developed chatbots to lure pedophiles in chatrooms.

Waxy’s Bandwidth Blowout #1: Heat Vision and Jack. In the years before YouTube, serving video was a massive pain in the ass. If you were lucky enough to have a dedicated server, excess bandwidth was a handy commodity. I always loved hosting commercially-unavailable materials.

Amazon Knee-Jerk Contrarian Game. This post, tracking horrible Amazon reviews of critically-loved media, still makes me laugh.

Kleptones, “Night at the Hip-Hopera”. Still my favorite mashup album ever, I originally hosted a copy and crowdsourced the sample list for the Kleptones. It netted me my second cease-and-desist, this time from Disney/Hollywood Records.

Afro-Ninja Found! I managed to track down the identity of a stuntman having a very bad day.

Amateur Tsunami Video Footage. Another pre-YouTube phenomenon, the demand for this tragic disaster footage was so high, it melted my server and even took down Archive.org for a time. The videos I uploaded to Archive.org dominated their most downloaded lists for years.

2005

Boing Boing Statistics. I built a simple visualization tool for Boing Boing’s five-year archive, following my own Waxy.org Stats and Metafilter growth charts.

WordPress Website’s Search Engine Spam. The biggest story I’d ever broken, at that point, covering search engine spam hidden on WordPress.com. For me, this was a switch from casual blogging to serious journalism, including quotes from Matt Mullenweg before publishing. More in the followup.

Automating Wikipedia History. I started a contest to make a Greasemonkey script to visually browse Wikipedia history, and got some amazing entries, including one by future-jQuery creator John Resig.

Yahoo and Upcoming, Sitting In A Tree. One of the craziest things that ever happened to me, the optimism in this post is almost blinding.

House of Cosbys, Mirrored. After the brilliant Cosby-inspired animated series was shut down, I mirrored all of the videos and got a takedown order from Bill Cosby’s lawyer. I publicly defied it, compiled a list of Cosby parodies in the media, and did an interview about it with the New York Times. I never heard from team Cosby again.

2006

Metafilter Sources 2006. Tracking how the top 50 link sources on Metafilter changed between 2004 and 2006.

Sex Baiting Prank on Craigslist Affects Hundreds. I broke the story of Jason Fortuny’s “Craigslist Experiment” after seeing a link to it in a private discussion forum. This ended up being a huge story, involving Craigslist, lawsuits, and ruined lives.

2007

Outgoing. Waxy.org went into cryogenic sleep while I was working at Yahoo and raising my baby boy, so I decided to take some time off to write again and explore new ideas.

2008

Colin’s Bear Animation. Four years later, this video still makes me laugh. I tracked down Colin and interviewed him about it.

Personal Ads of the Digerati. I dug up vintage personal ads from Dave Winer and Richard Stallman, and I interviewed RMS about his unusual methods of accessing the web.

The Times (UK) Spamming Social Media Sites. I exposed some nefarious SEO practices from a mainstream newspaper, and interviewed founders of online communities to see what they thought.

Highlights from the British MovieTone Darkweb. Some wonderful vintage videos from a service that doesn’t want you to find them. I’m amazed these videos still work.

ForumWarz Postmortem: Interviewing the Game’s Creators. This innovative game never got popular, but I was very proud of this interview.

WIRED and The WELL. I have a complete archive of The WELL, and occasionally dig into it for research. For anyone who cares about Wired history, it’s a treasure trove.

Internet Power, Volume 1: Flashback to the VHS-Era Web. I set up a VCR and started ripping vintage VHS tapes about the Internet. This was the first of a series of VHS rips, including Internet Power Vol. 2, Olympia School District, and Computability.

Fanboy Supercuts, Obsessive Video Montages. The blog post that named the “supercut” genre, I continued adding to it for years before starting Supercut.org.

Milliways: Infocom’s Unreleased Sequel to Hitchhiker’s Guide to the Galaxy. This post caused me more pain and heartache than anything I’ve ever written. On its release, I was extremely proud of it, reconstructing the never-before-told history of an unreleased Infocom game using digital archives. But I didn’t ask permission before quoting private emails, causing major fallout on the source that provided me with the archives, ending our friendship forever. You have no idea how often I wish I could unpublish this post.

The Whitburn Project: 120 Years of Music Chart History. I’ve always loved this story about a group of record collectors on Usenet, illegally swapping Billboard chart spreadsheets. In my followup post, I used the data to analyze music history.

The Machine That Changed the World: Great Brains. An awesome, out-of-print documentary series on computer history that I ripped from VHS, and created annotated show notes for each of the five episodes.

Girl Turk: Mechanical Turk Meets Girl Talk’s “Feed the Animals”. The first of my Mechanical Turk experiments, crowdsourcing metadata about the album to make neat charts.

Cheap, Easy Audio Transcription with Mechanical Turk. People still cite this post regularly as the guide for DIY crowdsourced transcription.

Kickstarter. The first of many posts about Kickstarter, when I first met the team and joined the board. “Ultimately, everybody should be able to support themselves doing what they love using the web.”

Memeorandum Colors: Visualizing Political Bias with Greasemonkey. I worked with Joshua Schachter on this Greasemonkey script analyzing linking behavior on Memeorandum. I still use this every day.

The Faces of Mechanical Turk. I wanted to know what they looked like, and was willing to pay them to find out. This image seems to show up in every conference presentation about Mechanical Turk.

2009

Robin Hood’s “Oo De Lally,” Translated Into 16 Languages. This makes me happy.

Translating “The Economist” Behind China’s Great Firewall. One of the strangest online communities I’ve ever discovered, a group of Chinese fans of The Economist translating the entire thing cover-to-cover as a learning tool. I ended up writing a shorter version of this piece for the New York Times.

Attribution and Affiliation on All Things Digital. This investigation into AllThingsD’s linking practices led to concrete change. They never use long quotes anymore, clearly attribute, and drive traffic to the blogs they link to. Everyone wins.

Category Inflation at the Webbys. In the three years since, the number of categories continues to explode. Planning on writing a followup soon.

Kind of Bloop: An 8-Bit Tribute to Miles Davis. My first Kickstarter project was a big success, hitting its goal in four hours, and went on sale later that year.

Meme Scenery. One of my all-time favorite posts, I removed the subjects of famous memes from their backgrounds. There’s something weirdly serene about these background locations without context.

Code Rush in the Creative Commons. In 2008, I’d posted an annotated copy of the classic Mozilla documentary and interviewed the director after he requested I take it offline. A year later, he decided to release it under a Creative Commons license, allowing me to put my annotated version back online.

2010

Interviewing Ted Rall on Comics Journalism in Afghanistan. I interviewed several project creators for the Kickstarter podcast, including this one with author and cartoonist Ted Rall, Pixeljam and James Kochalka, and R.U. Sirius.

Wikileaks Cablegate Reactions Roundup. Sometimes, there’s value in just curating the best set of links around a topic. Every time I’ve ever done this, people seem to like it. I need to remember that more often.

Joining Expert Labs At the end of 2010, I took a leap and joined Expert Labs to work on tools to help government agencies better listen to citizens using social media.

2011

Metagames: Games About Games. Quite possibly the most entertaining research I’ve ever done. It took me forever, largely because I ended up playing so many clever games.

The Daily: Indexed. I got a lot of press for creating a public index of The Daily’s iPad app, against their will. After my trial was up, I wrote about how I did it.

Making Supercut.org. The product of one very, very long night, I worked with artist Michael Bell-Smith to make a script that generated randomized video clips composed entirely of spliced-together supercuts.

Playable Archaeology: An Interview with Telehack’s Anonymous Creator. I was so floored by this tour de force of computing history, I interviewed the brilliant, but anonymous, genius behind it.

Kind of Screwed. The long, frustrating tale of the contested Kind of Bloop artwork, which cost me a large out-of-court settlement and a bunch of legal bills. Makes a good story, though!

Apple’s 1987 Knowledge Navigator, Only One Month Late. As I was watching the Knowledge Navigator video, I started piecing together dates to figure out when it was supposed to take place. I was blown away by the coincidence.

Google Kills Its Other Plus, and How to Bring It Back. My first column for Wired ended up being a big one. Lots of other power users were justifiably upset, and it directly led to the “Verbatim” feature being added to Google Search.

Supercut: Anatomy of a Meme. I dug into the supercut meme using Mechanical Turk and my database of clips. This doubled as the launch announcement for Supercut.org, a community-contributed index of videos.

Google Analytics A Threat to Potential Bloggers. Exposing one of my techniques for researching anonymous sites, I was surprised how many people didn’t know about this.

Viewing the UC Davis Pepper Spraying from Multiple Angles. Sometimes, the simplest ideas are the most powerful. The video’s been viewed on YouTube over 150k times.

No Copyright Intended. Remix culture is the new Prohibition.

I’ll wrap it up there. With luck, I’ll see you in ten more years. Thanks for reading.

Instagram's Buyout: How Does It Measure Up?

Instagram’s billion-dollar sale to Facebook raised eyebrows yesterday, renewing cries of a new bubble. But relative to other major acquisitions of the past, how does it measure up?

I crunched the numbers, pulling together data from a selection of 30 notable internet acquisitions over the last ten years, from Broadcast.com to OMGPop, to see if the Facebook/Instagram acquisition was as crazy as everyone thinks. (I left out companies without public purchase prices or user stats.)

The spreadsheet below captures the acquisition date, dollar amounts, and ballpark counts of the users and employees at the time of acquisition. Be warned: any of these numbers are very rough, cobbled together from Internet Archive searches, old news articles, Quora answers, and tech blogs. If you have more accurate information, please leave a comment and I’ll fix it.

Download the spreadsheet or view it on Google Docs.

Cost Per User

When a startup’s acquired, they’re purchased for any combination of the technology, talent, or the user base.

If we look strictly at the acquisition cost per user, Facebook got a relative deal with the Instagram purchase, paying roughly $37 for each of Instagram’s 27 million users. (The median cost across all the acquisitions is about $92 per user.)

Compare that to acquisitions like Aardvark ($555/user) or Jaiku ($240/user), and you can systematically see which were likely technology or talent hires. The glaring exception is Yahoo’s famous purchase of Mark Cuban’s Broadcast.com in 1999, which paid nearly $10,000 for each of their 520,000 monthly active users, ten times any other startup. (Broadcast.com skewed the chart so much, I had to leave it off.)

Cost Per Employee

But if you look at the payout per employee, Instagram is completely off the charts. If split equally, each of Instagram’s 13 employees would make nearly $77 million. The nearest runner-up is YouTube, with a paltry $24M for its 2006-era staff of 67. Skype, Broadcast.com, and Myspace all top the charts. The median? About $3 million.

Some would point to this as a sign of a bubble, but I think it’s more likely it just reflects the incredible scalability of modern app architectures. Using cloud services, failover, and solid monitoring, Instagram can quickly scale up to support a million new users overnight with very little additional engineering effort.

The User-to-Employee Ratio

Instagram’s numbers are exactly what you’d want to see in a social network — high user counts with the lowest number of employees. This ratio is a measure of your efficiency, and it’s no surprise that Instagram comes out on top here, with a ratio of one employee for every 2.07 million users.

The second highest user-to-employee ratio is OMGPOP, famous for developing Draw Something, the fastest-growing mobile app in history. With only one employee for every 875,000 users, they were able to scale to 50 million users within 50 days.

On the other end of the scale are the short-lived Q&A service Aardvark, with one employee for every 1,800 users, and customer-service giant Zappos with one employee for every 3,400 users.

More than anything, the app ecosystem rewards efficiency; your ability to massively scale with very little engineering effort. I’m guessing these ridiculously lean startups with huge exits aren’t a freak occurrence. We’ll see more of them as the rest of the world catches up, and learns how to do more with less.

Methodology

All figures are at the time of acquisition, and I favored active user counts over total registered users for calculating acquisition cost per year.

Thanks to Tristan Louis for providing some of the rumored numbers.

Update

I originally published this yesterday on Wired, under a different headline and revised lede from my editor. To be clear, I don’t know if we’re in a bubble or not. My only point is that, relative to other acquisitions, the per-user cost for Instagram isn’t insane. Union Square Ventures’ Albert Wenger added some additional thoughts, noting that the per-user costs should be discounted as the userbase grows.

Many Wired commenters complained I was wrong because Instagram has no revenue. In 2006, YouTube had 34M users, zero revenue, and were bleeding $1M/month for bandwidth alone. Was Google crazy to buy them, too?

Anyway, it was a good excuse to collect all of this data in a spreadsheet for the first time. I went looking, and couldn’t find the numbers available in one place anywhere. Hope you liked it.