Exclusive: Google App Engine ported to Amazon's EC2

One of the biggest criticisms of Google’s App Engine have been cries of lock-in, that the applications developed for the platform won’t be portable to any other service. This morning, Chris Anderson, the Portland-based cofounder of the Grabb.it MP3 blog service, just released AppDrop — an elegant hack proving that’s not true.

AppDrop is a container for applications developed with the Google App Engine SDK, running entirely on Amazon’s EC2 infrastructure. Just like Google’s Appspot, anyone can use a modified SDK to deploy their App Engine apps directly to Amazon EC2 instead of Google, and they work without modification.

This proof-of-concept was built in only four days and can be deployed in virtually any Linux/Unix hosting environment, showing that moving applications off Google’s servers isn’t as hard as everyone thought.

How does it work? Behind the scenes, AppDrop is simply a remote installation of the App Engine SDK, with the user authentication and identification modified to use a local silo instead of Google Accounts. As a result, any application that works with the App Engine SDK should work flawlessly on AppDrop. For example, here’s Anderson’s Fug This application running on Google App Engine and the identical code running on EC2 at AppDrop.

Of course, this simple portability comes at the cost of scalability. The App Engine SDK doesn’t use BigTable for its datastore, instead relying on a simple flat file on a single server. This means issues with performance and no scalabity to speak of, but for apps with limited resource needs, something as simple as AppDrop would work fine.

I spoke to Chris this morning about his project and where he wants it to go. “AppDrop is open-source just like the Google SDK, so I’m hoping someone will come along and take it to the next level,” he said. “It wouldn’t be hard for a competent hacker to add real database support. It wouldn’t be that hard to write a Python adapter to MySQL that would preserve the BigTable API. And while that wouldn’t be quite as scalable as BigTable, we’ve all seen that MySQL can take you pretty far. On top of that, you could add multiple application machines connecting to the central database, and load-balancing, and all that rigamarole.”

While this is only a hack, it demonstrates that App Engine developers don’t need to live in fear of Google’s reprisal. “The upshot is that if you put a lot of time into an App Engine app, and then run afoul of Google, you have alternatives, even if they are more work.”

Update: Chris announced the project on his own blog, with some design notes.

April 20, 2008: Addressing concerns with data lock-in, Google announced that large-scale data import and export for will be coming soon to App Engine.

20 Comments

Fanboy Supercuts, Obsessive Video Montages

This insane montage of (nearly) every instance of “What?” from the LOST series started me thinking about this genre of video meme, where some obsessive-compulsive superfan collects every phrase/action/cliche from an episode (or entire series) of their favorite show/film/game into a single massive video montage.

For lack of a better name, let’s call them supercuts. (Thanks, Ryan.)

Here are some examples I could find, but I’m sure there must be more. Post ’em in the comments and I’ll add them. Bonus points for supercuts with the most clips, the shortest clips, and in additional genres (sports? politics?).

UPDATE: This entire list (and many more) is now on Supercut.org. Add more there!

Film

Glengarry Glen Ross – Obscenity Count

Glengarry Glen Ross – “The Leads”

Ship, Computer, and Sauce in the first six Star Trek films

Shia LaBeouf in “No No No No”

Requiem for a Dream, montage of every drug montage (meta!)

Casino, every “fuck”

Big Lebowski, every “fuck”

Big Lebowski, Every “dude”

Big Lebowski, Every “man” (thx, Matt)

True Romance, every kill from the finale

True Romance, every “fuck”

Rushmore, handjob references (thx, Matt)

Scarface, every “fuck” (thx, oscar)

The Departed, every “fuck” (thx, oscar)

Jay and Silent Bob Strike Back, every “fuck” (thx, MeatFarley)

All the pauses and silence in His Girl Friday from 1940 (thx, progosk)

The Incredibles, buttons, doors, and explosions (thx, Joshua)

Fargo, every “yeah” (thx, Doobybrain)

Charles Bronson Death Wish Bodycount (thx, Dave)

Chris Hefner’s Talking Picture (The Road to Ruin), removes all words from a 1938 film (thx, Jamie)

Boondock Saints, every “fuck” (thx, Brandon)

Midnight Run, every “fuck” (thx, Lakawak)

Miscellaneous films, cops turning in their badge and gun (thx, Darrin)

Every “McFly” from the Back to the Future trilogy

Cell phone cliches in horror films

Mirror scares

Nearly every Hitchcock film cameo (thx, Oscar)

“We’ve Got Company” (thx, Buzzfeed)

“Get out of there!” (via Buzzfeed)

“It’s Gonna Blow!”

Every lightsaber ignition/retraction from the Star Wars series (thx, Buzzfeed)

Everything Chris Klein Says in “The Legend of Chun Li” (thx, Jeff)

“You look like shit.”

Every Arnold Schwarzenegger scream (thx, Buzzfeed)

Every Nicolas Cage freak-out

In 3D! (thx, Joe)

Every “Michael” in The Lost Boys

“Now if you’ll excuse me…”

“Blah blah blah.”

7 minutes of face slaps in film

“It’s Showtime!”

“Nooooooooo!” (thx, Scott)

Every Bone Steven Segal Has Broken

TV

Every “What?” from the LOST series

Legend of Zelda TV show, Excuse Me, Princess!

Knight Rider – Turbo Boosts

CSI: Miami, Caruso’s One-Liners

The Simpsons, every couch intro

The Sopranos, Every single whacking

Ojamajo Doremi, every transformation

Star Trek: The Next Generation, Last 10 seconds of every episode of season 1

Every Dragonball Z transformation

Mighty Morphin’ Power Rangers, every finishing move from Season 1

Deadwood, every curse in Episode 1, 2, and 3 (thx, Brian W)

LOST, Sawyer says “Son of a Bitch” (thx, Jordan)

Rozen Maiden, every “Desu” (527 times! More context, thx Jason)

Buffy the Vampire Slayer, every mention of “Buffy” from Season 1 (Chuck Jones)

Battlestar Galactica, every “frak” from season 1 (thx, Nowak)

Big Brother’s Julie Chen, every “but first” (thx, Cardhouse)

House M.D., every “lupus” reference (thx, engtech)

LOST, Sawyer’s nicknames in the first three seasons (thx, oscar)

Rachael Ray, “Mmm!”

MTV’s Newport Harbor, 82 “like”s in one episode (thx, Jamie)

Red Dwarf, every “smeg” reference in all 52 episodes (thx, arto)

LOST, Desmond saying “Brother” (thx, cypher)

The Wire, Clay Davis’ “Sheeeeeit” (thx, dunk3d)

24, Jack Bauer says “damn it” (thx, jonathan)

The Simpsons – Homer’s D’ohs, excerpt from an official episode (thx, Scott)

Scrubs – Every Girls Name to J.D. from Dr. Cox (thx, oscar)

Naruto – Every Rasengan from the filler story arcs (thx, Binkley)

The Hills, without the dialogue (thx, Rex)

Bea Arthur says “Whoa!” on the Golden Girls (thx, BWE)

The Office – “That’s What She Said” (thx, Jason)

“I’m not here to make friends” from every reality TV show (thx, Rich)

Dr. Who – “What are you doing here?” (thx, Duncan)

The Sopranos, every profanity

The Royle Family, every “My Arse!” (thx, Dunk)

Stargate SG-1’s Teal’c says “Indeed” (thx, Torley)

Kramer’s Entrances from Seinfeld (thx, Buzzfeed)

Every “Dude” from Hurley on LOST

Every Secret Ingredient from Iron Chef America (thx, Oscar)

Mad Men’s Don Draper says, “What?”

Every cigarette smoked on Mad Men

Every “Christmas” from the 90210 Christmas special

Star Trek, Spock says “Fascinating” (thx, Scott)

MST3K, The Many Names of David Ryder (thx, Nathaniel)

Games

Half-Life series, every G-Man sighting (and part 2)

Every Famicon (NES) Game Title Screen

Metal Gear Solid questions? (thx, William)

Miscellaneous Sources

Various films, Wilhelm Screams

Various films, The Slow Clap

Various films, NOOO!

Steve Jobs says “Boom!” in Mac keynotes (thx, Jeff)

Clip from Christian Marclay’s “Telephones” from 1995 (thx, progosk)

iPhone “Hello” ad, heavily inspired by “Telephones” (thx, progosk)

Phil Collins’ “In the Air Tonight,” every “Oh Lord” (thx, oscar)

2008 State of the Union, without any speech

Bill Gates says “Uh…” in Rocketboom interview

Collage of “Zoom In and Enhance” scenes

“Hey, Guys!”, collection of YouTube beauty guru intros

Collection of “Myspace salutes” (more context)

“I Could Tell You, But Then I’d Have to Kill You”

“We’re not in Kansas anymore.”

Club Drunk Party Hands, every use of those four words in the Billboard Top 10 for 2010

All the pauses in Sarah Palin’s response to the 2011 Arizona shootings

Obama says “spending”

Audio

Only the inhaling from an hour of NPR’s All Things Considered (Chuck Jones)

Loveline, every question asked by the hosts (Chuck Jones)

Loveline, every name mentioned in alphabetical order (Chuck Jones)

Loveline, every “Yes” and “No” (Chuck Jones)

Loveline, every number (Chuck Jones)

Loveline, interjections (Chuck Jones)

Loveline, dead air (Chuck Jones)

NWA’s Straight Outta Compton, obscenities only (thx, oscar)

Honorable Mention

A commenter points to the work of Chicago artist Chuck Jones, who’s created a number of excellent audio and video supercuts he calls Isolation Studies. I’ve listed them all above.

The “Most Obsessive” award goes to artists Jennifer & Kevin McCoy for their work Every Shot, Every Episode from 2001, a 277 DVD set compiling 10,000 clips from Starsky & Hutch, arranged by categories like “Every Dead Body,” “Every Mirror,” “Every Gunshot,” and “Every Affirmative Response.” Other work of theirs includes I Number the Stars, a shot-by-shot index of the first 20 Star Trek episodes in 120 categories, How I Learned, a 10,000 shot inventory of the show Kung Fu in over 100 categories, and Every Anvil, cataloguing the violence in 100 Looney Tunes cartoons. Mind-blowing. (Thx, Buzzfeed!)

June 15, 2011:

The earliest supercut appears to be Joseph Cornell’s “Rose Hobart”, a short film from 1936. It compiles nearly every scene featuring the obscure actress in the 1931 B-movie, East of Borneo.

Want more? Michael Bell-Smith and I launched a site dedicated to the supercut genre at Supercut.org.

112 Comments

Waxy.org Redesigns

For the first time since I started blogging in 2002, I’ve redesigned Waxy.org. Over the last six years, I’ve grown pretty sick of the old design but never found the time to rework it. Mostly, the changes are cosmetic. Cleaner design, new logo, bigger type, headlines, better iPhone support, and more space devoted to Waxy Links.

I’ve also taken the opportunity to change my URL structure, removing some cruft and giving some additional length to the slugs. All old URLs should redirect, thanks to some mod_rewrite magic and a little PHP.

One change that might affect you is that you’ll now be seeing all of my longer articles in the Waxy Links feed, so you might want to unsubscribe from the main feed to avoid getting duplicates. Since I generally only post once a day, and I try to only write things I’d want to link to, this seems like a good alternative to linking to my own posts. If you really don’t like this change, please let me know privately and I’ll work something out.

What do you think? Nothing’s permanent, so I’m all ears.

Update: You’re probably seeing some weirdness in the RSS feed. Links appearing in the articles RSS feed, tons of old entries, and links pointing directly to Waxy.org instead of the sites I was linking to. All of these problems are fixed! But feedreaders take time to update, so it’ll be resolved as soon as your RSS reader of choice sees the updated feed. Sorry!

61 Comments