Waxy.org
Waxy.org is the sandbox of Andy Baio, an independent journalist and programmer living in Portland, Oregon. I created Upcoming.org and some other stuff too.

Contact Me: log@waxy.org or waxpancake on AIM

Googling the Onion

Posted May 14, 2002

A Google search for "onion" doesn't return The Onion homepage anywhere in the results. A little more digging reveals that the Onion homepage isn't in the Google index at all. Any idea why? Maybe Aaron knows.

4 Comments (Add Yours)

May 14, 2002
10:35 AM  
reb wrote:

they've got an anti-robot meta tag in their source. :)

<META NAME="robots" content="noindex,follow">


May 14, 2002
10:40 AM  
Andy Baio wrote:

Well, that answers that. I looked for a robots.txt file, but didn't think to look at the META tags. Thanks!

But it begs the question, why would The Onion want to exclude all search engine referers from their site?


May 14, 2002
10:44 AM  
reb wrote:

that -is- a good question. and thanks for fixing my meta tag. :-) you'd think, if anything, they'd want to generate more traffic. maybe it has something to do with the caching that google does? though it's not specific to the googlebot.


Jun 3, 2002
12:18 AM  
Merlin wrote:

Google shows 13K links in and Blogdex shows them as the #11 all-time entry; maybe they feel like they don't want to risk giving the milk away for free if so many folks are already advertising their particular cow for them.

I understand they start writing every article with the headline and work backward, so maybe they want to ensure they register your impression before you even get the punchline, y'know? If there were a way to read their stuff without suffering the increasingly invasive ads, I know I would do it. ;-)


 

Leave a comment





Waxy Links
Ads via The Deck
January 6, 2009
The Perils of Zero-Gravity Videography — Matt Harding discovers hard drive-based camcorder don't work in zero-gravity (via)
Screenshot: 4chan hacks MacRumorsLive during Apple keynote — the 4chan thread shows how they found the admin interface, password hashes, and finally cracked a user's password
January 5, 2009
xkcd's Guide to Converting to Metric — even Liberia and Myanmar are mostly metric, compared to the U.S.
Crowdsourcing an Ethical Dilemma — Dolores Labs uses Mechanical Turk to answer the Trolley Problem
January 3, 2009
Stamen's Mike Migurski on extreme programming vs. interaction design — the linked interview is great
January 2, 2009
Jason Scott on the closure of AOL's online communities — like physical evictions, there need to be laws protecting community data in the event of closure
JPG Magazine to stop publishing, turn off website — with only three days notice; here's the response from Derek and the JPG community
December 31, 2008
Wikipedia over DNS — loony hack serves summaries of Wikipedia articles; also available as JSON and JS
Leap year bug caused every 30GB Zune to crash at 2am this morning — as strange as the Android bug that ran every keystroke as root
Metafilter's exhaustive tour of the early origins of Adult Swim — the Cartoon Network breathed new life into old cartoons, while constantly trying to find the next big thing
December 30, 2008
Infochimps' massive scrape of Twitter's friend network — Twitter gave their blessing on sharing the 56-million records, which includes 10M tweets and 220k hashtags
The Lonely Island's We Like Sportz — the sequel to Just 2 Guyz
Niall Kennedy documents the undocumented Google Reader API — whoops, this was three years ago; here's an updated version
Sakurako Shimizu's Waveform Jewelry — the "I Do" wedding band and Atari chip ring are cute, too
Fimoculous' 30 Most Notable Blogs of 2008 — an incredibly well-researched list, with related recommendations for every entry
December 29, 2008
DJ Earworm's United State of Pop 2008 — mashing up the top 25 singles of the year into a single song and video
Twit 4 Dead, four Twitter bots fight zombies in real-time — watch their collected activity here
Facebook sentiment mining predicts presidential polls — like StateStats, Facebook Lexicon is tons of fun
Giganews reports Usenet upload growth since 2001 — note this doesn't reflect Usenet popularity, but most likely the rise of huge Blu-Ray and HD rips
December 28, 2008
List of Starbucks employee jargon — culled from the Starbucks Gossip blog
December 27, 2008
Rocketboom covers the history of the Lip Dub — the Know Your Meme series is consistently well-researched and fun to watch
Jennifer 8. Lee on the history of General Tso's Chicken — different cultures each localized their own versions of Chinese food around the world (via)
Top 20 freeware games released by Cactus, this year — is Jonatan the most prolific game developer alive?
December 26, 2008
Paul and Storm finish their 25 Days of Randy Newman — hosted on Bandcamp, and now with the solo piano track used in each song
AutoPager, infinite scrolling for Firefox — love the idea, but too clunky for everyday use (via)
December 24, 2008
Net Cafe archives, dot-com nostalgia TV show from 1996-2002 — Sergei Brin in 2000 at the newly-opened Metreon, Mondo 2000 and Boing Boing, awkward Webby broadcasts, and hundreds of dead dot-coms (via)
The Offworld's best indie and overlooked games of 2008 — also: Gamasutra's top 5 indie games
Left 4k Dead — lo-fi zombie shooter in 4k of Java (via)
NORAD's Santa Tracker on Twitter — they just passed through Kazakhstan; also tracking on Google Maps and in 3D on Google Earth
December 22, 2008
ScummVM adds support for 7th Guest — I didn't realize they expanded into non-Scumm engines last year, including the Sierra AGI games

Andy Baio lives here. Some rights reserved, for your pleasure.