Skip to content
Waxy.org
About
Mastodon
Contact

Lost Media: Finding Bill Clinton’s “Boxers or Briefs” MTV Moment

Posted January 23, 2023January 23, 2023 by Andy Baio

Yesterday, I saw a tweet that seemed so obviously wrong, it made me wonder if it was just clickbait.

During a 1992 MTV event, Bill Clinton was famously asked if he wore "boxers or briefs". It was a touchstone moment in American politics.

But I can't find any actual video of it. It's been completely scrubbed from existence. Which is crazy to me, in this age.

— Adam Spragg (@AdamSpragg) January 22, 2023

But after digging through Google, YouTube, Vimeo, DailyMotion, C-SPAN, and the Twitter archives myself, it seemed to be true: an iconic moment of ’90s political pop culture appeared to be completely missing from the internet.

Boxers or Briefs

If you were alive in the early ’90s, there’s a good chance you remember this moment.

During MTV’s “Choose or Lose” campaign coverage in the early ’90s, Bill Clinton promised to return to MTV if elected by the channel’s young voters. As promised, a little over a year into his first term, he appeared on MTV’s Enough is Enough on April 19, 1994, a town hall-style forum with 200 16- to 20-year-olds focused on violence in America, and particularly the 1994 crime bill being debated at the time.

Toward the end of the 90 minute broadcast, during a series of rapid-fire audience questions, 17-year-old Tisha Thompson asked a question that seemed to surprise and embarrass Clinton:

Q. Mr. President, the world’s dying to know, is it boxers or briefs? [Laughter] [Applause]

Clinton: Usually briefs. [Laughter] I can’t believe she did that.

That question got a ridiculously outsized amount of attention at the time. The Washington Post called him the “Commander In Briefs.” It was covered in the New York Times, Baltimore Sun, and countless others. It was the subject of late-night talk show monologues, and Clinton himself joked about it at the White House Correspondent’s Dinner later that week.

Over the following years, the “boxers or briefs” question became the “Free Bird” of the campaign trail, posed to Newt Gingrich (“that is a very stupid question, and it’s stupid for you to ask that question”), Bernie Sanders (“briefs”), and then-candidate Barack Obama: “I don’t answer those humiliating questions. But whichever one it is, I look good in ’em!”

Nearly 30 years later, the original clip is shockingly hard to find online. Someone on Reddit linked to a version of the video on YouTube, but the account was terminated. C-SPAN has a different clip from the show, as well as a searchable transcript, but not the clip itself.

As of right now, before I publish this post, it’s extremely hard to find online — but not impossible, because I found it, and here it is.

How I Found It

Among its voluminous archives of web pages, books, and other media, the Internet Archive stores a huge number of U.S. TV news videos, clips from over 2,470,000 shows since 2009. You can search the closed captions, and view short video clips from the results.

Their search engine is a little quirky, but more than good enough to find several news talk shows who rebroadcast the clip over the last few years, typically to poke fun at Bill Clinton. I searched for the exact quoted phrases from the original interview, and found 14 clips that mentioned it from shows like Hardball with Chris Matthews, Tucker Carlson Tonight, and The Situation Room with Wolf Blitzer.

Only one of the clips included the full question and answer, and didn’t overlay any graphics on the video, from an episode of Up w/Steve Kornicki on March 15, 2014.

The Internet Archive will let you stream the short clips, but there’s no option to download the video itself, and unfortunately, it frequently won’t show the exactly the moment you’re searching for. (This is probably an issue with alignment of closed captions and source videos.)

That said, you can edit the timestamp in the video URL. Every video result page has a URL with something like “/start/2190/end/2250” in the URL. This is the start and end timestamp in seconds, which you can adjust manually. (There appears to be a three-minute limit to clip length, so if you get an error, make sure you’re not requesting longer than that.)

Once you’ve found what you like, you can download it using Chrome Dev Tools:

  1. First, start and then pause the video.
  2. In Chrome, use Option-Command-C to open the element inspector in Chrome Dev Tools.
  3. Highlight and click on the paused video.
  4. In the Chrome Dev Tools window, right-click on the <video> tag and choose Open In New Tab.
  5. The video will now be in a dedicated tab. Hit Ctrl-S (Command-S on Mac) to save the video, or select “Save Page As…” from the File menu.

After that, I just cropped the clip and uploaded it to my site, and YouTube for good measure. If you have a better quality version, please send it to me.

That’s it! The Internet Archive is an amazing and under-utilized resource, poorly indexed in Google, but absolutely filled with incredible things.

Screenshot of Up w/Steve Kornicki broadcast from March 15, 2014
5 Comments

Invasive Diffusion: How one unwilling illustrator found herself turned into an AI model

Posted November 1, 2022November 5, 2022 by Andy Baio

Last weekend, Hollie Mengert woke up to an email pointing her to a Reddit thread, the first of several messages from friends and fans, informing the Los Angeles-based illustrator and character designer that she was now an AI model.

The day before, a Redditor named MysteryInc152 posted on the Stable Diffusion subreddit, “2D illustration Styles are scarce on Stable Diffusion, so I created a DreamBooth model inspired by Hollie Mengert’s work.”

Using 32 of her illustrations, MysteryInc152 fine-tuned Stable Diffusion to recreate Hollie Mengert’s style. He then released the checkpoint under an open license for anyone to use. The model uses her name as the identifier for prompts: “illustration of a princess in the forest, holliemengert artstyle,” for example.

Artwork by Hollie Mengert (left) vs. images generated with Stable Diffusion DreamBooth in her style (right)

The post sparked a debate in the comments about the ethics of fine-tuning an AI on the work of a specific living artist, even as new fine-tuned models are posted daily. The most-upvoted comment asked, “Whether it’s legal or not, how do you think this artist feels now that thousands of people can now copy her style of works almost exactly?”

Great question! How did Hollie Mengert feel about her art being used in this way, and what did MysteryInc152 think about the explosive reaction to it? I spoke to both of them to find out — but first, I wanted to understand more about how DreamBooth is changing generative image AI.


Since its release in late August, I’ve written about the explosive creativity and complex ethical and legal debates unleashed by the open-source release of Stable Diffusion, explored the billions of images it was trained on, and talked about the data laundering that shields corporations like Stability AI from accountability.

By now, we’ve all heard stories of artists who have unwillingly found their work used to train generative AI models, the frustration of being turned into a popular prompt for people to mimic you, or how Stable Diffusion was being used to generate pornographic images of celebrities.

But since its release, Stable Diffusion could really only depict the artists, celebrities, and other notable people who were popular enough to be well-represented in the model training data. Simply put, a diffusion model can’t generate images with subjects and styles that it hasn’t seen very much.


When Stable Diffusion was first released, I tried to generate images of myself, but even though there are a bunch of photos of me online, there weren’t enough for the model to understand what I looked like.

Real photos of me (left) vs. Stable Diffusion output for the prompt “portrait of andy baio” (right)

That’s true of even some famous actors and characters: while it can make a spot-on Mickey Mouse or Charlize Theron, it really struggles with Garfield and Danny DeVito. It knows that Garfield’s an orange cartoon cat and Danny DeVito’s general features and body shape, but not well enough to recognizably render either of them.

On August 26, Google AI announced DreamBooth, a technique for introducing new subjects to a pretrained text-to-image diffusion model, training it with as little 3-5 images of a person, object, or style.

Today, along with my collaborators at @GoogleAI, we announce DreamBooth! It allows a user to generate a subject of choice (pet, object, etc.) in myriad contexts and with text-guided semantic variations! The options are endless. (Thread 👇)
webpage: https://t.co/EDpIyalqiK
1/N pic.twitter.com/FhHFAMtLwS

— Nataniel Ruiz (@natanielruizg) August 26, 2022

Google’s researchers didn’t release any code, citing the potential “societal impact” risk that “malicious parties might try to use such images to mislead viewers.”

Nonetheless, 11 days later, an AWS AI engineer released the first public implementation of DreamBooth using Stable Diffusion, open-source and available to everyone. Since then, there have been several dramatic optimizations in speed, usability, and memory requirements, making it extremely accessible to fine-tune it on multiple subjects quickly and easily.


Yesterday, I used a simple YouTube tutorial and a popular Google Colab notebook to fine-tune Stable Diffusion on 30 cropped 512×512 photos of me. The entire process, start to finish, took about 20 minutes and cost me about $0.40. (You can do it for free but it takes 2-3 times as long, so I paid for a faster Colab Pro GPU.)

The result felt like I opened a door to the multiverse, like remaking that scene from Everything Everywhere All at Once, but with me instead of Michelle Yeoh.

Sample generations of me as a viking, anime, stained glass, vaporwave, Pixar character, Dali/Magritte painting, Greek statue, muppet, and Captain America

Frankly, it was shocking how little effort it took, how cheap it was, and how immediately fun the results were to play with. Unsurprisingly, a bunch of startups have popped up to make it even easier to DreamBooth yourself, including Astria, Avatar AI, and ProfilePicture.ai.

But, of course, there’s nothing stopping you from using DreamBooth on someone, or something, else.


I talked to Hollie Mengert about her experience last week. “My initial reaction was that it felt invasive that my name was on this tool, I didn’t know anything about it and wasn’t asked about it,” she said. “If I had been asked if they could do this, I wouldn’t have said yes.”

She couldn’t have granted permission to use all the images, even if she wanted to. “I noticed a lot of images that were fed to the AI were things that I did for clients like Disney and Penguin Random House. They paid me to make those images for them and they now own those images. I never post those images without their permission, and nobody else should be able to use them without their permission either. So even if he had asked me and said, can I use these? I couldn’t have told him yes to those.”

She had concerns that the fine-tuned model was associated with her name, in part because it didn’t really represent what makes her work unique.

“What I pride myself on as an artist are authentic expressions, appealing design, and relatable characters. And I feel like that is something that I see AI, in general, struggle with most of all,” Hollie said.

Four of Hollie’s illustrations used to train the AI model (left) and sample AI output (right)

“I feel like AI can kind of mimic brush textures and rendering, and pick up on some colors and shapes, but that’s not necessarily what makes you really hireable as an illustrator or designer. If you think about it, the rendering, brushstrokes, and colors are the most surface-level area of art. I think what people will ultimately connect to in art is a lovable, relatable character. And I’m seeing AI struggling with that.”

“As far as the characters, I didn’t see myself in it. I didn’t personally see the AI making decisions that that I would make, so I did feel distance from the results. Some of that frustrated me because it feels like it isn’t actually mimicking my style, and yet my name is still part of the tool.”

She wondered if the model’s creator simply didn’t think of her as a person. “I kind of feel like when they created the tool, they were thinking of me as more of a brand or something, rather than a person who worked on their art and tried to hone things, and that certain things that I illustrate are a reflection of my life and experiences that I’ve had. Because I don’t think if a person was thinking about it that way that they would have done it. I think it’s much easier to just convince yourself that you’re training it to be like an art style, but there’s like a person behind that art style.”

“For me, personally, it feels like someone’s taking work that I’ve done, you know, things that I’ve learned — I’ve been a working artist since I graduated art school in 2011 — and is using it to create art that that I didn’t consent to and didn’t give permission for,” she said. “I think the biggest thing for me is just that my name is attached to it. Because it’s one thing to be like, this is a stylized image creator. Then if people make something weird with it, something that doesn’t look like me, then I have some distance from it. But to have my name on it is ultimately very uncomfortable and invasive for me.”


I reached out to MysteryInc152 on Reddit to see if they’d be willing to talk about their work, and we set up a call.

MysteryInc152 is Ogbogu Kalu, a Nigerian mechanical engineering student in New Brunswick, Canada. Ogbogu is a fan of fantasy novels and football, comics and animation, and now, generative AI.

His initial hope was to make a series of comic books, but knew that doing it on his own would take years, even if he had the writing and drawing skills. When he first discovered Midjourney, he got excited and realized that it could work well for his project, and then Stable Diffusion dropped.

Unlike Midjourney, Stable Diffusion was entirely free, open-source, and supported powerful creative tools like img2img, inpainting, and outpainting. It was nearly perfect, but achieving a consistent 2D comic book style was still a struggle. He first tried hypernetwork style training, without much success, but DreamBooth finally gave him the results he was looking for.

Before publishing his model, Ogbogu wasn’t familiar with Hollie Mengert’s work at all. He was helping another Stable Diffusion user on Reddit who was struggling to fine-tune a model on Hollie’s work and getting lackluster results. He refined the image training set, got to work, and published the results the following day. He told me the training process took about 2.5 hours on a GPU at Vast.ai, and cost less than $2.

Reading the Reddit thread, his stance on the ethics seemed to border on fatalism: the technology is inevitable, everyone using it is equally culpable, and any moral line is completely arbitrary. In the Reddit thread, he debated with those pointing out a difference between using Stable Diffusion as-is and fine-tuning an AI on a single living artist:

There is no argument based on morality. That’s just an arbitrary line drawn on the sand. I don’t really care if you think this is right or wrong. You either use Stable Diffusion and contribute to the destruction of the current industry or you don’t. People who think they can use [Stable Diffusion] but are the ‘good guys’ because of some funny imaginary line they’ve drawn are deceiving themselves. There is no functional difference.

On our call, I asked him what he thought about the debate. His take was very practical: he thinks it’s legal to train and use, likely to be determined fair use in court, and you can’t copyright a style. Even though you can recreate subjects and styles with high fidelity, the original images themselves aren’t stored in the Stable Diffusion model, with over 100 terabytes of images used to create a tiny 4 GB model. He also thinks it’s inevitable: Adobe is adding generative AI tools to Photoshop, Microsoft is adding an image generator to their design suite. “The technology is here, like we’ve seen countless times throughout history.”

Toward the end of our conversation, I asked, “If it’s fair use, it doesn’t really matter in the eye of the law what the artist thinks. But do you think, having done this yourself and released a model, if they don’t find flattering, should the artist have any say in how their work is used?”

He paused for a few seconds. “Yeah, that’s… that’s a different… I guess it all depends. This case is rather different in the sense that it directly uses the work of the artists themselves to replace them.” Ultimately, he thinks many of the objections to it are a misunderstanding of how it works: it’s not a form of collage, it’s creating new images and clearly transformative, more like “trying to recall a vivid memory from your past.”

“I personally think it’s transformative,” he concluded. “If it is, then I guess artists won’t really have a say in how these models get written or not.”


As I was playing around with the model trained on myself, I started thinking about how cheap and easy it was to make. In the short term, we’re going to see fine-tuned for anything you can imagine: there are over 700 models in the Concepts Library on HuggingFace so far, and trending in the last week alone on Reddit, models based on classic Disney animated films, modern Disney animated films, Tron: Legacy, Cyberpunk: Edgerunners, K-pop singers, and Kurzgesagt videos.

Images generated using the “Classic Animation” DreamBooth model trained on Disney animated films

Aside from the IP issues, it’s absolutely going to be used by bad actors: models fine-tuned on images of exes, co-workers, and, of course, popular targets of online harassment campaigns. Combining those with any of the emerging NSFW models trained on large corpuses of porn is a disturbing inevitability.

DreamBooth, like most generative AI, has incredible creative potential, as well as incredible potential for harm. Missing in most of these conversations is any discussion of consent.


The day after we spoke, Ogbogu Kalu reached out to me through Reddit to see how things went with Hollie. I said she wasn’t happy about it, that it felt invasive and she had concerns about it being associated with her name. If asked for permission, she would have said no, but she also didn’t own the rights to several of the images and couldn’t have given permission even if she wanted to.

“I figured. That’s fair enough,” he responded. “I did think about using her name as a token or not, but I figured since it was a single artist, that would be best. Didn’t want it to seem like I was training on an artist and obscuring their influence, if that makes sense. Can’t change that now unfortunately but I can make it clear she’s not involved.”

Two minutes later, he renamed the Huggingface model from hollie-mengert-artstyle to the more generic Illustration-Diffusion, and added a line to the README, “Hollie is not affiliated with this.”

Two days later, he released a new model trained on 40 images by concept and comic book artist James Daly III.

Art by James Daly III (left) vs. images generated by Stable Diffusion fine-tuned on his work
28 Comments

Winding Down Skittish

Posted October 27, 2022October 27, 2022 by Andy Baio

After we cancelled XOXO in the early days of the pandemic, I spent much of 2020 wondering if there was any way to recreate the unique experience of a real-world festival like XOXO online: the serendipity of meeting new people while running between venues, getting drawn into conversations with strangers and old friends, stepping in and out of conversations as simply as walking away.

Those explorations ended up in Skittish, a colorful and customizable browser-based 3D world that let you talk to others nearby with your voice while controlling a goofy animal character. It was weird and silly and I loved it.

Sadly, for a number of reasons, I’ve decided to shut it down this December.

There isn’t enough demand to keep it going, probably a combination of an overall decline in demand for virtual events and its niche featureset, and it requires ongoing support and maintenance that’s hard for me to provide on my own.

An Exciting Beta

I’m exceedingly proud of what we built with such tight resources:

  • A 3D environment in the browser, fully functional on desktop and mobile browsers
  • High-quality spatial audio based on your location
  • Built-in editor for collaborative world editing
  • Public and private audio spaces
  • Embedded videos and livestreams
  • Roles for organizers, speakers, editors
  • Chat with moderation tools
  • Subscription payments integration with Stripe

Throughout most of last year, we ran events large and small as part of an invite-only beta. Festivals, conferences, workshops, a summer camp, and meetups of all sizes. In that first year, it got some great press from TechCrunch, The Verge, and others, and feedback was incredibly positive. It seemed like we built something that was niche, but unique and special.

A Rocky Launch

The problems started shortly after our public launch in November 2021, when we opened signups to everyone.

Two weeks in, our audio provider, High Fidelity, dealt us some devastating news: they were shutting down the spatial audio API that made Skittish possible — with only six weeks’ notice.

We scrambled to negotiate an extension with them through January 2022, eventually hosting the service on our own AWS infrastructure at great expense to prevent a disruption of service while we migrated to Dolby.io, the only other service that provided a spatial audio API.

As we were tied up with these infrastructure changes for over two months, the winds were shifting.

Waning Demand

Starting in late 2021, covid restrictions lifted virtually everywhere, and despite the pandemic raging on, event organizers were resuming in-person events.

Consequently, the demand for virtual events dropped off a cliff. This is an industry-wide trend: Hopin cut 30% of their staff, only four months after a hiring freeze and major round of layoffs. Gather laid off a third of staff and announced they were pivoting away from virtual events entirely, focusing solely on remote work collaboration. It seems like many platforms are doing the same, or quietly folding.

I still believe there are huge benefits to virtual events, especially for those devoting the time to building thoughtful social spaces like Roguelike Celebration, but the demand for virtual event platforms like ours feels very low right now, partly because we built something niche, but also simply because many people just want to meet in person now, regardless of health risk.

As our revenue dried up, we also ran out of cash. Skittish was initially funded from a grant provided by Grant for the Web, and I considered doing a small fundraise, but with the future looking so uncertain, I decided it wasn’t worth the risk.

Skittish doesn’t cost much to run without contractors, but it’s still losing money. And frankly, I’m not well-equipped to adequately support it and continue development entirely by myself.

Calling It Quits

So, as much as I love it, Skittish is winding down. I’ve already disabled upgrading to paid plans, and will disable signups on December 14. If you have unusual circumstances and need access to it longer, get in touch.

I always knew there would be risk building something like this during the pandemic. Fortunately, I built it in a way where nobody would be burned: we fully honored the terms of our grant funding, it never had investors, never took on debt, never had employees, and I’ve made sure no paying customer will be negatively affected.

I’m extremely grateful to Grant for the Web for the initial grant funding, all the events and organizations that used Skittish over the last two years, and everyone who worked on it — but especially Simon Hales for his herculean effort on every part of the platform.

Thanks for playing!

The very busy Flash Forward wrap party
5 Comments

AI Data Laundering: How Academic and Nonprofit Researchers Shield Tech Companies from Accountability

Posted September 30, 2022September 30, 2022 by Andy Baio

Yesterday, Meta’s AI Research Team announced Make-A-Video, a “state-of-the-art AI system that generates videos from text.”

We’re pleased to introduce Make-A-Video, our latest in #GenerativeAI research! With just a few words, this state-of-the-art AI system generates high-quality videos from text prompts.

Have an idea you want to see? Reply w/ your prompt using #MetaAI and we’ll share more results. pic.twitter.com/q8zjiwLBjb

— Meta AI (@MetaAI) September 29, 2022

Like he did for the Stable Diffusion data, Simon Willison created a Datasette browser to explore WebVid-10M, one of the two datasets used to train the video generation model, and quickly learned that all 10.7 million video clips were scraped from Shutterstock, watermarks and all.

In addition to the Shutterstock clips, Meta also used 10 million video clips from this 100M video dataset from Microsoft Research Asia. It’s not mentioned on their GitHub, but if you dig into the paper, you learn that every clip came from over 3 million YouTube videos.

So, in addition to a massive chunk of Shutterstock’s video collection, Meta is also using millions of YouTube videos collected by Microsoft to make its text-to-video AI.

Non-Commercial Use

The academic researchers who compiled the Shutterstock dataset acknowledged the copyright implications in their paper, writing, “The use of data collected for this study is authorised via the Intellectual Property Office’s Exceptions to Copyright for Non-Commercial Research and Private Study.”

But then Meta is using those academic non-commercial datasets to train a model, presumably for future commercial use in their products. Weird, right?

Not really. It’s become standard practice for technology companies working with AI to commercially use datasets and models collected and trained by non-commercial research entities like universities or non-profits.

In some cases, they’re directly funding that research.

For example, many people believe that Stability AI created the popular text-to-image AI generator Stable Diffusion, but they funded its development by the Machine Vision & Learning research group at the Ludwig Maximilian University of Munich. In their repo for the project, the LMU researchers thank Stability AI for the “generous compute donation” that made it possible.

The massive image-text caption datasets used to train Stable Diffusion, Google’s Imagen, and the text-to-image component of Make-A-Video weren’t made by Stability AI either. They all came from LAION, a small nonprofit organization registered in Germany. Stability AI directly funds LAION’s compute resources, as well.

Shifting Accountability

Why does this matter? Outsourcing the heavy lifting of data collection and model training to non-commercial entities allows corporations to avoid accountability and potential legal liability.

It’s currently unclear if training deep learning models on copyrighted material is a form of infringement, but it’s a harder case to make if the data was collected and trained in a non-commercial setting. One of the four factors of the “fair use” exception in U.S. copyright law is the purpose or character of the use. In their Fair Use Index, the U.S. Copyright Office writes:

“Courts look at how the party claiming fair use is using the copyrighted work, and are more likely to find that nonprofit educational and noncommercial uses are fair.”

A federal court could find that the data collection and model training was infringing copyright, but because it was conducted by a university and a nonprofit, falls under fair use.

Meanwhile, a company like Stability AI would be free to commercialize that research in their own DreamStudio product, or however else they choose, taking credit for its success to raise a rumored $100M funding round at a valuation upwards of $1 billion, while shifting any questions around privacy or copyright onto the academic/nonprofit entities they funded.

Not sure if I mentione but stable diffusion is a model created and released by CompVis at University of Heidelberg.
The LAION dataset is created by the German charity of the same name. We support both.
This is outlined in the announcement post.
Has implications for stuff above

— Emad (@EMostaque) August 16, 2022

This academic-to-commercial pipeline abstracts away ownership of data models from their practical applications, a kind of data laundering where vast amounts of information are ingested, manipulated, and frequently relicensed under an open-source license for commercial use.

Unforeseen Consequences

Years ago, like many people, I used to upload my photos to Flickr with a Creative Commons license that required attribution and allowed non-commercial use. Yahoo released a database of 100 million of those Creative Commons-licensed images for academic research, to help the burgeoning field of AI. Researchers at the University of Washington took 3.5 million of the Flickr photos with faces in them, over 670,000 people (including me), and released the MegaFace dataset, part of a research competition sponsored by Google and Intel.

I was happy to let people remix and reuse my photos for non-commercial use with attribution, but that’s not how they were used. Instead, academic researchers took the work of millions of people, stripped it of attribution against its license terms, and redistributed it to thousands of groups, including corporations, military agencies, and law enforcement.

In their analysis for Exposing.ai, Adam Harvey and Jules LaPlace summarized the impact of the project:

[The] MegaFace face recognition dataset exploited the good intentions of Flickr users and the Creative Commons license system to advance facial recognition technologies around the world by companies including Alibaba, Amazon, Google, CyberLink, IntelliVision, N-TechLab (FindFace.pro), Mitsubishi, Orion Star Technology, Philips, Samsung1, SenseTime, Sogou, Tencent, and Vision Semantics to name only a few. According to the press release from the University of Washington, “more than 300 research groups [were] working with MegaFace” as of 2016, including multiple law enforcement agencies.

That dataset was used to build the facial recognition AI models that now power surveillance tech companies like Clearview AI, in use by law enforcement agencies around the world, as well as the U.S. Army. The Chinese government has used it to train their surveillance systems. As the New York Times reported last year:

MegaFace has been downloaded more than 6,000 times by companies and government agencies around the world, according to a New York Times public records request. They included the U.S. defense contractor Northrop Grumman; In-Q-Tel, the investment arm of the Central Intelligence Agency; ByteDance, the parent company of the Chinese social media app TikTok; and the Chinese surveillance company Megvii.

The University of Washington eventually decommissioned the dataset and no longer distributes it. I don’t think any of those researchers, or even the people at Yahoo who decided to release the photos in the first place, ever foresaw how it would later be used.

408 of about 4,753,520 face images from the MegaFace face recognition training and benchmarking dataset. Visualization by Adam Harvey of Exposing.ai.

They were motivated to push AI forward and didn’t consider the possible repercussions. They could have made inclusion into the dataset opt-in, but they didn’t, probably because it would’ve been complicated and the data wouldn’t have been nearly as useful. They could have enforced the license and restricted commercial use of the dataset, but they didn’t, probably because it would have been a lot of work and probably because it would have impacted their funding.

Asking for permission slows technological progress, but it’s hard to take back something you’ve unconditionally released into the world.


As I wrote about last month, I’m incredibly excited about these new AI art systems. The rate of progress is staggering, with three stunning announcements yesterday alone: aside from Meta’s Make-A-Video, there was also DreamFusion for text-to-3D synthesis and Phenaki, another text-to-video model capable of making long videos with prompts that change over time.

But I grapple with the ethics of how they were made and the lack of consent, attribution, or even an opt-out for their training data. Some are working on this, but I’m skeptical: once a model is trained on something, it’s nearly impossible for it to forget. (At least for now.)

Like with the artists, photographers, and other creators found in the 2.3 billion images that trained Stable Diffusion, I can’t help but wonder how the creators of those 3 million YouTube videos feel about Meta using their work to train their new model.

8 Comments

A mysterious voice is haunting American Airlines’ in-flight announcements and nobody knows how

Posted September 23, 2022September 26, 2022 by Andy Baio

Here’s a little mystery for you: there are multiple reports of a mysterious voice grunting, moaning, and groaning on American Airlines’ in-flight announcement systems, sometimes lasting the duration of the flight — and nobody knows who’s responsible or how they did it.

Actor/producer Emerson Collins was the first to post video, from his Denver flight on September 6:

The weirdest flight ever.
These sounds started over the intercom before takeoff and continued throughout the flight.
They couldn’t stop it, and after landing still had no idea what it was. pic.twitter.com/F8lJlZHJ63

— Emerson Collins (@ActuallyEmerson) September 23, 2022

Here’s an MP3 of the audio with just the groans, moans, and grunts, with some of the background noise filtered out.

This is the only video evidence so far, but Emerson is one of several people who have experienced this on multiple different American Airlines flights. This thread from JonNYC collected several different reports from airline employees and insiders, on both Airbus A321 and Boeing 737-800 planes.

Other people have reported similar experiences, always on American Airlines, going as far back as July. Every known incident has gone through the greater Los Angeles area (including Santa Ana) or Dallas-Fort Worth. Here are all the incidents I’ve seen so far, in chronological order:

  • July – American Airlines, JFK to LAX. Bradley P. Allen wrote, “My wife and I experienced this during an AA flight in July. To be clear, it was just sounds like the moans and groans of someone in extreme pain. The crew said that it had happened before, and had no explanation. Occurred briefly 3 or 4 times early in the flight, then stopped.” (Additional flight details via the LA Times.)
  • August 5 – American Airlines 117. JFK to LAX. Wendy Wanderman wrote, “It happened on my flight August 5 from JFK to LAX and it was an older A321 that I was on. It was Flight 117. There was flight crew that was on the same plane a couple days earlier and the same thing happened. It was funny and unsettling.”
  • September 6 – American Airlines. Santa Ana, CA to Dallas-Fort Worth. Emerson Collins’ flight. “These sounds started over the intercom before takeoff and continued throughout the flight. They couldn’t stop it, and after landing still had no idea what it was… I filmed about fifteen minutes, then again during service. It was calmer for a while mid flight.”
  • Mid-September – American Airlines, Airbus A320. Orlando, FL to Dallas-Fort Worth. Doug Boehner wrote, “This happened to me last week. It wasn’t the whole flight, but periodically weird phrases and sounds. Then a huge ‘oh yeah’ when we landed. We thought the pilot left his mic open.”
  • September 18 – American Airlines 1631, Santa Ana, CA to Dallas-Fort Worth. Boeing 737-800. An anonymous report passed on by JonNYC, “Currently on AA1631 and someone keeps hacking into the PA and making moaning and screaming sounds 😨 the flight attendants are standing by their phones because it isn’t them and the captain just came on and told us they don’t think the flight systems are compromised so we will finish the flight to DFW. Sounded like a male voice and wouldn’t last more than 5-10 seconds before stopping. And has [intermittently] happened on and off all flight long.” (And here’s a second person on the same flight.)

Interestingly, JonNYC followed up with the person who reported the incident on September 18 and asked if it sounded like the same voice in the video. “Very very similar. Same voice! But ours was less aggressive. Although their volume might have been turned up more making it sound more aggressive. 100% positive same voice.“

Official Response

View from the Wing’s Gary Leff asked American Airlines about the issue, and their official response is that it’s a mechanical issue with the PA amplifier. The LA Times followed up on Saturday, with slightly more information:

“Our maintenance team thoroughly inspected the aircraft and the PA system and determined the sounds were caused by a mechanical issue with the PA amplifier, which raises the volume of the PA system when the engines are running,” said Sarah Jantz, a spokesperson for American.

Jantz said the P.A. systems are hardwired with no external access and no Wi-Fi component. The airline’s maintenance team is reviewing the additional reports. Jantz did not respond to questions about how many reports it has received and whether the reports are from different aircrafts.

This explanation feels incomplete to me. How can an amplifier malfunction broadcast what sounds like a human voice without external access? On multiple flights and aircraft? They seem to be saying the source is artificial, but has anyone heard artificial noise that sounds this human?

Why This Is So Bizarre

By nature, passenger announcement systems on planes are hardwired, closed systems, making them incredibly difficult to hack. Professional reverse engineer/hardware hacker/security analyst Andrew Tierney (aka Cybergibbons) dug up the Airbus 321 documents in this thread.

So… We've had a good dig into this.

The A321 passenger announcement system looks to be physically discrete to the interphone and other systems.

We're struggling to see a path. https://t.co/qVdJR6cUm0

— Cybergibbons 🚲🚲🚲 (@cybergibbons) September 23, 2022

They don't tend to put things in planes that are not needed.

You can speak on the interphone (the cabin telephone system) from lots of places including the belly panel and engines. But it's wired.

— Cybergibbons 🚲🚲🚲 (@cybergibbons) September 23, 2022

“And on the A321 documents we have, the passenger announcement system and interphone even have their own handsets. Can’t see how IFE or WiFi would bridge,” Tierney wrote. “Also struggling to see how anyone could pull a prank like this.”

This report found by aviation watchdog JonNYC, posted by a flight attendant on an internal American Airlines message board, points to some sort of as-yet-undiscovered remote exploit.

pic.twitter.com/5Ol4zuSb9u

— 🇺🇦 JonNYC 🇺🇦 (@xJonNYC) September 20, 2022

We also know that, at least on Emerson Collins’ flight, there was no in-seat entertainment, eliminating that as a possible exploit vector.

They did not! This was a watch inflight entertainment on your phone flight

— Emerson Collins (@ActuallyEmerson) September 23, 2022

Theories

So, how could this happen? There are a handful of theories, but they’re very speculative.

Medical Intercom

The first to emerge was this now-debunked theory came from “a former avionics guy” posting in r/aviation on Reddit:

The most likely culprit IMHO is the medical intercom. There are jacks mounted in the overhead bins at intervals down the full length of the airplane that have both receive, transmit and key controls. All somebody would need to do is plug a homemade dongle with a Bluetooth receiver into one of those, take a trip to the lav and start making noises into a paired mic.

The fact that the captain’s announcements are overriding (ducking) it but the flight attendants aren’t is also an indication it’s coming from that system.

If this was how it was done, there’s no reason the prankster would need to hide in the bathrooms: they could trigger a soundboard or prerecorded audio track from their seat.

However, this theory is likely a dead end. JonNYC reports that an anonymous insider confirmed they no longer exist on American Airlines flights. And even if they existed, the medical intercoms didn’t patch into the announcement system. They only allow flight crew to talk to medical staff on the ground.

someone says:
“These don’t exist on AA. We use an app on our iPhone to contact medical personnel on the ground. No such port exists, not since the super80 and they were inop’d.”

— 🇺🇦 JonNYC 🇺🇦 (@xJonNYC) September 24, 2022

Pre-Recorded Audio Message Bug

Another theory, also courtesy of JonNYC, is that there’s an issue with the pre-recorded audio messages (“PRAM”), which were replaced in the last 60 days, within the timeframe of all these incidents. Perhaps some test audio was added to the end of a message, maybe by an engineer who worked on it, and it’s accidentally playing that extra audio?

.. as an intermittent inflight announcement? Maybe the IT version of blowing a slide with a beer in your hand. 😂"

⬆️THE "CRAZY THEORY" PART PLEASE ⬆️

— 🇺🇦 JonNYC 🇺🇦 (@xJonNYC) September 25, 2022

It's probably the PRAM… Pre-Recorded Announcement Machine.

These have solid state storage, techs just load files they get from *somewhere*, test procedure for audio is less than 20 minutes to check it out, and it can be interrupted by inflight announcements.

— Mɪᴄʜᴀᴇʟ Tᴏᴇᴄᴋᴇʀ (@mtoecker) September 23, 2022

Artificial Noise

Finally, some firmly believe that it’s not a human voice at all, but artificial noise or audio feedback filtered through the announcement system.

Nick Anderegg, an engineer with a background in linguistics and phonology, says it’s the results of “random signal passed through a system that extracts human voices.”

An amp malfunction that inputs the signal through algorithms meant to isolate the human voice. All the non-human aspects of the random signal will be stripped out, and the result will appear human. https://t.co/2bXYVCFs2l

— Nick Anderegg loudly supports human rights (@NickAnderegg) September 26, 2022

Anderegg points to a sound heard at the 1:20 mark in Emerson’s video, a “sweep across every frequency,” as evidence that American Airlines’ explanation is accurate.

The tone sweep is just a sign that it’s artificial. Random signals (i.e. interference), when passed through systems designed to isolate the human voice, will make them sound human. It’s attempting to extract a coherent signal where there is none, so it’s approximating one

— Nick Anderegg loudly supports human rights (@NickAnderegg) September 26, 2022

Personally, I struggle with this explanation. The wide variation of utterances heard during Emerson’s three-hour flight are so wildly different, from groans and grunts to moans and shouts, that it’s difficult to imagine it as anything else but human. It’s far from impossible, but I’d love to see anyone try to recreate these sounds with random noise or feedback.

Any Other Ideas?

Any other theories how this might be possible? I’d love to hear them, and I’ll keep this post updated. My favorite theory so far:

Flying hurts the clouds and their screams are picked by the PA system. Seems pretty obvious 🙄

— Horus First (@HorusFirst) September 23, 2022
Photoillustration of an American Airlines jet headed towards a scared cartoon cloud
9 Comments
⇠ Older Posts
February 6, 2023
AI-generated Seinfeld banned from Twitch after transphobic standup — less than a month after AI VTuber Neuro-Sama was banned for two weeks for denying the Holocaust #
February 5, 2023
touchHLE — new open-source project to emulate early iOS apps, starting with App Store launch title Super Monkey Ball from 2008 #
February 3, 2023
Mastodon Flock, find your Twitter friends on Mastodon — even better than Movetodon before Twitter revoked its API access (via) #
February 2, 2023
Katie Notopoulos interviews bot creators about the Twitter API closure — the people behind @ca_dmv_bot, @oliviataters, @MakeItAQuote, @BigTechAlert, @_restaurant_bot, and more #
CatGPT — an AI chatbot that won't confidently lie to you #
DONKS — new animation from Felix Colgrave, "an exploration of ocean plastic, avatars and adaptive bottom feeders" (via) #
Twitter announces the end of free access to its APIs in one week — this will kill every free bot, tool, and service built on its API, including my own Belong.io aggregator #
January 31, 2023
Platformer exclusive on Artifact, the personalized news feed from Instagram’s cofounders — unfortunately it's only news articles from big publishers, so resembles a less personal version of Google News' For You #
Nothing, Forever, an endless livestreamed AI-generated episode of Seinfeld — Motherboard interviewed the creator #
January 30, 2023
Ars Technica’s overview on the state of generative AI — a readable high-level primer on the foundational models that made recent breakthroughs possible #
broider — Max Bittker made a tool for making 9-patch quilt-like borders in CSS using inline data URIs (via) #
January 27, 2023
Using Kid Pix to Recreate Caravaggio’s “Judith Beheading Holofornes” — Cat Graffam's followup to recreating "Saturn Devouring His Son" in Mario Paint #
MusicLM — new AI model from Google Research generates music from text prompts, like "accordion death metal" (via) #
Chronophoto, guess the year photos were taken — my best score is 3,164 4,009 (via) #
Drayk It — make an AI Drake write and perform a song about blogs, Scooby Doo, or anything else (via) #
Measuring the cultural weirdness of Avatar — analyzing Avatar fanfic, memes, and lyric mentions to gauge whether it's a cultural outlier relative to other blockbusters #
January 24, 2023
Macroeconomic Changes Have Made It Impossible for Me to Want to Pay You — "The fact is, if I wanted to pay you, I could. I could even give you raises. But once again, that is not the economic reality we face." #
jwz on Mozilla’s 25th anniversary — Jamie reconstructed some early Mozilla websites not captured by Wayback (via) #
Tapbots releases Ivory, a polished Mastodon app for iOS — if you can't swallow the subscription fee, Ice Cubes is free and open-source #
January 23, 2023
Wonders of Street View — explore weird and wonderful things on Google Street View #
More Links ⇢
Waxy.org | About