How much glue should you put in your pizza?

Speaker A
Search engine is brought to you by Rosetta Stone I only speak English, and honestly, not that well. I'm about to go to England to report a story where I'm at least going to get to pretend like I'm understanding people speaking a different language. But what I should do. What you should do is try Rosetta Stone, the most trusted language learning program available on desktop or as an app that truly immerses you in the language you want to learn. Rosetta Stone is a trusted expert for 30 years with millions of users and 25 languages offered.

Spanish, French, Italian, German, Korean, Chinese, Japanese, Dutch, Arabic, and Polish. And it's an amazing value. Lifetime membership has all 25 languages for any and all trips and language needs in life. Don't put off learning that language. There's no better time than right now to get started.

For a very limited time, search engine listeners can get Rosetta Stone's lifetime membership. For 50% off. Visit rosetta stone.com searchengine. That's 50% off. Unlimited access to 25 language courses for the rest of of your life.

Redeem your 50% off at rosetta stone.com searchengine today. Hi, this is Amy Poehler here to tell you about a new improvised show from paper kite podcasts. The team that brought you. Say more with Doctor Sheila. Check out our new parody podcast, women talking bout murder.

Amy Poehler
It's a show about women talking bout murder. Every episode features special guests, twists, turns, and the mystery of a missing co host, available on the Odyssey app or wherever you get your podcasts.

Speaker A
Hello, we were not actually supposed to publish an episode this week, but then something happened that was so directly and frankly, so absurdly related to our last episode that we wanted to make a quick one for you because the world continues to be very strange, and as it does, it's sometimes hard to resist the urge to document it. So we're here to catch you up. Last episode we were talking to platformers Casey Newton about this huge change that had just been made to how Google search worked. Our episode, I will admit, a slightly doomy installment for a show that tries to, if not avoid the doom, at least steer away from it. Jim, I got your message.

I'm sorry, but the news we were responding to was that Google was increasingly replacing search results that had human written information with AI generated search answers. The way this new feature would work, the AI would now draw on the vast corpus of human knowledge on the Internet to just answer user questions itself. According to the head of Google's parent company, the reason for this new feature is that many Google users would prefer to just not have to sift through a bunch of search results. Instead, the company wanted to let Google do the Googling for you. This change may have also been rolled out because the quality of much of what is googleable is not always that wonderful anyway, and in the last year, AI Spam has already begun to clog up a lot of the websites that Google might want to index.

So just giving people searching for a question the answer saves Google some of the work of trying to sort the wheat from the chaff online. I had reservations about this big new change. We talked about those reservations last episode. What I could not picture just a few weeks ago was how funny the next phase of things would be.

Google rolled out AI overviews widely in mid May. Lots of people started using it for the first time and turned out the way that AI would answer questions was sometimes chaotically insane. The problem was that the AI Google used to answer readers questions had ingested much of Reddit. And while Reddit can be a source of useful information, it can also be a source of lies and jokes. And the AI seemingly could not tell the difference.

Google's users were told things like, quote, eating at least one small rock per day is recommended because rocks contain minerals and vitamins that are important for digestive health. A crazy week on the Internet. So I wanted to talk about Reddit, both its history as a source of sounds good, sounds questionable information online. I wanted to talk about how it. Came to be a website that Google's AI consumed.

And I wanted to know what happened to the one person who did in fact make a glue pizza and consume it. So I invited one of the least trustworthy chefs on the Internet to search engine Katie Natapolis. Okay, before we get into any of this, how do you describe your job to people? I am a senior correspondent, a Business Insider covering tech and culture. I have been following your work forever.

Speaker C
I don't think there's anyone who covers the Internet the exact way you cover the Internet. Like the way I would describe it, is that you're both like a sharp observer of how the Internet can either incentivize or induce strange human behavior in its users, but then also someone who sometimes chooses to behave strangely on the Internet. You do a lot of human guinea pig style reporting. Can you just tell me some of the things you've done, either for fun or research online? Oh gosh.

Katie Natapolis
I find that a very flattering assessment of my work. I'm trying to think of some of the human guinea pig things I've done. I one time was really interested in, like, how sort of tech bros and finance bros all wear, like, fleece vests or puffer vests at the office, sort of like a uniform. And it was kind of, like, boring to just write about because literally, hey, have you noticed finance guys wear fleece vests? That's about it.

Like, there's not that much more to it. So I tried for a week. I wore a fleece vest to the office every day to see if it made me feel more powerful. Did it make you feel more powerful?

It made me feel more comfortable. I'll be honest, it is very comfortable, especially compared to normal women's business casual attire. But I also felt deeply ashamed and unfashionable. And, you know when you have a bad outfit on and you feel bad about it? Yeah.

Speaker C
Like, you constantly want to explain it. Like, you're like, I know that this is not the right choice, but it's the choice that I made for specific reasons. Yeah. I once unfollowed all men on Twitter. I will say this is, I think, coming up on the ten year anniversary.

Of this thing that I interviewed you about, you unfollowed all men on Twitter. And it's funny, this was like, several. The gender politics of the Internet were just. I know from several cycles ago, it doesn't quite hold up. I'll say.

Speaker A
Before we could get into the most. Recent news, Google's AI shenanigans and Katie's. Latest experiment involving eating gluey pizza, I wanted to ask her about the prehistory of her current moment. This year, one of the most popular listener questions for our show has just been people wanting to know, why doesn't Google search work for me anymore? What's gone wrong?

Katie Natapolis
I mean, I know what people are saying, which is that the nature of SEO and the SEO industry has made it such that the stuff you are actually looking for tends to be more and more buried. There's more frequently the sort of drop down boxes of related questions to what you're looking for. That's not necessarily it. There's a lot more on the page than like, hey, how do I get to the website that has the information? SEO is.

Is big and vast and, like, connecting me to the right information about. The question I'm asking is not the only thing that Google has broken. In a way, I think it's worth remembering that a lot of SEO money goes into, like, if you're Walmart, you can pay for the keyword target. So when someone wants to type in target.com, but they don't want to type the whole.com and they just put in target. Your ad for Walmart comes up top in front of them, and then Target also has to pay for its own name.

So there's, like, a lot of money of companies being held ransom and having to pay for their own names because someone else is going to run an ad against them. And that's just genuinely a terrible experience. I think a lot of people have had the kind of thing where they search a specific company or name, and the first three ads on top are something completely different that is genuinely very bad experience and kind of broken. So anyone who uses search a lot probably has their own sort of interior tips and tricks of, like, how they do it. Like, I know that a lot of people put Reddit at the end because often Reddit is a source of great information.

If you're looking for how to change the light bulb in my refrigerator kind of thing, everyone does have their own, like, secret. How do I actually use Google model going on? The same reason people have been searching Reddit instead of the wider web is why the two of us were talking about Reddit this week. Because as the rest of the Internet has degraded, Reddit has remained one site that lots of people still go to for advice, for product recommendations, for their general questions about the world, which was not always the case. Reddit has had a recent ish evolution from under moderated mess to what it is today.

The earlier versions of it were, like, in its first, I don't know, five years of existence, it was known as, like, the trash fire of the Internet. Like, it was akin to four chan. It was just full of terrible, awful people. And a lot of that had to do with the way it was being run from the top, which was this sort of laissez faire free speech. We're not gonna get rid of the bad people because, hey, it's the Internet, and you're allowed to say whatever you want.

Eventually, after a series of crises, they decided, hey, maybe if we want to run a successful business, we should ban the Nazis or all these really awful subreddits they had. Did you use Trashfire Reddit? I didn't post. I would look at it. It also had a very distinct character.

It was this nerdy web comics. When you think about the early teens or late two thousands Internet memes, to say someone is a Redditor had a very distinct, it's a neckbeard and a fedora who thinks advice animal memes are funny and loves webcomics and has an anime body pillow and that very specific kind of early Internet humor. I mean, I feel like I still sort of use Reddit in this sort of derogatory way to be like, if some restaurant has an overly memey food, here's the hamburger with like, 100 kinds of bacon or whatever, it's, oh, that's such Reddit food or something like that. It's funny, as you say. I'm like, basically like 2005 to like, 2011, 2012 Reddit, that is the peak of that.

Speaker C
It feels like everyone on the site is the comic book store guy from the Simpsons. Exactly. And then there's a turn where it's like, Conde Nest acquires them. It becomes, I think, a pretty successful moderation story where they do start to figure out how to have both relatively free speech and relatively few nazis. And I remember reply all days covering, oh, what are they going to do about the Donald?

What are they going to do about this? There's this virulent subreddit that's targeting people, and you don't really see those stories in the same way anymore. No. And I think that with any sort of large platform group, there's a flywheel effect of the mix between moderation and users and who wants to be on it and what kind of community they're making. Right.

Katie Natapolis
So, like, when you have a thing that's like a garbage fire thing, you're going to scare off the normies. And if you're constantly seeing people say certain things, it's going to raise the tolerance for that. Right. So then you come in, you, like, lay down the banhammer, you ban a bunch of these bad subreddits. You make it a little bit more palatable for, like, normal people who just want to discuss, what kind of air filter should I buy to come on?

And then you sort of create this flywheel of, okay, now, people know that you have to behave like a normal human on here. And also there's more normal humans who would never even think to, like, say something awful or join an awful subreddit or do these bad things. And so you actually do sort of grow a healthier community that is more usable, frankly. Yeah. I find it to be actually a place where I go now not to witness horrible human behavior, but to get okay advice about things that I am curious about.

That's the thing, is, I actually do use Reddit quite a lot. I'm on it. I don't know, maybe almost every day. I often just check in to see if there's anything I'm using. I don't really post.

It's like, I love lurking. I love knowing what people are talking about the Internet. And what's fun about Reddit is that there is this still anonymous element to it, so people are totally willing to say embarrassing things that they normally would never reveal. I mean, I think the classic am I the asshole subreddit that people love so much that's full of personal conflict advice that's just really fun. I love that.

And people wouldn't do that under their real names. What I struggle with with Reddit, and I use it. I totally use it, but I have an uneasy relationship with it because I find myself distracted all the time wondering, is this true? Even, am I the asshole? Which I love.

Speaker C
It's always somebody describing some conflict they're in. Almost always, the person is behaving in a completely terrible way and is completely wrong, or it's never hard. Either the person is totally in the wrong or they're the kindest little Church mouse. And it's like my roommate has started taking money out of my pockets and wearing all my clothes. And I asked them to stop, but I'm always like, is it true?

And I started with that, with Reddit in general, where I'll use it, I'll use it, I'll use it. And then I'll see people on Reddit discussing something that I actually know about and the level of people just being completely certain or just lying. And I'm like, oh, this might be all of it. And so I try to use it only for things like gardening tips, where it's about expertise rather than about knowledge. If that's a differentiation, I agree with you.

Katie Natapolis
I will say one of my absolute favorite subreddits is tv too high. What? Is tv too high? So people will post a picture. They're like, I just hung this tv in my new apartment.

Is it too high? And they're obsessed with the idea that tvs should be really low. Like they should be at exactly eye level when you're sitting on a couch. And so I think a lot of people will put a tv, like, for example, above a fireplace, or they sort of expect it to be a little bit raised up. And so a lot of people hang their tv, according to the subreddit, too high.

So then the Reddit was a viper's den. They will just descend upon this person and just mercilessly roast them, overhanging their tv too high. And a lot of it, you can tell, is my girlfriend says, this is where the tv should be. But I think it's too low. And it's always like, break up with her.

And like, there's something about it that, like, I love. Like, it's a weird, dark, horrible corner of the Internet where people are behaving wildly bad, but it's over something so stupid that I find it very wholesome and I really enjoy it. And even though I don't frequently hang tvs, I read this subreddit really frequently because it's really amusing. But then people will go and clearly post fake pictures. Sometimes there will be funny ones where they'll be like, I'm at an Airbnb and you always know what things are whack there.

And it's like right up in like the absolute corner of the ceiling or something, like really weird things. And they also were obsessed with the idea that you should never hang a tv over a fireplace. Why? Because they think it's too high. There's some amount of, if you're actively using the fireplace, it could damage the tv, which is somewhat questionable.

And a lot of people don't actually use the fireplace, but this is this sort of huge obsession. And so they're like, here's a picture of my living room and it's very obvious the tv is meant to go above the fireplace. There's only one way to arrange this living room. And everyone's like, make it so that your couch is against the window. And they will do anything to get the tv not to go over a fireplace.

It's funny to watch. After a short break how the website where people yell at you about your tv being too high on the wall or hanging over a fireplace was fed into Google's extremely expensive artificial intelligence robot brain. That's after some ads.

Speaker A
Search engine is brought to you by Mint Mobile. My favorite spring cleaning takeaway is the post clean clarity you get. How have I been living like this? It's kind of like when you find out that you've been paying a fortune for wireless when mint mobile has phone plans for $15 a month. When you purchase a three month plan.

Wow, how have I been affording this? It's time to switch to mint mobile and get unlimited talk, text and data for $15 a month. For me, compared to my traditional wireless carrier, that's like almost $100 in saving. To get this new customer offer and your new three month unlimited wireless plan for just $15 a month, go to mint mobile.com search. That's mintmobile.com search.

Cut your wireless bill to $15 a month@mintmobile.com. search $45 upfront payment required new customers on first three month plan only speeds slower above 40gb on unlimited plan. Additional taxes, fees and restrictions apply. See mint Mobile for details. Surge engine is brought to you by Yahoo Finance wouldn't it be great if you'd see all your investment and retirement accounts in one place?

With Yahoo Finance you can consolidate your views from multiple accounts into one hub and access the expert analysis you need to tend to your entire portfolio with confidence. Youre probably wondering what I invest in. I do an index fund and some of the dumbest individual stock choices any person has ever made. I am personally helping to fund the us economy. Dont be like me.

For more than 25 years, Yahoo Finance has been the brand behind every great investor. Whether you're a seasoned investor or are looking for that extra guidance, Yahoo Finance gives you all the tools and data you need in one place. They are the number one finance destination, producing a holistic look at the financial news cycle, including breaking news, original editorial perspectives, analyst ratings, independent research, customizable charts, and so much more. For comprehensive financial news and analysis, visit the brand behind every great investor Yahoo Finance.com dot the number one financial destination Yahoo Finance.com dot that's yahoofinance.com dot.

Welcome back to the show.

So just a refresher on Reddit as a business, not a website. In case that is helpful here. Founded in 2005 by two college roommates, Steve Huffman and Alexis Ohanian, joined by the late Internet pioneer Aaron Swartz, the company was acquired a year later by Conde Nast, the magazine publisher. At the time, it seemed like a strange investment, but it turned out to be a shrewd one. Conde bought Reddit for cheap, reportedly between ten and $20 million for what is currently one of the top ten most popular websites in the world.

Over the years, Reddit has made money chiefly through ads. But these ads are display ads relative to some of the more invasive or targeted ads you see online. Display ads are not usually incredibly lucrative. Reddit went public at IPO just a couple months ago, in March of 2024, and ahead of that IPO, you got the feeling that the company was looking for ways to become more profitable. As part of this, Reddit had just announced a licensing deal with Google.

Reddit would allow Google to use most of the content on its website as training data for Google's AI. Katie Natopoulos said that at the time, this seemed like a good deal for both sides. I would imagine that it behooved both parties very well, right? Reddit wanted to go public and it needed to make more money essentially, it had been in business for a long time and it was still not quite breaking even, I think. And it basically needed to be making more money in order to do that to made this deal.

Katie Natapolis
I think it's $60 million per year with Google to allow Google to train its AI models on Reddit data. And I think probably some users were maybe uncomfortable with the idea of their words being ingested into a training model. But also, like, you put those words on Reddit, what did you think was going to happen? I don't know. Google also, one way that these different companies making AI language models can differentiate themselves is like they desperately need more and more words, right?

Like they need more content to ingest, to train the models to become better. There's something called the common crawl, which is basically this sort of open source, giant, massive chunk of the web for years and years. And everyone uses that and they've already gobbled that up, right? That's how like Wikipedia and a lot of other websites have been somewhat ingested. Now you have all these other companies coming along saying, hey, if you want to use our stuff, you have to pay us or license it.

Essentially. A lot of media companies are doing that now. Business insiders parent company does that with OpenAI. And I don't know how good those deals are to some degree. It may be like sort of last ditch.

You are probably either going to do it anyways. But for Google, getting to license Reddit is great because Reddit has a lot of words, it has a lot of pictures, it has a lot of useful information. Tell me what happens to Google when Google's AI robot ingests Reddit and treats it as gold standard human knowledge. So the way the Google AI modules work is if you ask a question that might have a kind of answer, like, what temperature should I cook a turkey at? Right?

Like it could come up with that, with an AI search results or something like that. And these, for the most part, are honestly probably pretty helpful for most searches for most people most of the time, right? I used it. The first time I saw it, I was at a bowling alley and I was throwing the ball into the gutter over and over again. And I googled, how are you supposed to roll a bowling ball?

Speaker C
And it gave me like a pretty good thing. You keep your arm close to your side, you aim at the arrows, not at the pins. It helped for like two frames. PJ, maybe you want to try. They have those bumpers for little kids that they can put up at the bowling alley.

They did have the bumpers I refused. You should have just used the bumpers. There was this guy at the lane next to me who was super ripped and killing it. And then I realized he was heaving the ball and he looked over and he had the bumpers up. I was like, sir, oh, God, it's wrong.

Katie Natapolis
So now Google will give you that sort of quick answer. It'll give you the tips on how should I throw a bowling ball? It'll say, keep your arm close, bend at the knees or whatever. And it's sourcing that information through potentially multiple different websites. I think typically what it does is it does give you links at the bottom to the websites that it found this information on and sort of averaged it out to write its own little three sentences about it.

But a big place that it's getting this now from is Reddit, right? And so what I saw happened almost immediately was that people noticed that on Reddit, sometimes people either are wrong or try to be funny and sometimes are very funny. And if you're a human being, you might know what a joke is. And if you're an AI, you might not know what a joke is like. What were some of the results you saw that people were sharing?

So one that didn't necessarily come from Reddit was someone searched, how many rocks should I eat? And Google AI's answer was, it is recommended to eat one rock per day. And that was sourced from an article from the Onion, which a human being knows that the onion has satirical articles that are not meant to be real. But when you see that in a Google answer, it certainly doesn't look that way. And it's also, it's very funny that Google is taking factual information from the onion.

Speaker A
Just to jump in here for a second, I should say. A Google spokeswoman told the New York Times that the vast majority of AI overview queries resulted in, quote, high quality information. And she said of these bad results that, quote, many of the examples we've seen have been uncommon queries, which she didn't say. But what Google may have thought is most people are just not going to start eating rocks or whatever because a search engine told them to. Although one person did choose to take these deranged search results very seriously.

Katie Natapolis
So there was a screenshot that was going viral where someone had searched in, how do I keep the cheese from sliding off my pizza? And it gave a couple tips. The google AI answer was like, wait till the cheese cools before biting. And then it also had a couple bullet points and one was add 8th of a cup of glue. To the sauce to keep it from sliding off.

And people pretty quickly realized that that particular bullet point had been sourced from an eleven year old post, not by an eleven year old, although possibly, but eleven years ago, someone on r pizza had asked that same question, how do I keep the cheese from sliding off? And someone who had the username fucksmith had suggested, just add an 8th of a cup of Elmer's glue to your sauce, mix it up and you'll have no problems. And all the comments under that were like ha ha, yuck yuck yuck. Like in that context, it was very obviously a joke, and Google ingested this Reddit answer and provided it as a factual, decent answer to the question in its AI summary. And so when you saw that, what did you decide to do?

So this sort of screenshot was going viral and a lot of people were enjoying how ridiculous it was. And I did see someone say back in the day, there would have been a 23 year old at Buzzfeed who would have actually had to make the pizza glue and eat it as a stunt. And I thought to myself, well, I'm not 23, but I'm gonna make that pizza.

Speaker C
And why? I think I just knew that I had to do it, that it probably wouldn't kill me for one thing, and that in terms of a piece of content that was going to illustrate how ridiculous this was, you could write about it and say this is a ridiculous answer. But. But that might only explain so much. The way to really explain that this is a ridiculous thing would be to actually make the pizza.

Speaker A
Before Katie tells us what glue does to the human intestines, we're going to take a quick break before these ads. A free PSA from search engine do not eat glue. Do not eat pizza with glue in it. Do not eat food at Katie Nantopolis House okay, some ads search engine is sponsored by Miro. No matter what you're working on, it can be challenging to visualize what tasks are needed and how to prioritize them.

For a team sprint, many tools can be restrictive in the way they organize information. Your ability to see all tasks is restricted by the size of your screen, which make it harder to understand the relationships between tasks, especially between different teams. Miro is a visual collaboration platform that gives your team more clarity through comprehensive functionalities that work together with your existing toolsets to make any sprint ritual. Whether it be a standup estimation, sprint planning or retrospective, more efficient, clear and ultimately more productive, Miro helps ensure your team has the context they need before devoting time and resources to get the work done with Miro. Planning team tasks is smoother and gives everyone a clear sense of mission for every sprint.

Whether you work in product design, engineering, UX agile, or marketing, bring your team together on Miro. Your first three Miro boards are free when you sign up today@miro.com. dot that's three free boards@miro.com. dot search engine is brought to you by Squarespace. Squarespace is the all in one website platform for entrepreneurs to stand out and succeed online.

Whether youre just starting out or managing a growing brand, Squarespace makes it easy to create a beautiful website, engage with your audience, and sell anything from products to content to time, all in one place, all on your terms. Despite reporting a lot of stories about the Internet, I find websites hard to make. Squarespace offers blueprint, AI and SEO tools. You can start a completely personalized website with a new guided design system, Squarespace blueprint. They also have flexible payments.

You can make checkout seamless for your customers with simple but powerful payment tools. Squarespace also offers the fluid engine, the next generation website editor from squarespace. It's never been easier for anyone to unlock unbreakable creativity. Head to squarespace.com for a free trial, and when you're ready to launch, go to www.squarespace.com engine to save 10% off your first purchase of a website or domain. That's squarespace.com engine.

Welcome back to the show. We now return to an ordinary kitchen in an ordinary home in an ordinary state, New Jersey, in which nonetheless, something was about to happen that possibly had never before happened in all of human history. Have you ever made pizza before? I have. I will say this did inspire me.

Katie Natapolis
I should make homemade pizza more often. It's a delight. But like, I went to the grocery store, I got a ball of dough that's uncooked pizza dough. And I got jarred sauce, pre shredded mozzarella cheese, came home, got my ingredients. I already had the white glue.

Speaker C
How do you source? I think the Reddit post, if I recall right, did specify non toxic glue. How did you decide what type of glue to use? So I looked at the glue I had in my home, which was target brand white glue, the classic school glue that's white with the little orange top, and it said on there, non toxic. I said, good enough for me.

Katie Natapolis
To be fair, I did google, how much non toxic glue can you eat? I tried a couple different versions, like how much glue is okay to eat? What happens if you eat glue but. You'Re asking the same AI that told you to eat glue. I feel like you're not even learning the lesson of your own joke.

And true. The thing is, I didn't want to dig too deep into it because mainly I was getting a general response of like, a little glue might make your tummy hurt. Don't eat too much. And at one point, I, like, saw some link to how much glue could actually be bad for you because I can't remember the name of the chemical in there. It's some sort of poly acetate kind of thing.

And it was like some study done on rats of how much it caused to kill them. And I was like, not reading that. Nope. The other thing, as a person with a very limited understanding of either chemistry or human biology, my fear would not just be that there's something in it that at a certain dose is toxic, but I would also think glue makes things stick together and you're putting it. Through your intestinal tract.

Speaker C
And what if just two things stick together inside of you? Do you know what I mean? I don't even know. I can't draw a stomach for you, but I can just imagine things happening that would be bad. I do think that by the time it gets into your stomach, okay, this is, again, I am making some big guesses here, but that the gluiness of it would have sort of already been broken down by whatever sort of digestive processes you might have.

Katie Natapolis
But I will say this does remind me of a problem with AI search. So I recently was having sort of like a debate with a friend about the digestive process and whether or not the sort of phrase like, oh, if you eat something that disagrees with you, it goes right through you. Like, oh, I ate chipotle. And 2 hours later it came out and I was like, no, it doesn't work that way. Food takes 24 hours to digest.

You can't eat something, and 2 hours later that actually comes out the other end. Right. It's the food you ate yesterday is what's coming out. And we were debating this about whether or not it could be true. And this is a case where sort of lived experience of chipotle is in conflict with the science.

And so I had been testing out an app or an AI search called perplexity. AI. Yeah. I've used perplexity. Yeah.

Which is only AI search results. And it's really good for like, questions kind of like this. So I asked perplexity AI, can you poop something out right after you eat it? Basically. And it gave me an answer that confirmed what I knew to be true, which is, no.

It takes 24 hours to digest something. And that what can happen is that if you eat something that disagrees with. With your stomach, it might stimulate a response where yesterday's lunch is coming out. And I was like, huh, look. See, I'm right.

And my friend was like, where's that information coming from? And perplexity makes it a little bit harder to see your sources than Google does. And I finally, like, found the little source of where this information had come from. And when you're looking at health information online, like, you kind of know in your mind, like, what's reputable, like Mayo Clinic or NIH, or even like, WebMD or Wikipedia, even honestly. And this had been sourced from dudewipes.com dot.

I'm here trying to win an argument, and it turns out it was the correct information. But it makes it a little harder when you realize that the information you're getting has been sourced from dudewipes.com dot. Yeah, it seems to point at the whole problem of it, which is the Internet's always been a place where you have to be a smart consumer of information in a way that we all always sometimes fail at. But at least you had context clues. And it feels like what is tricky about AI, at least as it exists right now, is that you've lost a lot of your context, or you have to dig harder to find it.

Speaker C
Like, you can't actually see what ingredients are in the thing that you're eating as clearly. Yeah, I think that by 2024, most people had become pretty good at being able to look at a set of Google searches results and assess which is the thing they want to click on, that's going to be the trustworthy information or whatnot. Based on our experience doing this and all, information is not equal, right? Yeah. But to answer your question, I wasn't so worried about my stomach gluing together.

You're worried about toxic chemicals. I guess I was more worried about, is this a sort of forever chemical macroplastic that I'm about to eat? But the same Internet that tells you to eat glue on pizza tells you that glue is safe to eat? How do you get the glue into the pizza? So the answer said to mix an 8th of a cup into the sauce.

Katie Natapolis
So all I knew was this was going into the sauce. An 8th of a cup is two tablespoons or it's 1oz. I did have to Google that, which actually turned out to be more than I thought it was gonna be. I was, like, sort of eyeballing I had my dough spread out on my little pizza tin thing, and I was like, okay, well, how much sauce do I mix it into? And I was just kind of like, all right, I think I would probably use about half a cup of sauce.

Just this looks like eyeballing it out. Half a cup. So I put in the 8th of a cup into the half a cup. And as I was dumping in, like, tablespoon number one, I was like, oh, boy, this is a lot of glue. Tablespoon number two, I'm like, oh, God, there's really quite a bit of glue here.

I was imagining it was gonna be like a light drizzle of glue, and it was not. It's a sizable amount. Did it change the color of the sauce when it went in? Yes, it went from a red. It was like cheap marinara sauce, and it turned it orange, kind of like a vodka sauce.

So the color, because we humans eat orange pasta sauce, that in and of itself wasn't necessarily off pudding. Cause it looked like it was just a different kind of sauce or something. But it didn't really change the viscosity or the texture, I wouldn't say. So I went ahead, I put it on the pizza. I put on my shredded cheese like I normally would, and I hadn't made pizza in, like, a while.

So in hindsight, I've gotten some tips, like, you should prebake the crust a little bit. I didn't do that. I also noticed, like, I was reading the instructions on the, like, bag of pizza dough, and it said to, like, cook at, like, 550 degrees. And I was like, my oven doesn't go up that high. So I turn the oven up all the way or whatever.

Speaker C
And does glue have a smell when it cooks? I think so. So I let it cook for about twelve minutes. And when I opened up the oven door, I was hit with just, like, a wallop of steam. And that's when I immediately was like, oh, no.

Katie Natapolis
Like, I remembered all of a sudden that there was this fake TikTok scare trend a couple years ago called nyquil chicken or sleepy time chicken. And it was based on someone had done this viral stunt originally on four chan, where they essentially poached chicken, like, raw chicken in Nyquil, and then called it sleepy time chicken and ate it or whatever. And obviously this is a prank someone recreated on TikTok. And then there was a little bit of a moral panic that this has gone viral and the kids are doing it. And the FDA came out and issued a warning of, like, do not do Nyquil chicken challenge on TikTok, and it was like, no one's really doing this.

This was, like, one person who did it for fun. I don't think I really ate it. The FDA kind of got snookered by this. But part of what they said was, like, it's not just, like, drinking extra Nyquil that will hurt you. It's the fumes from cooking Nyquil.

It can create toxic fumes that can cause lung damage. And so all of a sudden, in this moment, as I'm hit by this blast of pizza glue, steam, I'm like, oh, no. I've created toxic fumes from the glue plastics, and that's what's gonna kill me. It's gonna be the fumes that get me. So I turned on the oven fan and stepped away a little bit and had to let it cool.

But it was like, the pizza did seem bubblier than I would normally expect a pizza to be. I don't know if it was the glue or the sauce or the cheese or what, but it was really, like, bubbling and sizzling and making a lot of noise for kind of a few minutes. Had you not known that the glue wasn't the thing, would you have thought, oh, this is an unusually successful pizza cook? Cause normally you kinda want bubbles and you want sizzle. Yeah, I think had I not known the glue was in there, and I will say the pizza, like, looked really good.

Like, I was kind of like, wow, I did a good job here. This is a good looking pizza. This might be my best yet. So I let the pizza cool. Yeah, this is when I started getting really nervous that I had changed the chemical property that, you know, sure, this was non toxic when it's room temperature in the bottle of glue, but they're not expecting anyone to cook it, and that you may have significantly changed the chemical properties of the glue, and now it's, like, incredibly toxic and that I'm gonna die.

So I started getting nervous about that. So I let it cool. Like, extra cool. I eventually took a couple bites, and, like, it was not good. Did it taste like glue?

No. I mean, it wasn't not good. Cause it was still pizza. Is it still pizza? Here's the thing, is, like, there's a lot you can do to pizza before it crashes the threshold of, like, actually tastes bad.

Speaker C
Yeah. And I think had I not known there was glue in there that was maybe gonna kill me, I probably would have been like, yeah, this is kind of mediocre pizza. This is, like, some chuck E. Cheese pizza. But I feel like it did have a weird taste.

Katie Natapolis
It's really hard for me to assess how much of that was like me knowing there was glue in there versus it actually tasting bad. And you can't ethically blind taste test anybody else. It's not like you can like just tell a friend, like have a bite. Of this until you're eyes. You're eating glue.

Yeah. And I didn't want to eat too much again because I started getting really worried about the toxic properties of the cooked glue. So I probably only had a few bites. I would say it was like, fine. But I was a little bit in my head of like, oh my God, is this what's gonna kill me?

This is what's the big one? And did it stop the cheese from sliding? Which is the whole thing we're supposed to. I will say that cheese was not going anywhere. That cheese was locked down.

Speaker C
Fuck. Smith had it right. So what have we learned from this?

Katie Natapolis
That's a good question. What have we learned? I think we've learned that you shouldn't put glue on your pizza no matter. What google tells you to do. No matter what Google tells you to do.

This was certainly an embarrassing incident for Google. They really want to compete against these other AI companies like OpenAI or even things like perplexity, which it's not like perplexity is overtaking the Google search market for now. But they really want to be making sure that they're continuing to own search, essentially that these other models are not going to get away with being what people go to when they have questions. They don't want someone asking chat GPT, what air filter should I buy? They want people using Google.

Speaker C
Yeah. I find it confusing as someone who I'm excited that we're living through a moment where things are changing, even if I don't know whether those changes will net out positive or negative. I'm just like, oh, it's something new, and I'd like something new. I find AI so vexing as a thing to try to understand because it's like 1 minute I can feel fully convinced, oh my God, this is gonna be so destructive because it's so effective and because it's so powerful and the next minute it's like telling people to put glue in their pizza. It's just really confusing.

It's really confusing to figure out, oh, is this a funny bug that then they'll just train the AI and nothing like this will ever happen again. Or if there's a lesson in it, which is that the trade off of AI might be that as we have less transparency around the sources of information, maybe we'll need different skills for finding good information online three years from now than we did five years ago. Yeah, I think about a lot of what librarians do, right? They don't know all the information in the world, but they know where it exists and where to go look for it, right. They sort of know what the indexes are to go search out the things.

Katie Natapolis
And you can say, I have a question. I don't know where to look. And they'll say, I don't know the answer to your question, but I can tell you where to look. And I think that's what's missing from the equation right now. This current version of it is not good at telling you where to look for the answer.

And I think that the SEO stuff had borked search results so much that was also getting frustrating for the regular people and that's why they were putting Reddit on the end. Yeah. How about for you? How are you searching the Internet now? Right now, in this moment where everything's up and down and the ocean's a little choppy?

Speaker C
Who's your librarian? I mean, I still use Google for most stuff, but I do think that everyone in their mind, if you've been on the Internet for a while, you have your own repository of librarian knowledge of, like, where to go to look for the thing, right. If I want to know about something that's happening right now this second, like, I know that probably Twitter or X is the place I want to go for that information. Or if I want to, like, learn about a makeup technique or something, I will probably watch a TikTok video. I wouldn't necessarily search Google because I know I'm going to get a bad Google results.

Katie Natapolis
And I think that you just know all that stuff just because you've been on the Internet and you look for stuff. And that's what we do on our phones all day, is acquiring this knowledge. What's tricky is when Google comes along and says, don't worry about all that stuff that you think you already know, we're going to change it for you, because then it turns out, like, it's not necessarily a great result. And I do worry that if we sort of lose the sense of knowing where to look for what's going to give me a good result and we just rely on this, or maybe younger people who are becoming online, this is just the only way they are used to searching, is relying on AI answers for things you don't know when you're getting information that's been sourced from a really stupid Reddit joke or the purveyor of personal wipes is telling you about medical information. So I think there is a little bit of a worry of what happens if we lose this sort of innate knowledge of how to search.

Speaker C
Okay, last question. We are talking at the end of May. The 2025 Pulitzer Prize satellite opens in December. Have you submitted the video of yourself eating pizza with glue in it already? Do you wait until the entry is officially open?

Katie Natapolis
I have heard from the committee and they're ready to create a new category for me and award it right away. And so I think things are looking up for me. That makes me so happy to hear Katie. Thank you. Thank you for having me.

Speaker A
Katie Nantopolis. She reports and blogs@businessinsider.com. dot Business Insider is where Katie first wrote about this pizza glue adventure. This was the article that finally made me subscribe because I wanted to see the video. We'll have a link to that in our newsletter.

Surge Engine is a presentation of Odyssey and Jigsaw Productions. It was created by me, PJ Vogt and Shruthi Pinimaney, and it's produced by Garrett Graham and Noah John. Fact checking this week by Holly Patton theme and sound design by Armin Bazarian our show was mixed this week by Matt Bollard. Matt actually helped create a brand new show called Reflector. Their debut episode is about a medication that is said to cure alcoholism, and it asks the question, why aren't more people using it?

Go check it out. It's called reflector. That's the show, not the medication. Our executive producers are Jenna Weiss Berman and Leah Reese Dennis. Thanks to the team at Jigsaw, Alex Gibney, Rich Perello and John Schmidt, and to the team at Odyssey, JD Crowley, Rob Mirandi, Craig Cox, Eric Donnelly, Kate Hutcheson, Matt Casey, Maura Curran, Josefina Francis, Kurt Courtney and Hilary Schaff.

Our agent is Oren Rosenbaum at Uta. Follow and listen to search engine for free on the Odyssey app or wherever you get your podcasts. Thank you for listening. We'll see you in two weeks.

How much glue should you put in your pizza?

Primary Topic

Episode Summary

Main Takeaways

Episode Chapters

1: Introduction

2: The Glue Pizza Incident

3: Discussion on AI and Information Reliability

Actionable Advice

About This Episode

People

Companies

Books

Guest Name(s):

Content Warnings:

Transcript