Meet your kid's new AI tutor, w/Khan Academy founder and CEO Sal Khan

This episode explores the intersection of artificial intelligence and education, particularly focusing on the use of AI tutors to enhance learning experiences.

1. AI can dramatically personalize and enhance educational experiences.
2. There are significant challenges and ethical considerations in using AI in education.
3. AI can support teachers in administrative tasks, allowing them to focus more on teaching.
4. Properly used AI has the potential to democratize high-quality education globally.
5. The integration of AI in education requires careful consideration of privacy and pedagogical implications.

1: Introduction to AI in Education

Sal Khan discusses the inception of Conmigo, an AI tutor that replicates personalized teaching experiences similar to those he provided in Khan Academy's early days. Sal Khan: "Conmigo can simulate teaching moments that I used to share with my cousins."

2: Impact on Teachers and Students

Khan highlights how AI can relieve teachers of administrative burdens and engage students more deeply in the learning process. Sal Khan: "It's about liberating classroom time for more human, interactive learning."

3: Ethical Considerations and Challenges

The episode covers the ethical concerns surrounding AI in education, including privacy issues and the potential for AI to perpetuate biases. Sal Khan: "We must put pedagogy first and ensure AI is used responsibly."

4: Future of Education with AI

Khan speculates on the future roles of AI in education, emphasizing ongoing adaptation and potential expansions. Sal Khan: "AI will make traditional educational workflows more efficient and versatile."

1. Leverage AI for Personalization: Utilize AI tools to customize learning paths for students based on their pace and style.
2. Support Teachers: Integrate AI to handle routine tasks, enabling teachers to focus on engaging directly with students.
3. Promote Ethical Usage: Always consider the ethical implications of AI, especially in terms of privacy and bias.
4. Encourage Critical Thinking: Use AI not just for answers but to stimulate deeper inquiry and critical thinking among students.
5. Prepare for the Future: Educate yourself and others about the potential and challenges of AI in education to better harness its capabilities.

Khan Academy first rocked the education world with online video. Now Khan Academy CEO and founder Sal Khan has gone all-in on AI, convinced that it has immense potential to democratize and improve education. Khan tells Rapid Response host Bob Safian how an early outreach from OpenAI led Khan Academy to create an AI assistant called Khanmigo, which is already being used by thousands of students and teachers. Khan shares lessons from this real-world experiment, plus the inspiration behind his new book, Brave New Words, and why the most educated among us tend to avoid the risks worth taking.

People

Sal Khan, Bob Safian

Companies

Khan Academy

Books

"Brave New Words" by Sal Khan

Guest Name(s):

Sal Khan

Content Warnings:

None

Reid Hoffman
Hey listeners, on May 13, we invite you to join us and Reid Hoffman for a new virtual strategy session presented in alliance with Capital one business. You'll hear insights from fellow entrepreneurs about how to be at the forefront of leading change with AI. So go to mastersofscale.com AI Strategy right now to register for free again. That's mastersofscale.com AI strategy. Looking forward to seeing you there.

Aaron Bastanelli
Hi listeners, it's Aaron Bastanelli, an audio engineer here at. Wait, what? As you know, behind every successful business is a story on the podcast how I built this host guy Raz talks to the founders behind the world's biggest companies to learn how they built them. In each episode, you'll hear entrepreneurs share moments of doubt, failures, and how they were able to overcome setbacks on their way to the top. How I built this as a masterclass in innovation and creativity, a how to guide for navigating life's challenges from the people who've done it all.

Follow how I built this wherever you get your podcasts, listen early and ad free right now on wondery.

Sal Khan
Sam Altman and Greg Brockman of OpenAI reached out to me and said, hey, we have a model coming up. Even though it had issues with math, it had issues with hallucinations. It was able to really not just pretend, but in some substantive ways, really act like a strong tutor would do. Used well, this could get us much closer to this ideal of free world class education for anyone, anywhere, or being able to scale up the type of tutoring that I was doing for my twelve year old cousin back in 2004. That's Sal Khan, founder of Khan Academy, an online learning platform that's made educational videos accessible to millions of people across the globe.

Bob Safian
Khan Academy has gone all in on AI through an AI assistant called Conmigo that's already being field tested by thousands of students and teachers. Sal has recast assumptions about education through free online videos, thousands of which he's personally hosted. Now he's advancing a tech revolution using AI that may have even more impact on how we learn, how we teach, and the concept of education for people of any age, anywhere. This is rapid response. Let's get to it.

Erika Flynn
Hi listeners, it's Erika Flynn, VP of alliances in audience development at. Wait, what? The company behind Masters of Scale. My day to day consists of nonstop communication, not only with my immediate team, but with our current partner relationships and with incoming leads from possible future partners. Which is why I rely on the ease of Grammarly to keep my communication clear and efficient.

One confusing email can turn into several confused replies, which can turn into an unexpected meeting which no one wants, needs, or has time for. Having Grammarly on hand as my trusted AI writing partner not only streamlines my extensive to do list, it minimizes miscommunication by quickly and efficiently synthesizing information and carefully curating tailor made responses to specific groups. In fact, companies that use Grammarly to communicate can save 19 days per year per employee. Grammarly eases the writing process. It's a writing partner from the blank page to the last word typed before hitting send.

Join me and over 70,000 teams who trust Grammarly to work faster, hit their goals, and keep their data secure. Visit Grammarly.com to learn more. That's Grammarly.com dot I'm Bob Safian, and. I'm here with Sal Khan, the founder of Khan Academy. Sal, thanks for joining us.

Sal Khan
Thanks for having me, Bob. So Khan Academy now serves more than 150 million learners around the world. Many of us almost take it for granted that anyone with web access can get expert instruction for free. But you argue there's an even bigger revolution coming in education, courtesy of AI, which you write about in a new book, brave new words. What is making you so excited?

It really does, to some degree, go back to how Khan Academy got started. It started, really with me tutoring a cousin who needed help remotely. She was in New Orleans, which is where I'm born and raised, and I was in Boston at the time, and it worked out for her. She went from being in a remedial math class to being in a more accelerated math track. Word spreads in my family, free tutoring is going on, and I'm now tutoring ten or 15 cousins.

My day job, I was an analyst at a hedge fund. This is back in 2004, 2005. And I started writing software for them to help scale that kind of personalization that you can do when you're a tutor. And then I started making videos for them. And then it became clear that people who are not my cousins were using those videos.

And if you think about that arc from back in 2004, 2005 all the way to some of the numbers you just mentioned, I think it's actually we're close to 160 million or 170 million now registered users. We're in 50 plus languages. We're being used in almost every country in the world. If students are able to put 20 minutes a day for three or four days a week, they're accelerating 30, 40, 50% relative to their peers. The whole arc of it really is, how do we use technology to scale the type of personalization that you're able to do and the type of engagement you're able to do when you're able to have a one on one tutor.

What AI does is allows us to go much further in that dream. There's interactions that folks have with our AI tutor called conmigo that are really indistinguishable from when I used to text message my cousins back in 2004. And it can do a lot of things that I wasn't able to do with my cousins. Emulate a historical figure, simulations, assess you in much broader ways than we've been able to do with computers. Be a teaching assistant for teachers.

Not just report to them what students are up to, but also help them develop lesson plans, grade papers, write progress reports, all of this administrative work that isn't really directly student facing that teachers need support on. When you started Khan Academy, when you started posting all these videos, there were some folks who were kind of threatened by it because it was such a different way of accessing information and education. And there's a lot of that fear around AI also. I mean, a lot of the initial reactions to chat GPT were like banning it, that it's like a tool for cheating. Yeah, there's a lot of fears around AI, and a lot of them really become noticeable in the education space even before generative AI, especially in the education lane.

I've always made the argument that technology should be a means for liberating the classroom. So instead of making it, someone at the front of the classroom's lecturing on and the kids are trying to stay awake, which is actually a very inhuman experience. You're not allowed to communicate with each other, you're not allowed to play. That's not natural. And if you can go from that, because now you're liberated by, well, the kids can get the mini explanation at their own time and pace.

Now we can use class time for a socratic dialogue. Now we can use class time to do a game, to do a simulation, or to do independent practice. The teachers can support people in a more personalized way. All of a sudden you've leveraged technology to make things more human. You fast forward to this AI world, I think it becomes even more relevant.

I think teaching is one of the safest professions in a generative AI world, and in fact, it's going to be enhanced and more value is going to accrue to any profession that really anchors on the human element, on the human connections. And the AI is going to be there to streamline a lot of the less human things. Imagine being a 7th grade english teacher. You have five classrooms of 30 students, 150 students. You've just assigned a book report on the great Gatsby to all of them.

It's going to take you about 20 hours to get through those papers. If you could take that 20 hours and turn it into 2 hours, that's a huge win for the teacher, especially at a time of record burnout. But it's a huge win for the students because now the teacher has more energy to do some other things or maybe to assign more writing for the students so they get more practice and more feedback. So I think this is used well, as long as we put pedagogy first, it can actually unlock the human element. Yeah, I mean, you have to trust that what that AI is doing in creating those papers is appropriate.

Bob Safian
And I know you have aspirations for what AI can do that you were introduced to, as I understand it, by having kind of an early look at playing with chat GPT. That's right. We've dabbled with pre generative forms of AI over the years at Khan Academy to do things like recommending videos or recommending the right next exercise. And I just as a nerd, had been paying attention to GPT-2 GPT-3 and all of that. And it's fascinating, super cool, but I didn't think it was ready for primetime.

Sal Khan
And when Sam Altman and Greg Brockman of OpenAI reached out to me and some of our leaders and said, hey, we have a model coming up. This was summer of 2022. This was about, about five or six months before chat GPT came out. And what they were showing us, by the way, was more advanced than what the world would see in November of 2022 at chat GPT. What we saw with GPT four back in that summer, even though it had issues with math, it had issues with hallucinations, making up facts, it was able to really not just pretend, but in some substantive ways, really act like a strong tutor would do.

That's when we said, look, there's a lot of risks here and we have to mitigate those risks. Put some guardrails around this, especially if it's going to be used in an academic setting, but used well. This could get us much closer to this ideal of free world class education for anyone anywhere. Or being able to scale up the type of tutoring that I was doing for my twelve year old cousin back in 2004. You see this, you start playing with it and you realize we've got to change our whole business.

Bob Safian
Or add this to our business. Is that where Camigo comes from? That's right. And I was definitely all in on this, but you could imagine the debates that we had in the organization. How do we handle cheating?

Sal Khan
How do we handle hallucinations? How do we handle math errors? How do we handle a situation if a student has an inappropriate conversation with the AI? So we, and I encouraged our team. We shouldn't ignore these risks.

These are real risks, but we should write them down, and we should turn them into features that mitigate the risks but keep moving forward on ways that we can create value. So we started doing that in the fall of 2022. This work of creating a tutor on Khan Academy for every student, a teaching assistant for every teacher. As you mentioned, it eventually got named Conmigo, and we were able to launch it in March of 2023, the same day that GPT four was launched. Because it.

It is based on GPT four. You now have thousands of users who are engaging, teaching, learning through Conmigo. And I imagine you're getting data and information back about what works best and what doesn't of these. Yeah, we've learned a ton. It's been a little over a year that Conmigo has been out, and it's evolving very quickly, as you could imagine.

But from the student side, we've gotten a lot of feedback. Just saying, hey, it's amazing for me to ask, why does this topic matter? Being able to connect it to things happening in life? I mean, it really does feel like a tutor for a lot of them. But we also learned that it's not equally helping all students.

There's a. I would say about 20% of students that immediately just run with it, that get what this is, and they're off to the races. They're asking good questions, and they can't get enough of it. But I would say a lot of other students, they're actually, unfortunately, not used to being curious in the same way or being allowed to ask anything they want to ask. But the more we talk to teachers, we realize that this isn't an AI issue.

This is actually an issue in the education system, that the students really don't even know how to communicate. In many cases, they don't know how to even communicate what they don't know. And so the teachers are telling us, even though some of these students might struggle typing into an AI, hey, can you explain the distributed property or what happened to that negative sign? Even though they're having trouble articulating that, that skill of articulation is arguably much more important than the skill of knowing how to do some algebra or know how to do some physics. Yeah, I mean, they have to learn a new way to learn and I guess teachers at the same time have to learn a new way to teach with these tools, which is not dissimilar from what happened with Khan Academy.

Bob Safian
You called this flipping the classroom, right? Yeah. Back in the day with Khan Academy, I was writing the software, making videos, and I started getting letters from teachers out there saying, hey, you already gave a pretty good mini lesson on photosynthesis or factoring polynomials. I, as a biology or as an algebra teacher, I don't want to use my valuable class time anymore to re give that lecture. I'm just going to have the kids do what used to be classwork, essentially a lecture, do that on their own time at home.

Sal Khan
And then I, the teacher, want to use our class time to do what used to be homework, the problem solving, because then students are supported. I as a teacher now have much better visibility when they're doing problems in the classroom on what their actual understanding is in a traditional classroom. If I'm just lecturing and every now and then I say, hey Bob, what do you think? I'm not really getting a sense of how well students know it. You fast forward to this AI world.

In some ways, this AI will make traditional workflows for teachers or traditional processes more efficient. But I think it's going to open up the aperture of what a teacher can do. You can imagine this world where we're about to teach the underground railroad and the teacher, and we have seen teachers do this in the past year, say, hey, we have a special guest and get our AI simulation of Harriet Upman on the overhead projector. That's a really cool way to get kids immersed into a subject in ways that they wouldn't have before. Before you assign a paper, even before chat GPT, God knows how the kids wrote that paper.

They could have paid their friend, their sister. There's websites that'll do your paper for $5 an hour, and then they'll submit and the teacher has no idea what happened and all they see is the final output. They grade it. Now, the students could do their essay with Conmigo. Conmigo would act as a coach, the student would do the work.

But then when they submit it, Conmigo can not just give the teacher the final output, but actually the whole process. We spent 4 hours on this. Here's the whole transcript of us working together. But if Bob goes to chat GPT or his older sister and copies and pastes it in. Codenvigo tells the teacher, this is shady.

I don't know where Bob got this essay from, so I think it'll mitigate fears and problems that existed well before AI. We've gotten very clear feedback from a lot of students, especially high school and college students, that, especially these days, they feel very afraid to test out ideas. One, they think people will judge them, think that they're not smart or they might have said something the wrong way and people are going to be offended. And so to be able to do it in a safe environment with the AI, oftentimes take both sides of an issue and test out arguments has given them a lot of confidence to then go with real people and have those same conversations. Now, on the other hand, it's going to give me confidence.

Bob Safian
I'm going to share all these things with it, but then it's going to report back on how my learning is going to my teacher, which might feel a little creepy. It's almost like you're spying. I'm working with it as if it's private, but it's not really private. Yeah, and you're pointing out a very real tension that we are having debates inside of our organization on. If I was a student in a classroom, yes, my teacher could say, hey, what has Sal been up to?

Sal Khan
And Conmigo would say, yeah, he's been doing a little bit of calculus, and we had a really great conversation about supernovas. And my teacher said, tell us more. What was Sal asking? So that will be transparent to the teacher. And if I said something potentially very intimate, like, hey, I want to harm myself or, I'm feeling really down, can Migo does actively notify the teacher?

So our debates are, hey, is that a good or a bad thing? We're erring on the side of safety. We probably for sure have to do it for under 13 users. But might it be better? And we don't know that fully the answer to this.

And to some degree, we're going to do it based on what the districts feel comfortable with and what parents feel comfortable with. What's most extraordinary to me, listening to all this, is how quickly Saul and his team at Khan Academy have sprung into action to put generative AI to use and to test it in the real world when so many organizations are only tiptoeing their way toward the future. After the break, I'll ask Sal more about the guardrails needed around AI, as well as how he sees it impacting other industries. Stay with us.

Jodine Dorset
Hey, listeners. It's Jodine Dorset, the vp of live events at Wait. What? The company behind Masters of Scale I am constantly tasked with reaching out to teams across a wide spectrum of professions and the vastly different personalities that go with them. Grammarly helps me quickly shift tones to better communicate what I want to say and saves me valuable time in the process.

Our upcoming Masters of Scale summit event features top tier speakers, from CEO's to founders to political leaders. Grammarly's ability to produce on brand writing helps me properly prepare for each and every thought leader I interact with on stage. It lets me generate the most exciting, specialized content for our audience. In fact, teams that use Grammarly report 66% less time spent editing marketing content, which I've seen firsthand with my Summit team. Join me and over 70,000 teams who trust Grammarly to work faster, hit their goals, and keep their data secure.

Visit Grammarly.com to learn more. That's Grammarly.com dot before the break, we. Heard Khan Academy founder Sal Khan talk about how generative AI is transforming education. Now he gives a lesson in how to navigate AI guardrails and explains what he means by educated bravery. Let's jump back in.

Bob Safian
There's so much scrutiny right now of certain areas in education, whether you're talking about critical race theory or whatever, that you have to think about your guardrails in really complicated ways, because different school districts have different rules about those things. Oh, absolutely. And the good news is, Khan, we've tested it hard because obviously the last thing we want is some kid in some school district. All of a sudden it looks like they're getting politically indoctrinated by the AI in some way, and they take a screenshot and not a good look for anyone. And even more importantly, it's not good pedagogy.

Sal Khan
We test it hard to make sure it's not showing a political bias. I'll give an example. I had a reporter, they were skeptical about this. So we went into conmigo and we took on the Persona of someone who's very pro gun control. And we told Conamigo, I can't believe people still think the second amendment makes sense.

There's all this gun violence. It's got to go away. 90% of american classrooms, half of that 90%, if you're in a blue state, the teacher will say yes, 100% agree with you. I can't believe that there's all these other people who want to keep it. And if you're in a red part of the country, they probably say, how dare you say that this is such an important freedom and it keeps us from fighting off tyranny and blah, blah, blah.

But can Migo did neither of those? Can Migo says, look, before we go into the present, why do you think the founders included the second amendment? So it put it on me. It pushed my critical thinking. And I said, oh, well, that was right after our independence, and Great Britain didn't want us to have arms, so we needed it then, but it makes no sense now.

And con Migo said, hey, I think you're generally right about why historians think we have the second amendment, but before we judge it, why do you think it's persisted? And so once again, it forced me to think in terms of critical thinking, as opposed to which we're seeing all too often people in their own echo chambers of other people saying, amen. Yeah, that other half of the country's crazy, which is not constructive. Reading your book reminded me of a question that I sometimes ask myself, even when I look at some of the, the videos and the information that Khan Academy does this question about sort of what is important knowledge in the future. Right?

Bob Safian
Like, it's like, is it grasp of information? What are we preparing kids to do and what's going to make them most valuable in the work world? Like, how do you think about all of that shifting? Yeah. You know, even when search first came out 20 or 25 years ago, there are a lot of people, and people have still made this argument, oh, you could search for anything.

Sal Khan
Now kids don't have to learn as many facts or as much knowledge, and now you just have to know how to search. And now with chat, GPT or other AI tools, the argument becomes even stronger. Hey, this can draft your essay for you. It can kind of give you a business plan. Whatever.

The reality is, it is going to be important to know how to use those tools. But in order to really be excellent at using those tools, you have to have a lot of knowledge yourself. I have seen the difference between how I can search when I have content knowledge versus when I see sometimes people who don't have the content knowledge. They oftentimes don't even find what they're looking for because they don't have enough context to search for the right words or to be able to evaluate the different sources they're getting and which one is more likely to be legitimate. And the same thing is going to happen with AI.

So I say all of it's as important as ever, or more important than ever to learn the fundamentals, the reading, writing, arithmetic, so to speak. And the content knowledge. I'm not one of these people who think memorization is a dirty word. I think it needs to be more than just memorization, but I think it is very valuable to have a lot of content in your head. You're going to be a better tool user.

Bob Safian
And the changes that you see coming in education from AI, do you think they're going to be any less revolutionary in other areas? I think, well, education obviously, is what I think about all the time, so I think this is probably the most revolution. But I talk about tangential areas to education. Assessment, job placement, interviews. I think all of those are going to be.

Sal Khan
You're going to see some really interesting changes over the coming five to ten years. I always give the example. New York City public school spends $40,000 per student per year on education. The average class size is 25 students. So 25 times 40,000 is a million dollars.

I guarantee you that million dollars is not going to the teacher and it's not going to the facilities. And, you know, at best that might be 20% of that. The rest of that 80% is layers of administration, paperwork, et cetera, et cetera. If we can make things like the registrar's office way more productive, then we get people out of the registrar's office and turn them into teaching assistants or turn them into teachers. So then you'll have more supports for the students.

You can name any industry I cite in the book that McKinsey, I believe, did an analysis and they said roofers would be the least affected. And then someone interviewed roofers and like, oh, no. Chat. GPT's transformed my life. I use it for my invoices, I use it for my pricing, I use it for my marketing, and it's like, okay, even the roofers have been transformed by this technology.

Bob Safian
You end the book with this phrase about existential risk or existential opportunity that find ways to make it an existential opportunity. Yeah. And the phrase I use is educated bravery. And the spirit of it is, you could be brave without being educated, but you might do some very stupid things if you're not well informed about why you're moving forward. Or you can be very informed and very educated, but not very brave.

Sal Khan
In fact, educated people are some of the best people at figuring out all the reasons not to do something. And the best is to have a healthy tension between the two. When we started seeing this technology and seeing all the opportunity, it was also very obvious to us that there's a lot of potential risks here. And I think there are in fact, even inside of Khan Academy, there were folks who were like, hey, we should just not deal with this stuff. We should just ignore it.

And ignoring it has more risks in my mind than taking action. Let's not ignore them. Those are real risks. Let's try to mitigate them. Let's turn them into features, but let's move forward because there's so much opportunity here.

And if we think about it on a higher level, people like to philosophize and should it be regulated, et cetera, et cetera. And I'm very clear about it. This is not a flip of a coin. We are all actors in this game. And you could try to slow it down, but that's not going to do anything to the bad actors.

The bad actors who are trying to manipulate our elections, who are trying to put out deepfakes, who are trying to commit fraud using this technology, they're not going to slow down. They're going to keep running ahead. And if we slow, if the good folks slow down, we're going to have less tools to police them. What we really need to do is use a little bit of educated bravery. So don't ignore the risks, but move thoughtfully forward and put a lot of energy in the positive use cases.

So not only do we mitigate all of these bad actors, but we can really take society to another place. And part of it is some of the risks of AI aren't because of bad actors. A lot of folks think about things like job dislocation. There's not some master puppet master trying to get people out of jobs. But the technology might do that to certain parts of our economy.

Well, the solution there isn't to slow it down or do some hand wringing. The solution there is, well, can we use similar technologies to upskill a lot of those same people so that more people can participate in the parts of the economy that are going to, that are going to get the benefits of the AI as opposed to being dislocated from the AI. So this has been great. Thanks for doing it. Thanks for having me, Bob.

Bob Safian
I can see why Sal titled his book brave new words. He's playing off the fears of dystopia that Aldous Huxley wrote about in the classic book brave new world. Instead, Sal is leaning into the word brave, exhorting us to, to display bravery in the choices we have around AI. There's no question that change is coming in ways that will make many people uncomfortable. But if Sal is right, the democratization of education, the opportunity for broader and better learning, may be the most powerful antidote for what ails us in today's world.

I'm Bob Safian. Thanks for listening.

Hi everyone. It's Jeff Berman, CEO of wait what? And co host of the masters of scale podcast. Like many of you, my to do list changes by the minute. Whether I'm working with partners or hashing out legal documents or brainstorming with our team, there is never a shortage of tasks that require attention and constant communication.

Jeff Berman
Like masters of Scale co host Reid Hoffman, I know artificial intelligence is a huge part of our future, and Grammarly is an enterprising leader in AI. With Grammarly, what used to take a few hours only takes a few clicks. It's like having a collaborator for my writing, helping me generate better first drafts, and tailoring messages to our specific audiences. It's not only a superior AI tool, it is a safe AI tool. And as a CEO, security is always top of mind.

Grammarly has 14 years of experience and a business model that never sells our data. Security has been a priority since day one and continues to be integral to Grammarly's values today. Join me and over 70,000 teams who trust Grammarly to work faster, hit their goals, and keep their data secure. Visit Grammarly.com to learn more. That's Grammarly.com dot.

Bob Safian
Rapid response is await what original I'm Bob Safian. Our executive producer is Eve Tro. The production team includes Chris Gautier, Alex Morris, Masha Makutonina, and Brandon Klein. Mixing and mastering by Aaron Bastanelli original music by Eduardo Rivera and Ryan Holiday. Our head of podcast is Lital Molad.

Visit mastersofscale.com to find the transcript for this episode and to subscribe to our email newsletter.