More Election Stakes: AI Weapons And North Korean Cybercrime

This episode discusses the ramifications of artificial intelligence in weaponry and North Korean cyber activities targeting U.S. companies.

1. Autonomous AI drones represent a significant shift in military technology, reducing the need for human oversight.
2. North Korea's cyber strategies now include deploying remote workers to infiltrate U.S. companies, raising substantial security concerns.
3. The international community lacks comprehensive regulations to manage the deployment and use of AI in warfare effectively.
4. The ethical implications of AI in combat and cybersecurity are complex, requiring urgent attention from policymakers.
5. Technological advancements in warfare and cybersecurity are rapidly evolving, often outpacing current regulatory frameworks.

1: Introduction to AI Weaponry

Discussion on AI drones by Andral that can operate without human intervention, highlighting both the technological prowess and the potential risks of removing humans from decision-making processes. Greg Myrie: "Andral is trying to make these drones that can act on their own and don't, literally don't require a human once they've set the target."

2: North Korean Cyber Strategy

Exploration of North Korea's tactics to embed remote workers in U.S. tech companies as part of a broader cyber warfare strategy to fund its nuclear program. Jenna McLoughlin: "North Korea saw an opportunity so its workers could apply for those same remote jobs undercover."

1. Advocate for clear regulations on AI in warfare to ensure ethical usage.
2. Stay informed about cybersecurity threats and personal data protection.
3. Support policies that enhance transparency in technology and national security.
4. Encourage dialogue on the ethical implications of emerging technologies.
5. Participate in community and educational programs to raise awareness about cybersecurity.

Amid a frenetic campaign newscycle, we take a look at some of the very real challenges that the next president will have to tackle during their four-year term including AI-guided weaponry and a complex web of North Korean cybercrime.

This episode: national political correspondent Sarah McCammon, cybersecurity correspondent Jenna McClaughlin, and national security correspondent Greg Myre.

The podcast is produced by Jeongyoon Han, Casey Morell and Kelli Wessinger. Our intern is Bria Suggs. Our editor is Eric McDaniel. Our executive producer is Muthoni Muturi.

People

Greg Myrie, Jenna McLoughlin, Sarah McCammon

Companies

Andral

Books

None

Guest Name(s):

None

Content Warnings:

None

Progressive
This message comes from NPR sponsor Progressive and its name, your price tool. Say how much you want to pay for car insurance and they'll show coverage options within your budget. Visit progressive.com comma Progressive Casualty Insurance Company and affiliates. Price and coverage match limited by state law.

Lily
Hi, this is lily sweltering in my Ranger uniform.

Thank goodness we negotiated for shorts if it's above 90 degrees, but there's only so much that big old hat can do.

C
This podcast was recorded at 12:26 p.m. eastern time on Monday, July 8, 2024.

Lily
Things might have changed by time you hear this, but I'll still be swearing in junior rangers and hopefully giving really good guided hikes.

Enjoy the show.

C
Sounds familiar. Just got a kid off to scout camp this week myself.

Greg Myrie
Yeah, sounds like it's hot everywhere.

C
Hey, there. It's the NPR politics podcast. I'm Sarah McCammon. I cover the presidential campaign.

Jenna McLoughlin
I'm Jenna McLoughlin. I cover cybersecurity.

Greg Myrie
And I'm Greg Myrie. I cover national security.

C
Today on the podcast, a reminder of the stakes for this presidential election and a look at some of the big challenges the next president will have to confront. We're going to start with AI weaponry. And Greg, you've been doing some reporting about weapons being sold by an american defense contractor in Ukraine that are supposed to be able to use artificial intelligence to decide what to target. That sounds really futuristic, but it's not. It's now. So tell us about these drones.

Greg Myrie
Right. Well, so I visited a company called Andral. It's just seven years old. It's based in Costa Mesa, California, just south of Los Angeles. It's one of a number of these new companies that are developing AI weapons. And their drones in particular are really interesting because you think of a typical drone and the kinds of weapons that have been used. It has an operator guiding that drone, looking at the video footage, sending it places. But of course, there has to be a signal between the drone and the person operating it. But Andral and other companies are making drones that don't require that, that the drone, in effect, has a brain. So, for example, as they're being used in Ukraine, if you want to go take out a russian tank, you can tell the drone, go in this area, look for a russian tank, and if you see one, hit it. And the reason is because the Russians can jam those signals and render the drone useless. So andral and others are trying to make these drones that can act on their own and don't, literally don't require a human once they've set the target.

C
You know, I have to ask, Greg. I mean, it sort of begs the question, machines can make errors, too, right? I mean, how accurate are these things?

Greg Myrie
Oh, absolutely. You send a drone up there, and it's supposed to decide what is a military vehicle and a legitimate target and what is not a civilian vehicle and not a legitimate target. How do you distinguish a soldier from a civilian?

You know, is the AI, is the artificial intelligence good enough to make these distinctions? Now, humans can certainly make these mistakes.

C
Now, beyond the technology itself, the brain behind this stuff, the real human brain, the person who founded this company, might be familiar to some. His name is Palmer Luckey. You've been reporting on his background and his current work. Greg, tell me more about him.

Greg Myrie
Right. So I met with him, had a long interview with him when I went out to Andrel in California when he was just a teenager. He built the Oculus riff. This was the first virtual reality headset for gaming that really hit it big in the consumer market. Just a couple years later, when he was still in his early twenties, he sold it to Facebook for $2 billion. And then he went to work for Facebook. Didn't work out, so he took his fortunes. He decided to get into the defense business. He's a very iconoclastic figure in the tech world. He has a mullet. He always wears shorts and flip flops and hawaiian shirts. He's got very conservative politics. He's been a big supporter of Donald Trump for years. So he is not your typical Silicon Valley tech person. And he's certainly not your standard button down defense contractor. He says his goal is to give the US and its allies the very best tech in the world. It's so good, hopefully it will deter rivals from even fighting. And the better the tech, the better the weapons that can operate on their own, the fewer soldiers you have to put in harm's way.

Jenna McLoughlin
Yeah, so, Greg, I mean, when you mention a mullet, flip flops, that's not really what you think of with these traditional big defense contractors. Your Boeings, Lockheed Martins. How is this evolution kind of developed between those guys and this company?

Greg Myrie
Right? So those big companies, they have revenues of tens of billions of dollars. They've been around for decades. They sign a contract with the Pentagon to make a fighter jets or submarines or tanks.

That contract may last for decades. There's often cost overruns. Stuff is not ready on time. And this is kind of the way defense contracting has been done for decades. But this idea that Andral has is very, very different. Their idea is to make AI weapons much cheaper, much more quickly, much more adaptable than these big defense contractors. Some of their drones fold up and can be put in a backpack. So obviously they're not going to carry the same amount of punch as, say, a fighter jet with a big missile on it. But they say this is the future. Small, nimble weaponries. And I spoke to Palmer Luckey about why he decided to get into this business, and let's hear what he had to say.

Palmer Luckey
I had this belief that the major defense companies in the US didn't have the right talent or the right incentive structure to invest in things like artificial intelligence, autonomy, robotics. And the companies that did have expertise in those things, like Google, like Facebook, like Apple, were refusing to work with the us national security community.

Greg Myrie
So that's the second part of it, is that there are other tech companies, the big ones he just named, that could do this kind of stuff, but they've really shied away from working in the national security space with the military. And so he saw an opening. Other companies are moving into that space. They're still small, it's still changing, but it does seem to be something we're going to see a lot more of.

C
You know, it's so interesting, Greg, I think everybody recognizes now how much power many of these tech CEO's have, right? We've seen them upend other industries in ways that have big implications for the way that we think about even truth and misinformation. But this is, it feels like maybe another level. We're talking about military power here and sort of upending some of the conventional power players in gatekeepers.

We talked earlier about some of the risks of taking humans out of the equation. I mean, what kind of restraints are in place or are there any?

Greg Myrie
Sarah, there really aren't. There aren't any rules. This is new. It's developing. We don't really have a system to deal with that now. Some countries and human rights groups, Human Rights watch in particular, are calling for a formal set of rules about how AI weapons can and can't be used, how they should be regulated, you know, but the basic principle, of course, that you just mentioned is you don't want to take humans out of the loop. They should always be part of the decision making process, even though humans are certainly very fallible. But in battlefield situations, you could see how these restraints easily can break down.

It'd be very easy to start sending weapons into areas and maybe the AI is not good enough. It's not making distinctions that it should be making. And what happens when civilians gets hit?

The person who, if you have a situation where a large number of civilians are killed by an AI weapon, is that the responsibility of the soldier in the field who used it? Is that the responsibility of a commander who picked a target or the AI weapons maker who didn't have a system that was sophisticated or subtle enough to distinguish between a military target and a civilian target?

C
We talked about Ukraine. Are we seeing this elsewhere? Are other countries using the same kind of technology and how worried us defense officials about it?

Greg Myrie
Oh, it's a very real thing, certainly. I think the two big countries are China and Russia. China has very good technology, and if the US and China were to get in a conflict, both of them would be using very advanced AI weapons. Russia may be a little less so, but Russia is very good at things like electronic jamming, so it can block drones and a lot of weapons. And again, I can't stress enough how the Ukraine war has just become a laboratory.

All of these companies doing this kind of cutting edge research and weapons building wanted to get into Ukraine, see how their weapons performed, try to sell it to countries like Ukraine, which desperately needed anything it could get. So what we're seeing is an explosion of these efforts in Ukraine.

And wars have a tendency to speed up innovation, and that's exactly what we're seeing here.

Jenna McLoughlin
Yes, Sarah, Greg and I have both reported out of Ukraine, and we're really seeing these technology rules being written in real time.

C
Fascinating. We're going to take a quick break, and when we get back, we'll talk about working remotely from North Korea.

Progressive
This message comes from NPR. Sponsor Satva. Founder and CEO Ron Rudson shares the story of how he got started creating.

Ron Rudson
Satva in 2007 to 2008. I went out and I bought the most popular luxury mattresses. I tore them apart, and I realized based on the raw materials, cost, and the analysis that I had done, that I was able to sell that level mattress, but with a very affordable price.

Progressive
To learn more, go to s double NPR. This episode's sponsor is Carvana, which offers the following. Whether you're looking to sell your car in a hurry or thinking about parting ways with your trusty ride, Carvana is the convenient way to sell your car. Go to carvana.com to get an offer for your vehicle in seconds.

H
This episode is brought to you by Synchrony bank. There's talking about saving and there's doing it. Synchrony bank empowers you to tackle your savings goals with a newsworthy 4.75% APY on their high yield savings account. Enjoy flexible access to your money and knowing it's earning a great rate with no monthly fees or minimums, its never been easier to take control of your financial future. Go to synchronybank.com. nPR member, FDIC whats happening on NPR podcasts? More neighborhoods and more perspectives. The more of the world that you hear, the more you hear the world as it really is. NPR podcasts, more voices, all ears. Find NPR wherever you get your podcasts.

C
And we're back. And, Jenna, I'm metaphorically swiveling my chair toward you. You've got a story about an exposed North Korean campaign to get remote workers hired at US companies and a lot of implications that flow from that campaign. So what's going on with this?

Jenna McLoughlin
Yeah, Sarah, it's a really crazy story. And let me take you back to March 2020. The WHO announces a global pandemic. We all start working from home. And at that moment, North Korea actually saw an opportunity so its workers could apply for those same remote jobs undercover. So this actually follows in kind of a long line of north korean scams. They're always trying to make money, and they need to find ways to stay afloat to support their nuclear weapons program. And they've done that all sorts of ways. And that includes building stadiums for major sports tournaments. They were selling fake Viagra pills in the nineties. There's north korean restaurants in world capitals everywhere. But in the last decade or so, North Korea's really advanced their technical skills because it doesn't take a ton of money or resources to develop those skills. And they work hard, long hours.

C
And, Jenna, what kind of scale are we talking about here?

Jenna McLoughlin
I actually spoke to Doctor Jung pak at the State Department. She's the deputy assistant secretary of the Bureau of East Asian and Pacific affairs, and she's in charge of diplomatic relations with North Korea, or DPRK.

H
They are generating revenue by getting jobs, to develop websites.

Jenna McLoughlin
They're designing dating apps. The government estimates that there are thousands, thousands of workers at dozens of Fortune 500 companies. It's hard to actually pinpoint that thousands number, because when I did some interviews on this, some of these workers are doing more than one job. They're all sort of stuffed together in group houses, you know, ten plus people in one space. They're working kind of around the clock, and that makes it hard to actually put a number on it. But they are making around $300 million a year. So that's pretty large scale.

C
And this is all happening remotely from North Korea.

Jenna McLoughlin
It's not actually all happening from North Korea. So some of these workers are in places like Russia and China, places that are friendly to Pyongyang, but they're still heavily monitored by north korean officials.

Greg Myrie
Jenna, I'm always amazed at what the North Koreans can do in the cyber world. This is not a country with a big tech industry.

It seems like, where do they develop these skills? And how have they figured out this huge opportunity to use these hacking skills and intelligence efforts and have so many people who are qualified to do it?

Jenna McLoughlin
Yeah, Greg, that's a good point. And you mentioned sort of they don't have an industry, and that's because they kind of don't need an industry. You know, all of these workers are in service of the regime. So kind of all the resources that they've got go into promoting those ends. It's really interesting what's been happening recently. These items previously were kind of grouped in this bucket of north korean scams. But Doctor Jung Pak said that state is now viewing this activity differently. It's not just part of the traditional scam bucket. It's part of North Korea's broader cyber efforts. So when we're thinking about north korean elite hackers, they do have some similarities with other nation state hackers from China, from Russia. They're breaking into defense industry companies in the US and nearby in South Korea and Japan. They're gathering intelligence from those places. They want to bolster their own defense programs, but, you know, they're also wreaking havoc. Back in 2014, after that movie, the interview with Seth Rogen and James Franco came out, a lot of officials were very angry. They infamously hacked Sony and dumped a ton of sensitive emails from movie executives and movie stars. And, you know, now they're constantly stealing cryptocurrency to fund the regime as well. So a lot of these things are being blended. They're working together.

They're. They're getting a lot out of this access that they're having.

C
And, Jenna, just to be clear, these jobs we're talking about just, they seem like they are just regular it jobs, right?

Jenna McLoughlin
Yeah, exactly.

And, you know, it's interesting how people have tried to work to uncover what's going on here. I spoke to Michael Barnhart at Google's mandiant, and he's been studying north korean hackers for a very long time. And he said, looking back in retrospect, they're able to kind of see this pattern happening, especially once Covid started.

C
So, I mean, what can be done to stop this? Obviously, the us government is concerned about it. I mean, where do these companies that are hiring these workers in or supported by North Korea, where do the companies come in?

Jenna McLoughlin
Yeah, it's difficult. You know, these workers are experts at this at this point. They've had a couple of years to perfect it, and that will take the government stepping in and providing some of this intelligence, talking to these companies about what to look out for. But it'll also take some pretty traditional things like vetting candidates, requiring them to go on video for their interviews, actually parsing through their resumes, calling their references, things that will make it really difficult for them to actually fake those things.

C
Obviously, we are dealing with a lot of campaign news right now. You know, Trump was online calling for military tribunals for his political antagonists over the weekend. President Biden is out with a letter to Democrats insisting he will not step away from the democratic ticket. But as all of that goes on, both of these stories are really reminders of some of the big, thorny problems that one of these men very, very likely will have to deal with every day in the coming years. You know, I mean, Greg, I feel like it's just a good reminder of the stakes for this election.

Greg Myrie
It's always struck me that there's this conventional wisdom that elections are not decided on foreign policy or national security, and yet I always find that kind of strange because presidents have a lot more power to act unilaterally when it comes to these issues. They can more or less start wars or end wars or make big changes to a policy with a country like Russia or China in a way that domestically, you have so many constituencies pushing against each other one way or another. A president can't really make these decisions unilaterally. So, yeah, I think this is a big issue, and we'll be watching.

C
All right, we're going to leave it there for today. I'm Sarah McCammon. I cover the presidential campaign.

Jenna McLoughlin
I'm Jen McLaughlin. I cover cybersecurity.

Greg Myrie
And I'm Greg Miry. I cover national security.

C
Thank you for listening to the NPR Politics podcast.

On this week's episode of Wild Card, actor Ted Danson says it's possible to embrace your regrets.

Greg Myrie
I wish I hadn't become a liar, you know, early in life, but even your wounds you kind of have fondness for if you've lived through it and made amends and all of that stuff.

C
I'm Rachel Martin. Join us for NPR's Wild Card podcast, the game where cards control the conversation.

I
The bear is still one of the most interesting and stressful shows on tv. And yes, chef we're recapping the new season. What do we make of Carmi, Sid and the rest of the kitchen staff? What do we think of all the celebrity cameos? And how does this all compare to the first two seasons? We've got thoughts on thoughts. So listen now to the pop culture happy hour podcast from NPrdem.