An officer and a gen AI: the future of war

Primary Topic

This episode explores the integration of artificial intelligence in modern warfare and the ethical, legal, and practical implications that arise from it.

Episode Summary

The episode delves deep into the transformative role of AI in warfare, highlighting its deployment across various military functions from logistics to lethal autonomous weapons. It discusses the acceleration of military capabilities and the profound questions it raises about the nature of combat and decision-making in war zones. The discourse centers on the "Lavender system" used by the IDF in Gaza and the ethical controversies surrounding the minimally supervised AI-driven targeting of threats, illustrating a future where AI's role in warfare is both powerful and problematic. The conversation also covers AI's impact on military strategy and its potential to outpace human decision-making, emphasizing the urgent need for ethical frameworks and international regulations to manage the risks associated with autonomous warfare.

Main Takeaways

  1. AI is becoming integral to all aspects of warfare, from mundane logistical tasks to advanced combat strategies.
  2. The use of AI can significantly enhance military efficiency but raises serious ethical and legal concerns.
  3. The blurring lines between AI-driven intelligence gathering and decision-making could lead to reduced human oversight in critical military operations.
  4. There is an urgent need for robust ethical guidelines and international laws to govern the use of AI in military settings.
  5. The pace of AI integration in warfare is rapid, necessitating immediate and thoughtful discussions among policymakers, military leaders, and technologists.

Episode Chapters

1: The Evolution of Warfare

AI's growing role in warfare is transforming military strategies and operations, highlighting a shift towards autonomous systems that could eventually dominate decision-making processes. Jason Palmer: "AI is trickling into almost every aspect of war."

2: Ethical and Legal Challenges

The episode discusses the ethical dilemmas and legal challenges posed by autonomous weapons and AI-driven warfare, emphasizing the potential for AI to make life-or-death decisions with minimal human intervention. Shashank Joshi: "A really important gulf is opening up between the lawyers and the ethicists."

3: Technological Frontiers

Insights into cutting-edge AI applications in the military, including logistics, surveillance, and autonomous navigation, illustrate the breadth of AI's impact on modern combat. Rosie Blore: "Tell us about some of the cutting-edge technology that we're seeing."

Actionable Advice

  1. Stay informed about the advancements and implications of AI in warfare to understand its impact on global security.
  2. Engage in discussions and debates about the ethical use of AI in military settings to contribute to the shaping of policies.
  3. Advocate for transparent international regulations governing the use of AI in warfare to ensure accountability and prevent misuse.
  4. Support research into AI safety and ethics to help develop systems that enhance security while minimizing ethical risks.
  5. Participate in educational initiatives to raise awareness about the challenges and responsibilities associated with AI-driven warfare.

About This Episode

Artificial intelligence is already making a difference in the theatre of war, and more involvement will certainly come. That raises a host of thorny ethical issues. In some cases, scientists just clocked, extinct beasts’ DNA can be extraordinarily well preserved—revealing once-inaccessible biological secrets (10:43). And remembering Pål Enger, who never quite knew why he felt compelled to steal “The Scream” (19:25).

People

Shashank Joshi, Rosie Blore, Jason Palmer

Companies

Israel Defense Forces

Books

None

Guest Name(s):

None

Content Warnings:

None

Transcript

Ryan Reynolds
Ryan Reynolds here from Mint Mobile. With the price of just about everything going up during inflation, we thought we'd bring our prices down. So to help us, we brought in a reverse auctioneer, which is apparently a thing. Mint Mobile Unlimited Premium wireless everybody get 30 30 better 30 baby get 20. 2020 better to get 2020 a better get 15.

Mint Mobile Unlimited Premium
1515 just $15 a month, so give. It a try at Mint mobile.com switch. $45 upfront for three months, plus taxes and fees. Promoting for new customers for limited time unlimited, more than 40gb per month slows full terms at mint mobile.com dot.

Jason Palmer
The Economist hello and welcome to the intelligence from the Economist. I'm Jason Palmer. And I'm Rosie Blore. Every weekday we provide a fresh perspective on the events shaping your world.

The DNA sequences of lots of long dead beasts are already known. What scientists hadnt discovered is how that DNA is folded and tucked into chromosomes. The real owner's manual for how to run, say, a woolly mammoth. That, though just changed. And everyone knows the painting the scream by Edward Munch.

Rosie Blore
But few were haunted by it, like pal Enger was, so he stole it. Our obituaries editor describes a thief who, under different circumstances, might have been a friend of the artiste.

First up though battlefields have long served as proving grounds for new technologies to. Break the stalemate, Britain had introduced the tank Germany was using liquid fire. And those technologies have in turn changed the character of war from tanks to radar. And the awesome destructive power of the. Bomb, the force from which the sun.

Unknown
Draws its power, has been loosed against those who brought war to the foe. Computers, too, have played their part. Colossus was built in 1944 to crack nazi codes, and by the 1950s, a digital control and command system was organizing America's air defenses. In the decades that followed, the role of machine intelligence grew, but remained quite small. Soon it will become pivotal, and it could transform the nature of warfare altogether.

Mint Mobile Unlimited Premium
Artificial intelligence is trickling into almost every aspect of war. Shashank Joshi is the economist defence editor. That is prompting some tricky questions about the nature of war itself and the human role in it. I think a really important gulf is opening up between the lawyers and the ethicists who worry about the role of AI and armed forces who see enormous opportunities and fear being left behind by their rivals. You say AI is trickling into every area of war today.

Rosie Blore
Tell us about some of the cutting edge technology that we're seeing. So start with the really boring stuff at one end. That's dull but essential. That could be logistics, that could be maintenance that could be HR. AI is being used in all of that.

Mint Mobile Unlimited Premium
So, for example, using AI to predict when a particular unit on the front may need more shells and sending it to them before they even ask for it. At the other extreme, Rosie, the bit that people tend to be most interested in, perhaps most exercised by, is the killer drone bit. The weapons that are fitted with some kind of AI. Maybe that's computer vision that can recognize a tank. Maybe that's the ability to maneuver across a battlefield and maneuver through the inside of a house using autonomous navigation.

And that's the sort of sharp end. I think the really interesting bit is everything between that and that. The line between intelligence, which is about spotting patterns and data, and command and control, which is about doing something based on that intelligence, is blurring. So give me some examples of these bits in between that are making militaries function. I think one really interesting example of this is the lavender system being used by the Israel Defense Forces, the IDF in Gaza.

This has had a lot of attention recently. The claim is that this is a kind of Aihe system that's being used to identify tens of thousands of Palestinians as targets, with human operators only giving very cursory scrutiny before ordering the strike. Now, in practice, that is likely to be a version of what we call a decision support system, or DSS. And what's effectively happening is that computers are not just processing lots of data, they're bringing recommendations or options to commanders. And at some point, humans can treat those as a kind of menu that they pick and choose, or they can treat those as something to simply accept.

And at that point, the machine is almost co commanding with the human. And I think that is the kind of future that many armies see. So spotting is okay, but decision making recommending is obviously very much getting towards the killer robot territory of science fiction. Tell us a bit more about the kind of ethical questions this is all prompting. On the one hand, Rosie, I could give you examples from the Vietnam war in which America was pulling together data from sensors.

They were processing them in big IBM mainframe computers in Thailand and sending the data to planes. And you can argue that is also an example of algorithmic computer enabled warfare. What's the difference? The difference, I think, is that today's software enjoys much more computing power. It has many more sophisticated algorithms, more data than ever.

And I think that is what is changing the ethical discussion. Partly because if your computer system is giving you the option of a thousand targets, then it really isn't that easy for any human or any team of humans to sort through that in a reasonable period of time. And if the opposing army is saying the computer can decide which target to hit, but you're relying on humans for that, I think the fear is that actually this is going to slow you down and allow the opposing army to get the advantage. But if you simply accept the recommendations given by the computer, then of course you are going to make mistakes. You're going to see the algorithm make some catastrophic errors, and there may be areas where computers are simply unable to do their job properly.

So, for example, can they really tell the difference between a child holding a toy gun and a soldier holding a real one? And those problems are really going to get worse and worse as these command systems are used more and more. So I think what you're saying is that we've always asked computers to help us make decisions, but obviously these decisions are much bigger. We're now asking computers to do things that humans can't while being terrified that computers can't do things that humans can. Is that correct?

I think you summed it up very well. And the fear is that not only are we asking computers to do a lot, that as these algorithms become more advanced, we understand them a bit less, but also they're more unpredictable. They may be trained on data from Ukraine, but then if you're applying them, in the case of Taiwan, they might result in very unpredictable output. The response to that from military types is to say, all that may be true, but war is already very messy. Human intelligence officers who have to sort through targets are subject to exhaustion.

They're subject to mistakes themselves. And actually that the baseline isn't whether the computer is perfect or not, it's whether it is better than a human team doing the same thing. And actually, the ethicists and the lawyers, sometimes they have too rosy a view of conflict today, the way it's waged by humans, and so they expect too much of the machines. And I think that debate really is still playing out between those who are worried by the responsibility being imbued into machines and those who think actually, that perhaps if the machines are more reliable, more predictable, not subject to emotion or fatigue, maybe they would even make more ethical decisions on some of these matters. So is war in practice going to wait for us to have these debates?

I think to answer that, look at Ukraine. Ukraine and Russia are both putting AI in their drones. They're using AI in their command systems to decide where artillery should strike. They're using it to find russian generals. They're not waiting for these legal and ethical debates to resolve themselves.

They're fighting, in Ukraine's case for their survival. And I think hanging over this rosie is also the kind of specter of a war involving big powers. NATO countries know they might one day have to fight Russia, an army that has now accumulated years of experience in putting AI into its systems and has very few ethical compunctions about the effects of that. China is pursuing many of the same technologies as well. And so american commanders are asking, what the People's Liberation army going to do?

Rosie Blore
Who's got the upper hand in the AI defense supremacy? A few years ago, you would have found that Americans were fretting. China's pulling ahead of us in AI. They have vastly more data collected from things like surveillance cameras. They have fewer rules about using it.

Mint Mobile Unlimited Premium
They have control over private companies. I think those concerns have abated a little bit. We've seen America pull ahead in cutting edge foundation models, things like the GPT models, inside chat, GPT. We've seen american chip export restrictions really savage some chinese companies. And I think we're also seeing american companies test some of their products in Ukraine pretty successfully, showing that they can also build very impressive things.

However, there is a worry, I think, among a lot of people, that armies and armed forces in the west are still quite slow to evolve. The Pentagon still spends less than 1% of its budget on software, and I think there is a real sense that we can see the future of war in the distance. AI is an integral part of that. But the gap from here to there of really transforming today's armed forces remains really, really formidable, terrifying stuff. Thank you so much, Shashank.

Thanks very much, Rosie. Artificial intelligence isn't just changing the face of war. It's also transforming espionage. On this week's episode of our science and technology podcast, Shashank takes us into the shadows to find out how spies are using tech to gain an advantage, you can listen to Babbage by subscribing to Economist podcast. Plus.

Ryan Reynolds
Ryan Reynolds here from Mint Mobile. With the price of just about everything going up during inflation, we thought we'd bring our prices down. So to help us, we brought in a reverse auctioneer, which is apparently a thing. Mint Mobile Unlimited Premium wireless how about to get 30? 30 bid to get 30 better 20 2020 1515 just $15 a month, so.

Give it a try@mintmobile.com. Slash switch $45 upfront for three months, plus taxes and fees. Promoting for new customers for limited time unlimited, more than 40gb per month slows full terms at mint mobile.com dot.

Jason Palmer
Scientists can learn quite a bit about extinct animals from the hints they leave behind.

Bones reveal body shapes and musculatures.

Footprints hint at posture, weight, even running speed. Some dinosaur fossils contain stunning detail, like patterned colored feathers. Maybe it doesn't sound so surprising. After all, moviegoers long ago became used to the idea that dino leftovers could be fashioned into tourist attractions. There it is.

Rosie Blore
Welcome to Jurassic park. Living biological attractions. Back in real life, there's still a tremendous amount about past beasts tucked inside their genetic codes that paleontologists are still desperate to know. And some of that can be learned when the leftovers are preserved in a particular way. For the very first time, scientists have found what they're calling fossil chromosomes.

Jason Palmer
Rory Galloway is a senior producer on the intelligence and also reports on science for the Economist. Theyre inside the cells of a mammoth that was frozen for 52,000 years in Siberia. And it might just change the way that we understand ancient life all over the planet. Now, im a little unclear here, because I thought that I had heard that DNA had been pulled out of a mammoth somehow before. So youre right, Jason.

Unknown
Weve had the DNA of a mammoth for a while, but its normally found in these tiny little fragments of DNA. What they do is something called paleogenomics, where they study those fragments and they sort of line it up into the right positions based on the DNA of an elephant and sort of checking across. But what this loses is all of the complex folding and other structures that are present in the nucleus of the cell. So these chromosomes and other structures that are really essential for understanding exactly which genes are switched on and not in the cell. And to understand this a bit better, I spoke to Doctor Eres Aden from Baylor College of Medicine in Houston, and he explained how different this was from what we had before.

Eres Aden
Imagine DNA is like a ladder. What's happening in ancient DNA is the ladder is getting, like sawed every 30 rungs, 50 runs, 100 rungs. But when we're reporting fossil chromosomes, what we're saying is those little subladders that get produced, all those little fragments of ancient DNA, are still arranged in three daughter as they were 52,000 years ago in the living organism. So for anyone who doesn't know, chromosomes are made up of extremely long chains of DNA, all squished down and packaged, and they help to structure that DNA so that it can be copied or put in the right places so that the right genes can be activated when they need to be. Okay.

Jason Palmer
And so how do these packets of squiggly stuff end up as what you're calling fossil chromosomes. Well, it's not dissimilar to the process that makes beef jerky just a little bit colder. So when flesh dehydrates really, really quickly, the nucleus of the cell, with all of its genetic structure, dries out really fast, too. And in that process, what happens is that the chromosomes within that nucleus are preserved into this sturdy solid. In a technical sense, it's a glass, so a non crystalline structure.

Unknown
And doctor Aydin and his team call that solid chroma glass. Two things help arrest molecular movement. One is cooling, the other is removing the water. So they all get jammed in there in that molecular traffic jam. And that combination is what creates chromoglass.

But the team wanted to find this preservation happening naturally. I started to test, you know, my dinner from the thanksgiving invitation at Eris's place. Cynthia Perez Estrada is also working at Baylor, and she was one of the lead authors on the paper just published in the journal Cell. All sorts of other critters that I could find in the road on my way to work. Crickets, roadkill mice, and even my bag just, you know, throw in different ideas on how to make it work.

Even though these samples were such poor quality, they still contained chroma glass. The majority of the experiments failed, but there were a few that actually gave us the idea that this search was not, maybe not a waste of time. Doctor Perez Estrada's experiment suggested it would be possible to find chromoglass in ancient specimens of extinct species, provided they were kept dry. So she started looking for it in something a little bit older, which is. How we come back to the mammoth.

I guess it is. She was searching for nine years and eventually was sent a sample, well, two samples, in fact, from mammoths found in caves in northern Siberia. Both were females. One had been frozen for 39,000 years and the other for 52,000 years. And they were so well preserved that their hair, skin, follicles, and even individual cells could be seen upon magnification.

And nestled deep inside those skin cells was the naturally formed chroma glass, or these fossil chromosomes. Okay, so once you've found it, though, how do you get it to tell you all the things that chromosomes can tell you that DNA fragments can't? Well, that involved an awful lot of complicated computer modeling and collaboration with a team at the center for Genomic Regulation in Barcelona. And I don't know enormous amounts about that, but what's more important is that it worked. We now know for the very first time that mammoths had 28 pairs of chromosomes, which was exactly the same number as other elephants have.

Both species, the asian elephant and the african elephant. And a group of international researchers compared this mammoth skin cell data with that of their living elephant relatives in other ways and found what's called epigenetic changes. So if the genome tells you how to build the beast, the epigenetic changes tell you how to run the beast, they tell you which genes are switched on and which aren't in its specific environment. And that's really exciting. Some of these genes were involved with coping with cold weather, perhaps unsurprisingly, and that included a gene for really long hair in the mammoth.

But what's more exciting to me is what this means for species outside of just the mammoth. Such as? Well, doctor Aiden expects chromoglass to be found in far more places. Now we know what to look for. And he also found that when this dehydration process forms, this chromoglass, at the point that it's formed, it becomes seriously durable.

It's really solid stuff. And in the paper, he and his colleagues theorize that it has a pretty extraordinary shelf life. We estimate about 530 million years, which is a very long time. Now, assuming there's extremely good preservation, 530,000,000 years takes you back way beyond the dinosaurs. That means we could find DNA from the cambrian era.

That's a time before any animals had crawled out of the water and onto land. That's how far back we're talking. But as I was discussing this with Doctor Aiden, he had an even more fun way to think about this. I wouldn't take it too seriously, but you could imagine there are cold, dry environments on comets. At the rate that comets move over 530 million years, material from Earth would have arrived at most of the Milky Way aboard a comet.

Eres Aden
So that's really robust. Now, there's another fun way to think about this, Jason, and again, this is super speculative, but space is pretty darn cold, and a much better environment for preserving this chromoglass like substance. There was a massive asteroid impact at the end of the time of the dinosaurs that blasted rocks, debris, and potentially unsuspecting t rexes out into space. So I like to think about the fact that sometime in the future, astronauts might be looking at some asteroids floating about somewhere out there in space, and they may just discover some t Rex jerky, complete with chromoglass inside it, just waiting to give up the secrets of the dinosaurs. That is barcare.

Jason Palmer
It's Rory. Look, I'm not saying Jurassic park is close, but it's definitely closer. Than it was yesterday. Rory, thanks very much for your time. Thanks, Jason.

Unknown
There are some paintings that just provoke a strong reaction. Ann Rowe is the Economist's obituaries editor. Pablo Picasso's Guernica had red paint sprayed on it. The rugby Venus of Velasquez was attacked with a meat cleaver by a suffragette. And as for Edvard Munch's the scream, that famous painting of swirling reds and blues with anguished figure at the center, that one, at least to Paya Enga, seemed to be something that had to be removed totally from where it was.

He was never exactly sure why he stole that painting. But one moment his ladder was up against the wall of the National Gallery in Oslo, and the next minute he was bundling this painting, which was then worth $55 million, behind the front seat of his car and driving around Oslo for hours wondering what on earth he was going to do next. He said it was a magical electrical feeling to have this painting with him. He was so glad to possess it. On the other hand, what now?

He'd been planning this theft for a number of years. He tried to steal the scream before he'd put up a ladder against the wall of the gallery. And he'd got instead of the scream because he broke through the wrong window. He found Munch's painting called love and pain, which shows a red haired woman ravenously embracing a mandehead.

He was disappointed for days that he hadn't managed to get the scream. But on the other hand, he was very happy to put love and pain up on his wall and to make quite an exhibition of it before the police got word that he had it. He went to prison for six years for doing that. But in 1994, he was well aware that Norway was about to host the Winter Olympics in Lillehammer, that the police would be very distracted that day, and it might be an excellent day to try to do what he really wanted to do, which was steal the scream. It was not something you'd expect from someone who'd been brought up in a very poor part of Oslo and had got into gangs pretty early.

But he had a rather busy and extraordinary life as a teenager. On the one hand, he was determined to be a very successful criminal, and he was. He made such a lot of money from stealing jewelry and profiteering that even at school he was going around in flashy clothes with large watches. And a bit later he was seen with the most luxurious cars, bmws and mercedes. And, as he liked to boast, the only Porsche in Oslo which the rich folk would come round to the slum just to see him washing it.

He had also been a very promising footballer when he was young. He played for Varanga, which is a team in the Norwegian Premier League, and had a lot of talent. But he couldn't do both the crime and the football. And in the end, because the football didn't pay very much and crime did, he just let the football slide.

He found, though, surprisingly, that he did rather like the paintings of Munch. He'd first encountered the scream on a trip in primary school, so he was very young. He was so struck by the painting that it haunted his dreams for a long time, because it seemed to him that this anguished central figure was expressing what he felt when he thought of his stepfather. He was a violent man and so he began to think about the painting more and more. And as he became an adult, he read a lot about it and he would go to the National Gallery at least twice a week and just stand there looking at it.

Of course, he would also notice, if he visited that frequently, that the painting wasn't glazed and it wasn't guarded particularly. And it was also right beside a window. And to someone with a criminal mind, that was interesting.

Having done that, he found he'd earned himself seven years in prison. But it had also made him a great celebrity because the scream was a national treasure in Norway. That being consternation when it was taken and when it was discovered that the man who'd taken it was also a footballer, there was some romance that clung to Pella Inge and he added to his fame by escaping from jail. When he was there, he waited until all the prisoners were taken on a field trip and ran away, and then disguised himself in a blonde wig and sunglasses and tried to get a train to Copenhagen. At the same time, however, his criminal career was not going terribly well.

He did still manage to steal numbers of smaller artworks and jewels, but he was either tiring or he was losing his touch. And it seemed that by 2012, he was reduced to stealing taxi license plates and pairs of socks.

But while he'd been in prison, he had taken up painting. At first he painted animals and then he had started to paint versions of the scream, but then he preferred to do abstracts of his own. And it was quite strange how painting after painting seemed to resolve into the swirling reds and blues of the scream itself and into that ghostly figure at the center with its hands in anguish, clasping its head.

Jason Palmer
Ann Rowe on Paya Enger, who's died aged 57.

That's all for this episode of the Intelligence. The show's editors are Chris Impey and Jack Gill. Our deputy editor is Jon Joe Devlin and our sound designer is will Rowe. With support this week from Timo Saila. Our senior producers are Rory Galloway and Sarah Lamuk.

And our senior creative producer is William Warren. Our producers are Maggie Khadifa and Benji Guy. And our assistant producers are Henrietta McFarlane and Canalbeck Patel. With extra production help this week from Emily Elias. We'll all see you back here tomorrow for the weekend.

Intelligence.