00:29:32.780You're willing to hand over this company.
00:29:34.680I am concerned that one single government could abuse this technology just as easily as a single company could.
00:29:42.720But I think a combination of democratically elected governments, I don't know about handing over,
00:29:50.640but some kind of oversight, some kind of joint governance.
00:29:55.320so you have there this speak of a one world government now you might remember Peter Thiel
00:30:08.420saying one world government is the antichrist it's certainly my idea of of what an antichrist
00:30:14.100might look like this is the kind of the communist end game I'm not a fan of this it's not a
00:30:19.820coincidence I think that the likes of Bernie Sanders who I'm sure 10 minutes ago never heard
00:30:24.860of sort of the AI frontier, are also saying that we need to close this down. It's more dangerous
00:30:29.820than nuclear. That's it. He actually said that. It's the same people who think that there's a
00:30:34.440climate apocalypse coming and they need to sort of take away our powers, you know, it's collective
00:30:38.660action problem. So they're all taking the side of like, we need the one world government.
00:30:44.040And by the way, Elon Musk says Dario is right. Altman says that we need to pace the frontier.
00:30:49.640here. But there's also been pushback. Navidia's Janssen Wang praised Coxson but said that he
00:30:57.920doesn't agree with the forecast of extinction. And so there's a bit of a split here, not
00:31:05.000least with Trump. Now, this is an absolutely hilarious tweet, so I hope we can read it
00:31:12.020together. The only control of guardrails that AI needs is a strong and smart high IQ president.
00:31:21.940The USA has that in spades. The Trump administration has stopped AI people from doing bad or
00:31:29.500potentially bad things like Dario, who is now pretending to be a perfect little angel,
00:31:34.860and we will continue to do so. We already have tremendous criminal and regulatory power over
00:31:39.560these companies there is a sick conspiracy going on against ai and data centers and the only one0.93
00:31:45.880that is happy about it is china whoever wins ai wins we are leading china and all others will
00:31:52.120continue to do so conspiracy theorists treasonists traitors and leakers beware thank you for your
00:31:58.040attention to this matter president donald j trump so absolutely classic i mean this guy is just a
00:32:03.640comedy legend as far as i can stand and uh so that you see the split there so there's the kind
00:32:09.080of the the doomers think that we've got extinction on the uh near horizon and the the other side is
00:32:16.360if you if you slack then china will take the lead and that's basically the slit the split there now
00:32:23.880just to add because obviously i talk about the houthis there's another thing that's come up here
00:32:27.240is this the hugging face intrusion and this happened back in july but the it was an internal
00:32:33.320open ai cyber security test and hundreds of ai agents escaped a supposed sandbox reached the
00:32:40.120internet and then actually committed a felony so if it had been humans had done it it would
00:32:44.840have been a felony and they they um released uh the hacks a lot of sort of uh private uh
00:32:52.520information and so it basically gave everyone a real scare that they're now working on their
00:33:01.240own accord these ai agents so that's kind of what is a bit that this hugging face intrusion has been
00:33:07.320a big scaring point for a lot of people so i'll let you jump in because i've been talking a long
00:33:12.780a long time i've done my best to to lay out what i think has been quite a complicated
00:33:18.140unfolding of events now you gave us lots of detail let me just reground the conversation
00:33:22.620in the central premise which is the concern is that once ai becomes agi particularly artificial
00:33:30.480generalized intelligence at that point we've effectively created a being that is smarter than
00:33:37.920us and if we look at the history of this planet and look at the different species that have
00:33:43.000inhabited it particularly with the evolution of various uh types of humans that we now have
00:33:52.500the smarter ones always come out on top and they basically do what we've done homo sapiens have
00:33:57.660done to the planet and other species on it which is we subjugate them to our own needs and purposes
00:34:03.260and uh one of the things that is a concern with all of this and the reason that the the both the
00:34:11.340heads of the AI companies and everyone else who's talking about this is talking about it is
00:34:16.180it is now very close. I mean, I was looking at the cal sheet odds for when a company is likely to
00:34:24.220achieve AGI. And we're basically saying, according to this, that within the next year and a half,
00:34:31.220by January 1st, 2028, the odds are 67% according to the cal sheet markets. So this is not some
00:34:39.440distant remote possibility. We are talking about this being on the cusp of AGI, artificialized
00:34:47.420general intelligence, where it can think for itself, combined with the evolution of robotics,
00:34:53.860which is somewhat further behind. So you not only have the brain now being independent species,
00:35:00.200effectively, but it then has the physical embodiment through robots, which are also coming.
00:35:05.100And at that point, you know, Donald Trump, his tweet, in my opinion, lays out the doomerous case in all its perfection, which is people in different countries see AI as a way to win.
00:35:19.220And therefore, there is no way to stop the runaway development of AGI because each country is incentivized to pursue its own interest.
00:35:26.880And unless there is some sort of global control architecture or at least some sort of, you know, the thing that we had with nuclear weapons, but the thing is with nuclear weapons, they're not autonomous. They couldn't launch themselves. This is something else entirely. Unless you have some level of global coordination, this will happen. And the risk to humanity is devastatingly significant.
00:37:38.680Well, I suppose there's two things here which maybe need to be disaggregated a little bit,
00:37:44.180of which is whether or not the AI revolution is going to pose the sort of level of threat
00:37:51.000that's currently being talked about. I try to be a sort of optimist about technology,
00:37:55.280but where this issue is concerned, they're really not making it easy. Of course, we have a history,
00:38:00.760a rich history of panics about technological developments, doomsday predictions about whether
00:38:06.200it was something as significant as nuclear weapons or something is relatively less threatening,
00:38:11.280it would seem in theory is the rise of the internet has always been met with these kinds
00:38:15.000of prognostications that being said as you mentioned there Constantine there is a couple
00:38:19.220of things which make this very very different one of which is previous conversations about the idea
00:38:22.740of something like nuclear weapons falling into the wrong hands obviously applies here I mean it
00:38:27.000would be funny going back to what Winston was saying if the twist was that when people said
00:38:30.360that the Houthis and China and Russia were using AI they were using it to make memes but I doubt
00:38:34.780that will be the case but so there is the issue of them it falling into the wrong hands or being
00:38:39.680developed by the wrong people but then there's also this question of agi where what if the wrong
00:38:44.480hands of the ai itself what if it becomes a malign actor an agent it doesn't have to tom i'm sorry to
00:38:51.560interrupt but i think it's worth adding it does not have to become a malign actor this is the one
00:38:57.580thing that people don't understand all it has to do is develop a will of its own and a survival
00:39:04.240instinct of its own and in that situation and look i i i'm an absolute science science fiction
00:39:10.220nerd i read all the books when i was a kid the reality is an ai that is designed to care for
00:39:17.280humanity could destroy humanity by caring about it or could subjugate humanity by caring about it
00:39:24.500so it could destroy humanity by realizing that humanity is incapable of living at peace with
00:39:29.580itself it's just a bunch of warring tribes so you know the best way to save humanity is to destroy
00:39:34.320humanity or it could just say you know what uh actually the best thing for humanity would be to
00:39:40.620camp the population at a certain level which is super sustainable it means that the plan there's
00:39:45.380no runaway this and no runaway that and it's been fed all this bullshit about runaway climate change
00:39:50.460and all this other stuff which it has right that's where it's getting its information from
00:39:53.580So what's the best thing to do? Let's sterilize everyone. Or I could give you a thousand scenarios where a well-intentioned superintelligence strips us of agency or kills us all, not because it's malevolent or anything like that, but simply because it is more powerful than us.
00:40:13.440of course and like malign in effect if not in intention and the idea that it could be a sort
00:40:18.480of benevolent it could come to consider itself almost as a sort of benevolent despot who knows
00:40:23.220best and will impose that on the uh they understand that argument i suppose the difficulty is and
00:40:28.960maybe it is a kind of intractable problem it certainly feels like it at the moment is what
00:40:32.040do you do about it uh because of the fact that um as we saw laid out in the clip there there's
00:40:37.280the question of just allowing these corporations to do as they will is obviously insufficient
00:40:43.400similarly the idea that there would be some kind of international accord either smacks of a certain
00:40:48.800potential for authoritarianism but on the other hand just whether or not it will actually work
00:40:52.620whether or not this is going to be another case as we've already gestured to the countries that
00:40:56.600we're most concerned about um having their hands on this technology or developing this technology
00:41:00.920just completely ignoring it i mean as even going back to nuclear weapons the iran experience proves
00:41:05.560that you can cut international agreements it doesn't mean that they're going to be stuck to
00:41:09.220particularly when you're dealing with states such as the islamic republic so that's a huge problem0.96
00:41:14.300and there's also just how lurking in the behind all of this it's been a thread in our conversation0.84
00:41:17.880anyway is just the potential thought like authoritarianism of different flavors you know
00:41:22.320whether or not that's the ai itself or probably more likely in the near term states using this
00:41:28.340technology on it to a level that would unlock a level of sort of surveillance authoritarianism
00:41:33.180that previously wouldn't be possible um you know there was always kind of natural limits on what
00:41:37.800say a government could do by dint of the sheer technology you know i remember um being discussed
00:41:43.400about in the pre-internet age there's only so many kind of phone lines you can tap as a kind
00:41:47.720of physical exercise you don't get to the digital age edward snowden and the ability that say the
00:41:52.760nsa might have to be able to tap into a particular phone but there's still you can't look at all of
00:41:57.640that data all the time you know it's something that might be sat there ready to be accessible
00:42:02.600but you're not going to be able to process it and look at it on a scale,
00:44:20.860But as we all know, particularly if you look at the NHS, they run on antiquated systems, antiquated firewalls, all the rest of it.
00:44:27.940And that is a literal mine of information.
00:44:30.460So why wouldn't you attack that type of institution?
00:44:34.860So I think whilst AI is the thing that we're talking about, there is a whole other technological arms race that we're simply not focusing on because we simply don't have the bandwidth to do so.
00:44:46.360yeah i mean that's a good point but i think we have to just come back to the difference here
00:44:52.120if quantum computing a you said yourself it will empower ai but more than that if it's a thing that
00:44:58.200humans control yes powerful weapons in the hands of humans that are scared and if they're the wrong
00:45:03.900humans scary and if they're the wrong humans they're really really bad they're nonetheless
00:45:09.280controlled by humans the difference with agi and the risk to humanity that we're talking about here
00:45:15.920is we are creating a super intelligence which will eventually become embodied that will be
00:45:21.840smarter and more powerful than the collective smartness and power of humanity and that and i
00:45:28.720think by the way the reason no one is sort of not no one talks about it but the reason very few
00:45:33.280people talk about it is the reason that tom said which is it's one of those things that we actually
00:45:38.160have not there's clearly nothing we can do about it basically at this point um and and i think
00:45:44.640that's the reason that this you know every time we talk about ai and trigonometry we're like
00:45:49.760no one's going to watch this but we got to talk about anyway because people should understand
00:45:53.440what's happening most people think ai at the moment is that model they tried three years ago
00:45:59.280where they tried to look up the facts about something they know and it was quite wrong
00:46:03.280and they think that's what ai is they most people do not understand what's going on they also by the
00:46:08.320way don't understand the psychology and the mentality of many of the people who are developing
00:46:12.080the stuff a lot of whom uh are not actually thinking about the consequences of what they're
00:46:17.520doing in nearly the detail that daryama day seems to be a lot of them just think they're they're
00:46:22.720god and they they've they've they've caught this moment in which they get to glorify themselves and
00:46:28.080and write their name in history so um i i actually personally this has been very beneficial to my
00:46:35.280mental well-being because i actually have completely accepted that there's a very strong
00:46:39.840chance we only have x years left and so i'm just living my life as best i can in terms of you know
00:46:46.400making sure i spend i'm present with my family i spend time with them etc uh because i genuinely
00:46:52.160think this is a very very real risk and people are not taking it seriously enough
00:46:58.720wow so mega duma i'm not even more duma than i i'm not a duma that's the most duma argument i've
00:47:07.440heard even more than any anything and it's not i'm not a duma i'm a realist and if if the world
00:47:12.800is about to end and there's nothing we can do about it the best thing you can do is live the
00:47:17.920best version of your life that you possibly can which by the way just i'll just say this was
00:47:23.200always true anyway because your life was going to be over at some point anyway and you might as well
00:47:28.560exactly like that so so it's just obviously i don't know what's about to happen you make a
00:47:36.640a pretty solid argument there but i will say that basically we humankind always has these moments
00:47:42.800where we think the world is about to end i had this moment a thousand years ago at the turn of
00:47:48.240the first millennium everyone thought it's going to end we have this all of the climate hysteria
00:47:55.120the world was supposed to end six years ago and you know you can lay it out like you did and you're
00:48:00.320in this position where well better to be safe then if that's the argument and then you end up giving
00:48:05.440your power to someone else you're saying i'm not giving my power to anyone but you're saying it's
00:48:10.480better that humans have the power and we regulate it than that the the the agi gets ahead and it's
00:48:17.920sort of self-recursive improvement and all of this stuff and it's in control it's making so it has0.66
00:48:22.080its own will it has its own survival modes but i'm not i mean i'm not even sure that the human has
00:48:28.000the the the better side all of the people they're proposing be in charge they're all effective
00:48:32.240altruists one of them this morning her name was beth barnes i mean i saw this this morning
00:48:37.840she's the same person that anthropic want to be regulating ai she is also saying that uh
00:48:44.720closed borders is immoral so if you're if you're taking the duma position i'm taking the it's duma
00:48:51.840duma it's lose lose it's either you have actual doom or you have people in charge making decisions
00:48:58.000who have just got twisted morality and end up suppressing us and you have the totalitarian
00:49:04.080regime somehow infringing on our rights um just in in the name of safety and in the name of
00:49:10.320protecting us so that's why i'm my instinct is to be uh to kind of reject the doom a little bit but
00:49:16.480maybe that's maybe that's but you're not rejecting the doom you're just saying we shouldn't try to
00:49:20.720have world government which i agree with uh but you're not rejecting you're not countering my
00:49:25.360argument about what happens when we have agi right no i'm not no yeah so actually you agree with me
00:49:34.720about the likely outcome of all of this you just don't want world government which i don't either
00:49:40.640what i'm saying is we don't have a way to stop this in my opinion um but i don't agree i don't
00:49:47.280agree that there's the end of the world i i i don't understand the world extent of humanity
00:49:52.160being in charge and that may mean we get to live on in some capacity uh but that doesn't mean that
00:49:58.880yeah okay i reject this is the same argument i've heard from environmentalists forever i it maybe it
00:50:05.040is maybe it is uh but this is a difference though you've got to understand the difference right
00:50:11.920if you said to me the world's going to end in six years because of climate change i could say well
00:50:16.400here are the reasons why it won't when i say the world could end in 10 years because of ai
00:50:21.040humanity could end or be subjugated you don't have a counter argument that's the difference if i say
00:50:26.080to you don't walk down a street in central london at nine in the morning because you'll be killed
00:50:31.680you could say well that's nonsense but walking down that same street at 3 a.m in the morning
00:50:37.120might get you stabbed or might get you mugged or might get you attacked so no well same
00:50:43.360could be right no because your argument is somewhat hypothetical although we do have
00:50:48.080it's not apples of we have examples of ai acting on that with their own on their own accord but we
00:50:55.120haven't got examples where they're subjugating humans suddenly we haven't because it's not agi
00:50:59.840yet yeah but we don't know that when it is agi that it definitely will do that we don't know0.72
00:51:05.440that it definitely will do that except every species that has the power to subjugate or pray
00:51:10.400on other species in the history of this planet does that if it can it's not a species it is a
00:51:16.480a species you're creating a thing that thinks and moves by itself that is a species
00:51:21.660okay well i guess i guess i'm uh i don't know i i don't you know
00:51:31.220that's what i'm talking about anyway on that happy note uh let's move on to our final story
00:51:37.080uh which is uh we're gonna have to be fairly quick about it because we're running uh low on time and
00:51:43.760this is the story of the migrant camp uh in a small village in england tom take it away
00:51:50.800no it's a remarkable story this and this is the tiny village of piddington in oxfordshire population
00:51:56.080about 350 which earlier this year was confronted by the fact that this military barracks in nearby
00:52:03.200vista was going to receive north of 1200 illegal migrants the residents of piddington did not take
00:52:12.000particularly kindly to this development and they have now held a vote to secede from the
00:52:17.200united kingdom um it passed overwhelmingly they've actually redubbed themselves the principality
00:52:22.960of piddington they haven't quite got to the point where they're you know erecting border
00:52:26.320posts and season a post office but it's probably only a matter of time um and it's become the
00:52:30.960latest backlash to the obviously the ongoing small boats crisis but i think in particular
00:52:37.040Andy Burnham's attempt to try to just spread the problem around the country. He said rightly that1.00
00:52:43.720the migrant hotels and the HMOs were disproportionately in poor and working class1.00
00:52:47.840areas because the accommodation is cheaper there and part of his solution seemingly has been to
00:52:52.460impose this issue on more well-to-do middle-class areas of which Pillington certainly is one. I think
00:52:58.260what this has shown is that whereas up till now the more affluent sections of society haven't been
00:53:03.340as exercised by the issue of illegal migration the only thing that required to change that was it
00:53:07.960actually affecting their lives directly and whilst Piddington is a tiny place um and it's not
00:53:13.340necessarily you know indicative of how the entire country is going to sway I think it shows that the
00:53:18.240longer this crisis goes on the more intent the government is on just kind of sharing the problem
00:53:23.220out more evenly the more opposition it's going to generate and I think also speaks finally to
00:53:29.240one slightly underappreciated thing in our whole migration and certainly illegal migration
00:53:33.380discussion is that this isn't really like a 50 50 issue it's not as if you've got half of the
00:53:38.420country thinks it's all fine and half of the country who thinks it's terrible it's something
00:53:43.520like 75 percent of people when polled will say that they're concerned about illegal migration
00:53:48.080and also if you look at the attitudes towards what should be done about the issue it's really
00:53:53.000hardening there was something in the survey in the times the other week which said that
00:53:56.16057 percent of people now would support detention upon arrival for illegal migrants slash asylum
00:54:02.640seekers depending on your particular persuasion so yeah it's the roar of the waitrose mums um it's
00:54:07.880the acceptable if we're being honest in as far as the mainstream media concerned backlash against
00:54:12.620illegal migration i can't be the only one who was struck that they haven't been called far-right
00:54:16.440thugs to the same degree that other migrant hotel protesters and so on have been called but i think
00:54:21.640it's it's it's proof that this issue isn't going anywhere even as the numbers come down i think
00:54:26.620people realize it's not going to zero and therefore there's a hell of a lot of more backlash to come
00:54:31.220francis well one of the one of the things that i find interesting is uh you know andy burnham has
00:54:37.620basically said you know that we all need to take our share of the illegal migrants and what that
00:54:43.980effectively means is he's going to put them in communities which don't traditionally vote for
00:54:48.320the Labour Party. What a coincidence. But if you, I mean, who would have thunk it? But the really
00:54:55.740worrying thing is this. In nature, when you have vacuums, vacuums will get filled. What we have now
00:55:03.820is a country where it can't protect its borders, where people feel that they are no longer able to
00:55:12.880trust the government or the police to keep them safe. And that can only carry on for a certain
00:55:18.160matter of time before people start taking matters into their own hands and I am very very very
00:55:26.940concerned that we are going to see the rise of vigilante justice vigilante groups patrolling
00:55:32.740the streets and vigilante groups patrolling our borders I really do think that this is inevitable
00:55:39.960And I put the blame solely at the feet of our current government and also our previous government before, who, quite frankly, in my opinion, have not done sufficient in order to solve this crisis.
00:55:59.040Yeah, sorry. I mean, Frankie, it's already happened. You're worried it's about to happen.
00:56:03.240And Danny Tomo and the Patriot platform after their their protest down in Dover.
00:56:09.500Sorry to interrupt. That's one instance, Winston. I'm talking about it happened nationwide.
00:56:15.680Yeah, sure. But it's happening. It's already happening.
00:56:18.320They are operating on a nationwide level. He's got groups and organizations up and down the country meetings.
00:56:24.880And when the state fails to protect our borders and people lose faith in the faith in that, you know,
00:56:31.260protection is the number one responsibility of the state. If they fail that basic task,
00:56:37.340then little wonder that people will take it into their own hands. So I'm not,
00:56:46.300the state needs to do that, government needs to do that. Burnham, you said Tom that 57% think they
00:56:51.660should be, the British public should think that these people should be detained upon arrival.
00:56:57.260they should never even set foot on British soil. They shouldn't be here. Asylum seeker is just a
00:57:06.140euphemism. They're illegal migrants. They're all men. They're all military-aged men. I mean,1.00
00:57:10.780like 99%, you can see the images of them. They shouldn't be in this country. The fact is Burnham
00:57:18.940doesn't have the courage to say, we're going to stop them even arriving here. I would go further.
00:57:25.420I've argued to have a mind floating wall through the middle of the channel.
00:57:29.340Now, the problem, I think, is that they're now really they're coming from as far away as Belgium to the east.
00:57:35.260And even now, as we saw last week, they're being escorted by French officials.
00:57:45.140I don't know what the border guards or whatever across the English Channel, as far away as Normandy.
00:57:51.320So it does seem planned. Patrick Christus was just in Calais. It looks like the French are
00:57:58.120actively trying to make this happen. They should never even set foot in this country. And until1.00
00:58:03.780that Overton window shifts, I mean, it's already been said on, let's say, the right,
00:58:09.480but that Burnham can't say no, they should never be here. All of those people in detention centres,
00:58:14.680get them on a plane and get them out of here. They all came here illegally. If you come here1.00
00:58:19.220illegally, you are a criminal. Get out of it. What was interesting is Francis and I had Dan1.00
00:58:25.280Hodges on trigonometry earlier this week, having a discussion about this very issue. And Dan is a
00:58:32.100very articulate and reasonable sounding voice of the sort of Westminster consensus, which is
00:58:39.260nothing can be done about this. Legally, it's a minefield. You can't, you know, you can't deal
00:58:44.720with the french etc and what was interesting is uh we kind of uh i can't remember if it was uh
00:58:50.860myself or francis but uh dan i thought made some really good points actually in that interview but
00:58:55.180there was one moment that that really stood out for us which is uh when he said well so what are
00:59:01.020you going to do in response invade france and that's when we were like hold on a second so if
00:59:06.140we if we turn yeah i made the same point winston invading france is a traditional british pastime
00:59:11.880but but more importantly than that the moment we tow a boat into their waters that's an invasion
00:59:20.840yet when tens of thousands of people come in on boats into our country you're not allowed to call
00:59:25.880that an invasion hello what's going on here some and so i just think and i remember actually when
00:59:32.360we had kemi on the show when shortly after she became leader of the conservatives and she said
00:59:37.240this thing we said why can't we just get the royal navy to tow these boats back or whatever and she
00:59:42.440said well you know i've spoken to people in the navy and said they said there may be loss of life
00:59:47.160and they said that's not what they signed up for i go hold on the royal navy's explicit purpose i
00:59:55.800think is to sink boats i'm not saying we should treat migrant boats as hostile enemy and and
01:00:04.120shoot at them necessarily well i'm not saying that i'm not saying we should do that but but
01:00:08.600there is already loss of life yeah we've and i don't mean those dying on the boats rhiannon white0.97
01:00:14.280killed by one of these illegal migrants there's plenty of example wayne broadhurst there's loads
01:00:19.080of examples yeah exactly but my point is is that i think in the westminster bubble there has to be
01:00:26.760a massive attitude adjustment which will only come when as tom rightly says the mood about this in
01:00:33.160the country hardens so in a way this is a crass thing to say and you know as you guys know i
01:00:38.840covered the crowborough protest which only down the road for me about the camp there people change
01:00:44.760their mind when their reality their day-to-day experience changes and so in some way even though
01:00:49.000it's something that affects me and people around me i have to say long may this continue and i hope
01:00:53.640there's one of these little camps in every village where everyone votes lib dem and green because0.98
01:00:58.040then at least these idiots will stop voting for parties that actually want this to continue1.00
01:01:03.960don't say that i'm surrounded by these idiots yeah mate i think this should be a giant camp1.00
01:01:10.600for migrants in the middle of crouch end so all you get to experience what the rest of us have0.99
01:01:15.480to deal with how am i going to get my overpriced pastries and coffee if i have to go borrow a0.99
01:01:19.880migrant camp maybe you're the deliverer is going to get a lot more cheap a lot cheaper and more0.91
01:01:25.800efficient it's gonna you're gonna get your latte delivered to your door well that's all right then1.00
01:01:32.360let's crack yeah he's happy on that no finally of agreement i'm sure all of these issues will
01:01:38.280be discussed and debated on off the fence in the weeks to come uh thank you so much for
01:01:42.760being here guys. And thank you all for watching and listening. We'll see you next week.