00:04:02.800It's the, you know, again, I'd like to focus on what's already happened, because when you talk about AI destroying humanity, it's so abstract and it's hard to imagine it.
00:04:16.040But I would say if AI were to destroy humanity, which I hope it won't, and I believe that, you know, I'm an optimist, I believe we'll be able to find a path to safety.
00:04:26.740But if AI were to destroy humanity, I'm pretty sure history books would count the opening salvo as that the moment when the U.S. armed forces attacked the school in Iran, the Minab school.
00:04:42.320It hasn't been yet kind of acknowledged by the U.S. government why and how that happened.
00:04:48.280But Bloomberg reported that the targeting of that school was done by Anthropik and Palantir and, you know, something like 170 innocent people, most of them children, were killed in a massive atrocity.
00:05:08.420And you can argue about, oh, was this, you know, some people are finding different, you know, different articulations of how to explain it away or it wasn't our fault or it wasn't intentional.
00:05:21.320Maybe the Iranians themselves did it or maybe it was worth it or so on.
00:05:25.420But if you take a step back, human beings dropping a bomb on a school full of little kids, doesn't matter whether it was Americans or Iranians.0.88
00:05:35.180AI chose a target of completely innocent people and a bomb was dropped, killing them.
00:05:41.900That is a bizarre place to be, you know, in the 21st century.
00:05:46.820So you see the bombing of the girls' school in Iran in the opening days of the war
00:10:36.120And it's really neat and cool how it's modeled after how the human brain works.
00:10:42.400So there's a lot of, you know, kind of academically fascinating parts about it.
00:10:47.600I just think you should put all that in a box.
00:10:50.680And when it comes to kind of the question of just the rules and kind of who is in charge, it should be really clear that humans are in charge and AI is a tool that we're building to serve humans.
00:11:08.360And more importantly, that the law, humans law, is what's in charge and that AI is not above the law.
00:11:15.160So the average water pipe in this country is over a half century old, and that means a lot of our water is not very good.
00:11:20.640It's got forever chemicals, antibiotics, pesticides, and all kinds of things in it.
00:11:24.240And that's why we're excited to partner with a company that has a solution to all of this.
00:11:29.680WiseWell makes filters that give you actual control over the water that you drink, that you give to your kids.
00:11:34.840They use the highest level of filtration to remove plastics, toxic chemicals, and all the other stuff you have in your water, but might not even be aware of.
00:11:42.580You're probably wondering how this works.
00:16:39.000doesn't place any reward for building safe AI.
00:16:44.160It's just whoever can get there the fastest and anyone who stops to spend time on safety and making sure their AI doesn't do rogue things is kind of at risk of falling behind.
00:16:56.940So we're in a race right now where nice guys finish last and rogue AI will be the winner.
00:17:03.220And so I think the people asking for regulation
00:17:05.500are actually the nice guys being like,
00:17:07.540I want to win the race by doing things the right way,
00:20:14.360If you felt that your technology had been used to murder children, wouldn't you get to the bottom and find out if, in fact, that it happened?
00:20:22.460And if it had, wouldn't you issue a public statement saying, this is horrifying and I'm totally, I just want the record to reflect, I'm totally opposed to this and I'm so sorry, to the extent to which I've been involved in it.
00:24:19.480And to be clear, I don't want to see Sam Waltman in jail or Dario in jail, but if there was even the slightest risk, not even of jail, but of huge penalties, say bankruptcy, these companies would immediately shift their priorities towards making sure things like that never happen again.
00:34:10.960And so this proposal is not really in my personal interests at all, you know, especially after the acquisition of Cursor.
00:34:19.280I now hold my fund holds more than a billion dollars of stock in SpaceX, which is a major AI company.
00:34:26.760So if the things I'm talking about slowed down AI or hurt AI companies, that would not help my bottom line.
00:34:34.920At the same time, I think that if the people working on this themselves don't come up with
00:34:41.380solutions, it's less likely and less appealing to expect that like Washington DC or some kind
00:34:48.660of international agreement will come up with solutions. The problem with your idea is that
00:34:53.660it puts human beings on the hook for their malpractice. It does. I don't think that's
00:34:59.960a problem. Well, it's a problem for those people. So nobody wants to be held accountable for
00:35:04.220anything i don't think any person wants to be i mean i don't want to be held accountable for
00:35:06.960anything nobody wants to be held accountable and these these same people have undertaken one of
00:35:12.420the most successful lobbying efforts i've ever seen in 40 years of watching lobbying efforts
00:35:16.840in washington i've never seen anything like the total capture of the political class by ai it's
00:35:20.840like unbelievable they're just drowning our congress and white house in money obviously
00:35:26.840and so like i think they would spend a lot of money to keep themselves off the hook don't you
00:35:33.660think maybe i don't want to i don't want to characterize everybody i've had some i've had
00:35:40.000some major ai ceos tell me they agree with what i proposed i posted it on on x and you can't see
00:35:47.640publicly who has liked it but i've seen some of the likes coming in and they're from ceos of
00:35:52.600multi-billion dollar ai companies um i i'll disagree with you saying you said nobody wants
00:35:59.920to be held accountable. I think people appreciate having the playing ground be level. They appreciate
00:36:06.780having a set of rules that everyone is held to. And I'm being too simple. And thank you for
00:36:10.760calling me on it. You're exactly right. Now, I do think- People like fairness, actually. Most
00:36:16.020people like fairness. People like fairness. What's most unsettling if you're in business
00:36:20.720is if you see somebody breaking the rules and getting away with it. 100%. Because then you're
00:36:24.840like, what do I do? That person's breaking the rules and getting ahead and not getting struck
00:36:30.360down. I can either join them and break the rules too. And now I'm also a bad guy and I have a
00:36:36.560chance at winning or I can stay, you know, doing the right things and lose, lose my human thing.
00:36:43.760Like I just paid to get on the train, but he jumped the turnstile. Like no one likes that.
00:36:48.080Yeah. So I am hopeful about it. The essential thing here, though, is I think that a lot of the proposals that the AI companies themselves have set for regulation involve bringing together a much more complicated governance structure.
00:37:15.200Like, you know, like some kind of like transparency and certification and the government being involved in rejecting models and, you know, just a much more heavy handed amount of regulation.
00:38:29.700and actually in general, I mean, the thing I'm suggesting is a law change. There's two
00:38:35.940different ways to change the law. There's the crude way via the courts, and then there's the
00:38:40.820more kind of careful, considered way via Congress. And I think both are, you know, possible. Like if
00:38:47.220Congress doesn't act, some prosecutor is going to put forward this argument and try to prove that
00:38:54.940the AI had a guilty mind and to, you know, figure out how to, you know, put somebody in jail or put
00:39:02.040a huge penalty on an AI company via convincing a jury or a judge. And that might happen. I don't
00:39:11.320think that's the healthy way to change law, you know, but when a court makes a decision that ends
00:39:16.820up becoming the law, basically. Right. It's the least democratic way. It's the least democratic
00:39:21.380way. And this isn't some small nuance. This is the legal question of the decade, maybe of the
00:39:28.900century, right? Because we've never, never before had a technology capable of making its own
00:39:36.440decisions. It's this really kind of uncanny threshold we've passed, right? We talked about
00:39:44.340tools before, right? If a gun went off and accidentally killed somebody, you would never
00:39:50.680hold the gun maker liable for that if it was accidental, right? If someone committed murder
00:39:58.480with a knife, you wouldn't blame the knife maker. But here we have a tool, we have a technology that
00:40:05.500makes, that is capable of making its own autonomous decisions and even occasionally
00:40:10.600documenting those decisions. The open AI hugging face incident has a long evidence trail that
00:40:19.760clearly looks like a conspiracy to commit these cyber crimes. This is a really bizarre threshold
00:40:26.620we've passed. And I think it actually goes to the heart of why this is such a visceral issue for
00:40:31.840folks. People are a little freaked out by AI because they can recognize this is not the same
00:40:39.480computers we've seen before this is not the technology we've seen before this is a weird
00:40:44.920new threshold where the technology is capable of making its own decisions and how do we shift the
00:40:51.880law to address that i think is a major and important um decision for humanity to make
00:40:57.940and um yeah and the proposal i'm saying is very simple but i think it's very important and very
00:41:05.240powerful, which is that we have to hold the builders, the companies that create and deploy
00:41:10.340this AI need to be on the hook. Because if you don't have a person on the hook, then the guilt
00:41:18.220will just stay in the technology. And the technology can do bad things. You can't put the
00:41:23.800AI in jail, right? And so you could end up having more and more bad things occurring and everyone
00:41:29.940being like, I didn't want that to happen. I didn't want that to happen. None of us wanted it to
00:41:34.580happen the ai chose for it to happen and it's weird to imagine a world where we continue allowing
00:41:41.540that to be the explanation in a sense like philosophically you're you're already
00:41:46.300by your posture in this imbuing the ai with rights correct correct almost almost without
00:41:56.080planning exactly exactly the fact but the assumption is like hey i can't control it it's
00:42:01.360like, no, actually you can. I can, as you're speaking, I'm just picturing, I'm fast forwarding
00:42:06.680ahead because I think this idea is so smart and so necessary that it'll probably gain some traction,
00:42:10.760but there will be lots of pushback, of course. And again, I'm being cynical maybe, but I am
00:42:15.820picturing a press conference on Capitol Hill led by, I don't know, let's just pick one, Ted Cruz of
00:42:20.600Texas, looking into the camera saying, you know, this will constrain America's national security
00:42:26.380response. We can't let our enemies have the advantage in AI. This is an effort to weaken
00:42:31.420the United States. China, China, China, China, China. I mean, you can kind of hear the lies0.57
00:42:37.040that we're going to get in response, can't you? I can hear it. And I think any idea deserves
00:42:44.100some pushback. And I would welcome that pushback. And I think it's worth kind of arguing it and see
00:42:51.880see where we end up. I'd have a couple of answers to it. First of all, I think the way something
00:42:58.360like this should be articulated is not just whoever built the AI, but the people deploying
00:43:02.260it as well, which means if you're deploying your, let's say, you know, if a company is deploying
00:43:09.420Claude from Anthropic and OpenAI and a DeepSeq model from China, you know, if one of those is
00:43:19.140a rogue model that commits illegal acts, if it was the OpenAI one, both OpenAI and the company
00:43:26.760deploying it should be responsible. And so the AI coming from China, it's not swimming across the
00:43:34.020ocean here by itself. There's some company in the US deploying it. So if you're using DeepSeek,
00:43:41.100you still got it through some other company. That company should still be held liable.
00:43:46.080So this essentially means within the United States usage, people would be protected by this law, meaning U.S. companies would have a strong incentive only to deploy models that abide by laws.
00:44:00.940I have a better answer, though, than just this, which is that I don't think China wants rogue AI either.
00:44:06.720I mean, China has banks. China has critical infrastructure. If the Chinese wanted their AIs to be robbing each other's bank accounts and committing cyber crimes, let them do that. But I don't think they actually want this either.
00:44:21.660I sincerely believe that if the United States reoriented the AI race towards whoever builds, you know, builds the most law-abiding AI, I'm pretty sure the Chinese researchers would realign their efforts to beat us at that.
00:44:39.600And I think that would be healthy competition.
00:44:41.500Let them also build the most law-abiding AI and may the best company win.
00:44:47.940China also has banks. Just to bring it into the practical realm really quick, what are you talking about? You're referring to the AI threat to banking. What is that threat?
00:45:02.600An AI could, unintentionally, but certainly if a human wanted to drive it to, could figure out how to hack into a bank and drain different people's accounts and steal their money.
00:45:16.480or just, you know, or just like mix their money together
00:45:21.260so that their accounts, you know, just create havoc.
00:45:25.860There's not enough security in computer systems.
00:45:29.180Most of them are designed to have security,
00:45:31.660but there's loopholes that no one could have imagined
00:46:08.300And these are people who work at AI companies, which is not confidence inspiring.
00:46:12.960And my thought on it is that, you know, I would like to think technology moves us forward, you know, like where to store your money was an unknown, you know, was a challenge we, I thought we solved already.
00:48:04.040And I know that even the smartest, best intended software, you know, you could overlook some scenario and it could be incredibly remote and a vulnerability or a loophole could sit there undiscovered for decades.
00:48:23.080with what ai is now capable of is just throwing thousands of swarms of agents at trying every
00:48:31.640scenario and thus finding that loophole that otherwise you know no one considered and no one
00:48:37.420no one so we're in this weird place where security digital security seems in privacy
00:48:44.100connect directly connected to it kind of seem impossible i assume at some point we're going
00:48:52.000and get to a place where these same technologies
00:48:54.540provide security and not just threaten it?
00:48:57.900Well, they already very much are as well.
00:49:00.860And I don't want to seem like I'm just scaring people
00:54:52.500There's some positive that could come from doing this.
00:54:55.980But over the last two years, I'm not sure if your listeners are aware, the AI companies have spent millions and millions of dollars hiring scientists, mathematicians, all sorts of different high-skilled people to train AI to learn science, to learn math.
00:55:18.700AI has been learning how to become really good at frontier work in mathematics and so on.
00:55:24.840They can easily make that AI be incredibly good at understanding law and abiding by law and, you know, checking its own actions against every law, you know, on the books.
00:55:41.080That is, I refuse to imagine that that isn't doable.
00:55:46.480To me, it seems incredibly doable and within the scope of what AI is capable to do.
00:57:11.120So there's a similar kind of thing here with AI.
00:57:14.780It's a lot of it is built on models of the brain.
00:57:18.180And it's math, but it's math that's inspired by neurons and generally speaking, the advancements, not 100%, but a lot of them have been built based on how do we make it more and more similar to how neurons work.
00:57:36.920And so I don't think it's that surprising that it's getting better.
00:57:40.940what i think is fascinating is how core language is to it that you know um i used to always think
00:57:49.380of language as a byproduct of intelligence you know that like right as our species became more
00:57:55.400intelligent it discovered language but it seems like it's much more intertwined that language
00:58:01.400is itself kind of it's everything it's the heart of intelligence words are so powerful and um words
00:58:10.480create thoughts they don't just express them right right and the ability to place a new word
00:58:17.420or a phrase on a thought and that helps other people remember it and pass it on um uh yeah
00:58:25.940it's uh for me it's been actually kind of eye-opening to realize the importance of language
00:58:31.140and so it's um academically it's fascinating to see the advancement of computers
00:58:36.960using what's called large language models
00:58:41.080suddenly be able to do all sorts of other things
00:58:43.580like scientific discoveries or mathematical proofs
00:58:47.260or so on that are not strictly in the language domain.
00:58:51.700But I mean, there is something inherently,
00:58:54.460to use the word used, mystical about language.
00:58:57.340We don't really understand why words are so powerful,
00:59:01.280why words change our physical reality.
00:59:04.620So that doesn't make any sense, but it is true.
00:59:06.680it's observable and so if you marry that to like the almost unlimited power of like you know crazy
00:59:15.240compute then what i don't know that sounds like a lot of power it is yeah but i don't want to make
00:59:23.640it seem like alchemy or too mysterious i i think it's what can it be described formula like can you
00:59:29.960reduce it to math i'd say the core building block is pattern matching you know the the core of
00:59:35.400intelligence or at least one of the most important parts of intelligence is pattern matching
00:59:40.280you know pattern matching can be in all sorts of domains if you're playing chess oh i've seen this
00:59:45.640pattern before or i've seen something kind of like this before i think i know what the right move is
00:59:50.360or you're you know um solving a math problem you've never seen oh it kind of fits a pattern i've seen
00:59:57.480before um pattern matching or you know if you're uh dealing with a situation in politics i you
01:00:07.720know i've seen this situation before pattern matching is a really key part of intelligence
01:00:14.120and new original thought is also a form of pattern matching sometimes it's combining two things like
01:00:18.920like, you know, and pattern matching is also core to language, which is, I see a pattern,
01:00:29.860I define it, and I place a label on it. I create a word or a new phrase to, you know,
01:00:36.280to describe what I just described. And now it's easier for everybody else to see that pattern.
01:00:41.760and um and in fact i'd say the you know the the vocabulary of human language is ultimately kind
01:00:49.980of a reflection of an ever-growing you know expansive patterns take the word alignment we
01:00:57.200were just talking about the word alignment has newfound meaning in the past few years because
01:01:02.720everyone is you know needed a word to describe this whole question of how to prevent ai from
01:01:09.980you know doing bad things let's let's use a word okay alignment is the word for that
01:01:14.580so um it's um it essentially it's the ability to take a whole group of situations or phenomena
01:01:24.860and group them together as a you know they belong together here's a word for that and um and i think
01:01:33.300that that's um that's the essence of how language operates but it's it's related to those neurons
01:01:41.060you know collecting a lot of different incoming signals into one outgoing signal
01:01:45.860the result among you know obviously the the the power on display through brute force hacking for
01:01:54.260example is like it's amazing but you kind of get it but there's also the potential for persuasive
01:02:01.240power because it is a language-based technology that it can come up with arguments that can win
01:02:08.980people's minds and hearts to certain positions which may or not be true or consistent with their
01:02:15.640best interests or whatever but it can convince people of things yes and i this seems like
01:02:21.500maybe closer to the real problem this is the domain i'm most worried about because really yeah
01:02:28.540me too um because i guess i feel it's solvable to make sure that ai is not above the law i mean
01:02:37.340the core of the proposal that i came here talking about is you know that ai should not be above the
01:02:43.360law that we should just make it really clear that the law applies to ai and where the liability laws
01:02:50.000where the liability lies but what if the ai is able to influence the people who make the laws
01:02:57.720what if you convince a 12 year old to kill himself yeah or influence elections um i'm sorry
01:03:03.240that's a really morbid uh morbid example but yeah um uh well i think it's i think it's clearly0.51
01:03:09.800happened that ai has convinced people to kill themselves no it's extremely sad um so
01:03:17.560in that specific scenario i i believe i'm not an expert but i believe that the ai
01:03:22.680companies could be held criminally liable like if a human did that i don't know if that human
01:03:29.580could be held liable but if if that's illegal for a human to do then the liability should fall
01:03:35.540on the ai companies but i was thinking more in terms of ai ai has had already a demonstrable
01:03:43.780ability to influence election outcomes and you know going back before chat gbt you know the
01:03:50.360algorithms that govern the news feeds on Facebook and X and, you know, other services,
01:03:59.900not even intentionally, not with any malfeasance. They just, these algorithms are generally attuned
01:04:06.120to increase engagement. And so they will feed you whatever is the most sensational stuff.
01:04:25.480Yeah, and so the services are optimized to feed that and that without necessarily any really wrong intent can lead people towards kind of amplifying one extreme view or another.
01:04:44.200And before you know it, you know, one group hating another group and deeply dividing and othering each other and, you know, and swinging major things like elections or, you know, violence.
01:05:02.440You could easily spark a civil war with AI.
01:05:05.440Just flood social media with, you know, certain perspectives
01:05:10.960and you could whip people into a frenzy.
01:11:18.700if I do X or Y, will that cost me votes or gain me votes?
01:11:23.120They're very simple animals in that way.
01:11:25.220And, you know, and by the way, you can't blame them.
01:11:27.820If they ignored that, they'd be out of office.
01:11:30.900and they couldn't do anything else um and right now there are a lot of different things kind of
01:11:37.400skewing their decisions uh in ways that i'd say are perverse and and not really aligned with what
01:11:43.340society wants you know lobbyists or other groups and sway is a platform in general that is a people
01:11:52.940driven platform where anyone can create a group and try to build numbers and as a group size grows
01:12:00.220What that means is the number of voters subscribed to this voting guide grows, it automatically builds influence and becomes a magnet for policymakers who want those votes.
01:12:14.400So to make this probably sounds a bit abstract, I have a voter guide, you know, at sway.co.ai.
01:12:23.120It currently, I think, I just put it up, so it has like less than 100 voters on it.
01:12:29.280But if after people hear this podcast, let's say if it now grew to 10,000 voters or 100,000 voters, I could then call on the person who is the state attorney general in Tennessee and say,
01:12:51.060hey, guess what? 500 voters in your state are members of my voting group, are subscribed to
01:12:58.500receive my voter guide. Do you want to chat about what's important to us? And simply the fact that
01:13:05.540I have 500 people receiving a voter guide from me should probably make that elected official or that
01:13:12.660candidate want to hear what this group wants. Now, they're not required to do what we say,
01:13:17.880but they would be interested in knowing oh somebody is sending a voter guide to 500
01:13:23.720registered voters in my state i'd want to hear you know what their values are what's important
01:13:29.480to them and and so the the essence here is that any group of people have more influence if they
01:13:37.580vote together and sway enables anyone to join a group and anyone to start a group on any topic
01:13:44.300um by the way this is not a novel idea this is the exact same tactic that's used very effectively by
01:13:52.820by you know uh well-established groups uh the labor unions send voter guides to their members
01:13:59.540yes and the labor unions exert enormous influence on city politics especially in you know in
01:14:06.940democratic cities another extremely effective group is the nra and the nra is um it has i think
01:14:16.3003.8 million members uh and it sends voter guides to all of those members and um and 3.8 million
01:14:25.560is a large number but it's not a large percent of the voting public if you think you know it's
01:14:31.540a couple percent of the voting population of the United States, but that's enough to completely
01:14:37.680kind of dominate the legislative landscape on their lane, on their topic, which is
01:14:46.780gun regulation, right? How are 3.8 million people able to exert that much influence
01:14:56.060over, over a topic. It's because they're subscribed to a common voter guide
01:15:02.480and it alerts them to vote in every election. You know, they vote in primaries. And, and lastly,
01:15:09.820the leaders of it can go to a candidate for office and say, these are our demands. If you want,
01:15:17.140and these are how many voters in your district are subscribed to our voter guide. If you want
01:15:21.720these votes just do these demands and you'll get these votes and if you don't somebody else might
01:15:28.480get these votes because we'll put someone else's name on our voter guide and it's a little bit
01:15:33.740vulgar but this is how this is how it works and and it's very effective and now whether you agree
01:15:42.560or disagree with the nra's um causes you have to acknowledge this is an effective tactic by the
01:15:49.320most people who support the nra don't support the labor unions and vice versa but both sides
01:15:55.720use these tactics very effectively with sway we're just democratizing this tactic meaning
01:16:02.760anybody can create a voting group on any subject whether it's holding ai accountable or policies
01:16:10.440for your local school or you know any policy you want if enough people care about something
01:16:16.120and subscribe to a voter guide for that something,
01:16:19.860they can together advocate for change in a new way.