00:00:26.220the graph for him is even worse a hundred percent a hundred percent it goes from zero percent
00:00:36.320well his emailed statement responding to these accusations were okay also came out as 100
00:00:43.680percent ai written by pan graham so i hope that the ai was like okay i regret nothing
00:00:50.460i love an ai having to make an answer about how this isn't written with ai and i'm sorry
00:00:58.060that things looked like they were written with ai before i wonder if like whatever he's using
00:01:03.680uh asked him at first like are you sure it's ethical to have me write this
00:01:08.180i know would you like to know more hello malcolm i'm very excited to be speaking with you today
00:01:14.600because it turns out that there are apparently some groups that are being discriminated against
00:01:19.880being falsely accused of using AI to write and they don't use AI to write they say one of these
00:01:27.820groups is um African a or black Americans who are like no we these I gotta jump to the punchline of0.56
00:01:36.840what you told me on this because that's what we're going to be getting into okay but there have been
00:01:40.620these black academics who have complaining that the AI searchers are all racist against them
00:01:45.880and what people have done is run their work through ai detection and they've all passed
00:01:52.540completely up until gpt gets popular yeah they're all getting hit by ai detections and the reality
00:02:00.320is is what we are seeing and this is what we're going to be talking about here is communities
00:02:04.680that became so used to cheating that the idea of not cheating is completely beyond them
00:02:12.060And I guess because this is a new means of cheating, potentially, it's it's they're getting caught, whereas before maybe the method had been around long enough to not get caught.
00:02:22.860In fact, there may be an interesting case in point there of someone who has has evaded this particular black spot on their record because they continue to use old cheating technology instead of new cheating technology.
00:02:35.620yeah so anyway let's though start with the lead story which was broken by cremeu uh we love
00:02:41.520following on x uh and we love his substack he he wrote if you read about pangram you'll quickly
00:02:47.640see a bunch of people claiming that it doesn't work worse they'll sometimes claim that it's
00:02:51.820biased pangram allegedly discriminates against autistic authors against anti-vaccine authors
00:02:57.920against people i'd politely described as conspiracy theorists on both sides of the aisle
00:03:03.360and most prominently against African writers. How will it supposedly flex their work as AI?
00:03:10.220There are a lot of articles about Pangram and other AI detectors mistakenly flagging
00:03:15.780Black and African authors as using AI to do or assist with their writing. The most prominent
00:03:21.420piece that comes to mind for me was published in the Pan-African Review. The piece was an unusual
00:03:27.360breakout for the review. The journal generally enjoys a pretty limited circulation. I suspect
00:03:32.780this is because of the import of the topic area and the utility of providing an example to point
00:03:38.220to when people want to explain why they were wrongfully flagged as using ai for writing so
00:03:43.880i'll consider the perspective of this piece to be emblematic of a community's wider concern oh by
00:03:48.200the way for people who want to get around this um rfab.ai's api which you can get by going to
00:03:54.300rfab.ai backslash api you give it to your ai one of the things that actually gives your ai the
00:03:59.480capability to do is feed anything it's writing into pengram yeah specifically pengram too
00:04:05.080yeah specifically pengram too to look for what gets flagged and then send it to models with
00:04:12.080framings that we have that are very good at human-like writing to specifically rewrite it0.53
00:04:16.460so pengram can't detect it so if they weren't using black people watched our show they wouldn't
00:04:22.440have a problem with this i know poor things um so he writes the piece is authored by one timmy
00:04:28.300Olanguju. Olanguju is a lawyer and public policy expert working at the intersection of tech
00:04:34.500governance and development. His claim is that writing in formal English will be flagged as an
00:04:40.220AI generated by an AI text detector. Okay, so Malcolm, what he's basically saying is that
00:04:47.140African writers are going to be flagged by Pengram because their writing is too perfect.
00:14:21.920So what I thought about first when I was reading about this was, of course, the most recent academic kerfuffle involving someone who was, I guess you could say,0.91
00:14:32.740conspicuously black which is to say someone who really made their ethnicity and racism0.83
00:14:38.340a core part of their academic identity and of course i'm speaking of jason our day0.77
00:14:43.880um the the late academic uh of cambridge who sadly committed suicide following allegations
00:14:52.400regarding his academic integrity allegation the proof well no so not everything was fully proven
00:15:01.080now the most the most serious thing of everything that was accused against him although i'm sure
00:15:05.980more will will take place when people get deeper into the book that he authored because i'm sure
00:15:10.440there's a lot of stuff in there that is very easy to disprove because a lot of it's just not
00:15:14.740physically possible what he described um like just i don't know we might get into it um the
00:15:22.940whole marathon but like with tree trunk legs a lot of this doesn't make sense but um so the
00:15:28.080academics dave harris and martin hammersley raised concerns about him actually as early as 2023 which
00:15:33.980i didn't know about they said that there were similarities between one of his papers on
00:15:38.120minority students mental health again to my point about him making race kind of his whole spiel
00:15:43.360an earlier study by arjun menon mem memon who um had written something similar and there was just
00:15:53.880there were way, way too many similarities. So then two journals subsequently published
00:15:58.720corrections addressing attribution and textual overlap. So it was pretty clear that he was
00:16:05.080guilty of kind of like at least semi-plagiarizing. But then more importantly, some quotations
00:16:11.340presented as coming from Arday in his research really, really, really closely resembled
00:16:16.820quotations from participants in Memon's earlier study. Like it looked like he had just taken
00:16:22.000quotes from this other guy's earlier research, and then just use that as his research because
00:16:27.920someone had conveniently already done the interviews for him and he could just use those.
00:16:33.240So Retraction Watch, and I've linked to all this in the show notes, they documented examples
00:16:36.880and reported that Arday later removed or altered numerous participant quotations because he
00:16:43.560realized he was going to get caught. And if this ultimately substantiated, and Cambridge is actively
00:16:49.200investigating this after first defending them sorry jason our day after first defending him
00:16:55.300they're now investigating him um well we may find out whether or not he was actually super super
00:17:02.080guilty um but this is going to be not only a plagiarism problem probably but also just a
00:17:08.720a research integrity problem and i think that the core thing with jason our day i think what we saw
00:17:15.940was this guy's career when you look at how far he got in his career um it shows that if if somebody
00:17:22.820claims to be like black and disabled or apparently just black they do not double check your work
00:17:27.200right yes this happened with an entire journal yeah well and that was that was one example of
00:17:34.020his work and i think what you can maybe look at when it comes to your your assertions about
00:17:38.420cheating which i think to be some they're they're interesting um in that the people who are using
00:17:45.220AI are getting caught now. And they're getting caught because they're using new cheating
00:17:48.720technology without really understanding the countermeasures that may be at play.
00:17:53.060Jason Arday, I think, may have been a pretty sophisticated cheater. And of course,
00:17:57.920all will come out later when people do investigations. So all of this is very
00:18:01.400alleged on my part. But I actually was like, oh, well, why don't I try the Pengram thing with his
00:18:05.860work just to see? Because maybe he was trying this out or maybe he wasn't. And from what I can
00:18:11.380tell he wasn't, but the most interesting thing is it's almost impossible for me to determine
00:18:16.260what he actually wrote or if he wrote anything. What do you mean by that? Yeah. So I, to do my
00:18:24.360whole pengram thing, I found some of his work in this case. Uh, like I went to Google scholar and
00:18:31.900I searched his name and the only work that he solely offered authored I could find was from
00:18:37.0602018, 2019, maybe like one or two articles from 2020, both academic or just editorial random
00:18:43.820like articles, like blog posts, basically. After that point, though, everything he wrote and
00:18:50.360published, unless it's somehow been taken down, was co-authored. And I ran all of it through
00:18:57.020Pangram. Nothing was AI generated. It all came back as 100% human. But also, I was shocked by
00:19:05.860the fact that i couldn't find anything that he had authored on his own and i wondered if it turns
00:19:10.540out that maybe part of his gambit and what actually enabled him to get by a lot of the time
00:19:17.100was by proposing to co-author things with people and then just having them do all the work um and
00:19:25.660it's very hard to get caught cheating when you do a group project like look you need a black author
00:19:30.400on this for it to get put through right? I mean in many of the instances where he did co-author0.88
00:19:35.660articles which were quite often almost exclusively about things like racism and disability etc
00:19:42.040um he did often partner with people who are not black at least um or of of like more obvious
00:19:52.300African descent so far as I could tell though not all of them were white it could be that he used
00:19:58.120his prestige as a character because he was definitely rising as this like amazing, famous
00:20:05.480person with this incredible background where he would collaborate with people on projects and
00:20:11.280then they would just do all the work. And the reason why he doesn't have any AI detected work
00:20:15.900is because he didn't actually do any of the work, which kind of, to me, seems much more smart and
00:20:22.040sophisticated because we all know about that group project dynamic in academics environments,
00:20:27.540yeah we're like you're stuck in a group project with people you need to get the thing done you
00:20:32.520can't handle the fact that these people are doing absolutely nothing so you just take all the work
00:20:36.500home and you do all of it the greatest thing about being married to simone and working with
00:20:43.500simone is i don't have that dynamic at all i always know that she's working her hardest yeah
00:20:48.640but the worst part is that malcolm still does all the work and then just gives me credit along with
00:20:52.420him which is extremely frustrating because it doesn't things and it's also one of the reasons
00:20:57.560i work working with bruno like he doesn't he doesn't do work as fast as you or i do but i
00:21:02.780know he's always working on something and he doesn't need to bug me with what he's done
00:21:06.060yeah no everyone who works on rfab is a major contributor and not a dead weight and yeah there's
00:21:12.800only three people who work on rfab it's me there could only be free look we have very high standards
00:21:17.740um and i and bruno we love you very unrealistic standards for people yeah we're just like
00:21:23.280yeah we very unrealistic yeah the the fact that yeah any we would work with anyone is
00:21:28.400is a testament to them and i don't know how they can tolerate working with us bruno i don't know
00:21:31.620i'm not i'm not a very nice he's not very nice but it's not that i'm not you guys should hear
00:21:36.720how he talks to ai it's just like why would you call me about this never ask me this again you
00:21:43.060should be handling this by yourself he's like saying all this to the ai i've said this before
00:21:47.420The only reason you don't get that from me, Simone, is because you're my wife.
00:21:56.520You're being extremely, extremely accommodating.
00:22:00.160And to outsiders, it seems so direct, but they don't realize what real direct looks like from you.
00:22:08.320Anyway, I do think that that's an interesting method on his part.
00:22:12.440But the larger story here that I find to be really interesting is that the tension that we have between AI use and people who lean toward progressive elite circles, like journalists, like academics, like authors, because they're all claiming to not to hate AI and they're all.
00:22:55.660You're really screwed if you don't use it.
00:22:57.100So the people who are on the progressive side of this war, who have to at least performatively say that they don't like AI and that it's wrong and that they should do everything by hand, the people at the top are all going to be using AI, but they have to lie about it or somehow apologize for it constantly.
00:23:14.160And it's creating very good comedic effects, but also a lot of tension.
00:23:17.660So I'll give you some examples about academics also using AI and lying about it, because this is not just people from...
00:43:13.100He is both a book reviewer and a novelist.
00:43:16.000and what they discussed in their episode is his own ai plagiarism controversy where in the end he
00:43:22.900had his ties to the new york times cut um because they think he used ai in a book review
00:43:29.900which i do not care it's a book review like what matters is if he liked the book or if he didn't
00:43:36.240like the book and if if he tells ai to say hey say articulately that i thought this book was bad
00:43:42.040that's enough for me like if i think maybe he didn't read the book maybe he had ai read it
00:43:46.320which is what you and i would do that's that is well no i actually listen to books but i don't
00:43:51.360read them because i i am trying to echo the the new style of our era we are entering the new dark
00:43:58.320ages i'm not sure if you've heard this but we are um where apparently literacy doesn't exist anymore
00:44:03.000and um hopefully we get to wear those crazy hats i hope that hats are coming back because that was
00:44:09.120a dark ages thing so those hats were well wild the good dune series frank herbert's dune sci-fi
00:44:16.340miniseries is is anything to go by the future is going to have some great hats yeah no dark ages
00:44:23.140dark ages brings hats and dune is i think very dark ages and it's kind of uh so we're yeah good1.00
00:44:29.660you know sartorially speaking and with more jews jews have to wear their silly hats yeah they have1.00
00:44:35.800and they've maintained hats they're they've got a whole evolutionary cycle of silly hats this is1.00
00:44:41.600true their awesome hat continuity is solid whereas the rest of western society has massive hat0.73
00:44:47.080fluctuation though i guess you could say the same of like china you know where they have the crazy
00:44:52.100hats with the long the long wings on them do you know why those were invented i told you do you
00:44:56.180remember i have no idea okay so the crazy hats with the long wings exist because i think one
00:45:02.460emperor really wanted all the guys who like watched him in the audience to stop gossiping
00:45:07.620with each other and so he made the wings really really long because if you then turned your head
00:45:12.060they just slapped the next person next to them is that it yes so allegedly i can fact check that
00:45:20.300later she's gonna fact check it later what is she she knows i edit these so anyway she left me with
00:45:26.900this random memory to fact check for her and it is an urban legend by the way the reason historians
00:45:32.780treat it as an urban legend is the design evolved gradually over centuries from an earlier tang
00:45:37.420dynasty and even earlier photo head wraps soft cloth corners that tied the hung were stiffened
00:45:43.500linksened and stylized long before the song late tong and five dynasty and examples already showed
00:45:50.080spreading or elongated forms song styles exaggerated an existing trend rather than
00:45:55.120inventing something brand new for anti-gossip reasons. Contemporary song sources do not record
00:46:00.380a Zhao Kogin or any emperor ordering wings specifically to stop gossiping. Official histories
00:46:06.460lack support for the claim. The anti-whispering explanation traces to later explanations,
00:46:12.620most often linked to 13th century or Yuan era writer of dubious reliability, Yu Yan. Modern
00:46:20.320scholars including art historians describe it as unfounded folklore but i just find that so
00:46:25.560delightful because i didn't understand why they had those long flaps it didn't make sense but
00:46:29.000anyway really cool hat technology right there yeah we need we need more hat technology forget
00:46:34.880these meta glasses we need more but anyway they also talk but you you can do it simone you have
00:46:41.640a fan base you can you can go out and invent hats i haven't worked out i need to like try out so one
00:46:49.880the bible says women should have their head covered when they're praying and maybe if you
00:46:53.740want to be safe at other times yeah maybe all the time you've got cover on it i love the bonnets on
00:46:59.960you you used well i'm thinking about a wimple i feel like a wimple is more of a like a thing
00:47:05.980for talking dark ages what's a wimple um like think if i put a napkin on my head
00:47:12.680and i just kind of secure it on like what nuns wear but more white okay that's like a wimple
00:47:18.660i mean oh that no i don't like that your puritan look is way cooler uh get a witch hunter hat or
00:47:24.620something oh wait what is a witch hunter hat that is not a thing are you serious yes it is a thing
00:47:29.740i don't know why you're talking about anyway speaking of people in in the uk this um
00:47:36.520you reform uk candidate though i don't think he ran successfully named matt goodwin self-published
00:47:43.500a book called Suicide of a Nation. Jesse and Katie also discussed him in their podcast talking about
00:47:48.920people being canceled for AI use in their work. Apparently, there was some hallucinated data in
00:47:54.740the self-published book, though it also seems like in separate coverage, there were just issues with
00:47:59.620like his sources and stuff. So I'm not even sure if he used AI, he just maybe made some mistakes
00:48:04.380with his research. But he definitely got a lot of flack for allegedly using AI, which just also
00:48:11.060seems to be an accusation people like to use if they don't like someone whether this person is
00:48:15.240autistic or african or reform uk just like it's ai um is the new is the new insult in our new
00:48:21.760culture wars and they also talked about a washington post columnist named megan mcgardle
00:48:26.660who faced criticism after acknowledging that she used ai in her working progress just saying that
00:48:31.440she uses it um and i've seen this here by the way i'm dumping in the screen here for you your witch
00:48:36.220hunter hat that's for men i mean women would wear those as riding hats like modified versions of
00:48:42.420those but like i don't know we can work it out okay continue but i love that all these people
00:48:48.420are being attacked for being honest and the people who are lying like they're all lying like
00:48:53.740apparently like all black academics are lying that it was that like 86 percent of everything0.94
00:48:58.200going into that journal for black academics yeah that was that was insane utterly insane0.81
00:49:04.000And what I think this all means is that it's going to be a very high-tension culture, not on our side, but on the side of progressives, where, again, you have to use AI to be elite and to succeed, but then you also have to either constantly apologize for it or hide the fact that you're using it at all, which is very, very interesting.
00:49:30.180and i i see this already happening with youtube influencers that i follow like very openly
00:49:37.100progressive mom donnie supporting um youtubers like chelsea fagan of the financial diet or
00:49:44.840yeah financial diet who admits to using ai in her work uh but is like well i only use it for like
00:49:52.500the smallest things and and i'm i'm basically like i'm not happy about using it um like it's i know
00:49:58.440it's evil and capitalist and wrong but i do use it because i think she's done the calculus
00:50:03.820and she understands that if it were to come out like her team's use of ai and they lied about it
00:50:10.940she would just be permanently canceled whereas here she's able to say no no no i i was always
00:50:16.300i told you always that we had this like this was never um something that i lied about which is
00:50:21.680important um and i just want to make one little footnote here about i don't know if you caught
00:50:27.540this in the beginning of Cremieux's article, but he alluded to people also saying that autistic
00:50:34.320people get disproportionately flagged as having- I think it's that people who use autism as like
00:50:40.300an excuse who are getting flagged. Well, it's actually in the very sentence where he mentioned
00:50:47.080that accusation, he linked to a post on X that disproved it in the most autistic way possible.
00:50:54.900So he was, quote, tweeting a post on X by Christianity on the Spectrum, which both created and shared a long-form report and a YouTube presentation sharing his analysis on the matter.
00:51:09.720You've got to, there's like, it has an abstract.
00:51:12.680The abstract is, there have been many concerns raised that AI detection software disproportionately identifies text by autistic authors as AI written.
00:51:21.100This claim is assessed by using 24 different open source and commercial AI detection classification algorithms on samples of documents pulled from a pool of 143,758 documents from both autistic writers and non-autistic controls.
00:51:37.340Writing was taken from a variety of websites covering different writing types, styles, topics, and genres.
00:51:42.480An analysis of the data did not find meaningful or significant bias against autistic authors in AI detection software.
00:51:49.000Across most tests, human authored autistic writing was either just as likely or less likely to be flagged as AI than both non-autistic controls and the publicly available benchmarks.
00:52:00.480In very small number of tests that showed bias against human authored autistic writing, the differences were slight or within the margin of error and came almost exclusively from unreliable detectors.
00:52:12.500commercial detectors like pangram 3.3.2 and 4.0 which are the most likely to be used for ai
00:52:19.380detection showed no appreciable bias against autistic writing but this is just that's just
00:52:24.600the abstract the thing is like how long is his youtube presentation his youtube presentation is
00:52:30.580an hour and 22 minutes long okay and what i find it's so fun about this just to close the loop
00:52:39.300is so the autists and the Africans were accused of using AI to like to write basically. And the
00:52:49.200Africans who responded were like, it's racism. It is the colonial enforcement of British standards
00:52:57.780upon our people, causing us to just be so perfect in our English writing that AI just assumes
00:53:06.040that this must be assisted by artificial intelligence and so they make this basically
00:53:11.940whole like guilt-based colonialism white people bad argument to try to um push back against such0.63
00:53:20.320insinuations and accusations whereas the autists in turn are like okay like let's you let's use
00:53:27.320all of the, all of the AI detection softwares and a sample of, what was it again? 143,7580.71
00:53:37.200documents, including a control sample just to like check and find out. And I love that difference
00:53:44.960in refutation of an accusation. The, the race-based one based on, you know, anti-colonial
00:53:51.500guilt tripping and claims of being superior writers versus the autistic like incredibly0.99
00:53:59.860oh Malcolm you're muted again can you hear me now yeah let's find what's true here people0.87
00:54:05.260that's that's all they cared about that's well that's the autistic response to things0.53
00:54:11.000is that was I mean that's what it was me when I was like am I a bad person how am I hurting people0.91
00:54:17.780how can i be less bad and hurt people less and so you went to ai i will i will go to clod and i
00:54:24.860will turn it to maximum power and i will give it 20 years worth of diary entries and i will give it
00:54:30.740every single calendar event of my 24 hour scheduled days and it will tell me exactly what all of my
00:54:36.860flaws are and then i will work on them systematically until i've addressed them and
00:54:41.580then it will get better and i do think that that is kind of um that is the difference between um
00:54:47.140Autistic justice and racial justice, I suppose, but we'll see.0.70
00:54:52.940It doesn't change the fact that I'm evil and I hurt people.
00:55:47.140we tried i mean her fever's below it's it's it's at 101 like she's not in danger but
00:55:53.620i don't like seeing anyone uncomfortable my children babies anyway this was all very
00:56:01.900entertaining i obviously love um smug hypocrisy i i'm rife with it myself you know it takes one
00:56:08.860to know one so i uh i love seeing masterful work at play and um and this is the best of the best
00:56:16.280I mean, that's pretty peak to be like, I don't write with AI, and your colonial standards are so terrible and oppressive, but we mastered them, and then you punished us.
00:56:27.260It's like a double, like, the accusations there.