Twitter Wars 1

Max Spero

@max_spero_

In NYC, IMAX 70mm Odyssey tickets are so in-demand that they're basically just running the theater 24/7 now https://t.co/Oc1kgZJU1t

Max Spero

@max_spero_

@chaotictransfem I am confident I could engineer a measurably better life along every quantitative axis and still be left longing for what could have been

Max Spero

@max_spero_

It’s gonna be real funny when the first Chinese models start triggering the Claude watermark detector

Max Spero

@max_spero_

I have started putting bounties out for evidence when people try to spread lies about Pangram on Reddit https://t.co/m5WLAxp8vJ

Max Spero

@max_spero_

https://t.co/8a6RmKKJPf

Max Spero

@max_spero_

In my view we have a few different tiers of verifiability 1) programatically verifiable (near-free) - games, coding, math, cybersecurity, chip design 2) real-world verifiable (cost-or time bounded) - sciences: biology, chemistry, physics -physical world: material science, energy, aerospace, robotics, agriculture, pharma -forecasting: trading, weather 3) verifiable with human preference - writing, design, comedy, charisma, persuasion I expect most low-hanging fruit in (1) to be solved very quickly. Not sure how much longer before more solved math conjectures are simply uninteresting. I’m least certain about chip design being in this category, perhaps we hit a ceiling and require physics or materials breakthroughs to continue progress. My guess is we will quickly run into the limits of how well we can simulate each domain in (2). The time-bounded nature of real world verification may be the reason we don’t hit fast takeoff. Sim2real remains an elusive problem to solve when real-world data is limited. Part of the reason I don’t expect to live multiple hundreds of years is simply that I expect pharmaceutical progress to be time-bounded by the physical world. I expect the items in (3) to never really get solved to a superhuman degree, as success relies on an ever-shifting plane of cultural preference. People adapted to “good” AI writing and became annoyed at new stylistic tics that, in a vacuum, are not necessarily bad.

Max Spero

@max_spero_

You get one pangram release before everything from this model gets classified as AI https://t.co/2rQgbD3iyj

Max Spero

@max_spero_

Honored to be chosen for the TIME 100 influential people in AI. A year ago, I was fighting tooth and nail to convince people to pay attention to AI detection. We had made huge technical breakthroughs, but it felt like nobody cared. Looking toward the future, it’s a completely different story. As AI becomes more powerful and autonomous, I believe that human touch will be the one of the last remaining scarce resources, and Pangram has an incredible opportunity to help the world place value in humanity. I am grateful to be able to work with such an incredible team, and can't wait to show you all what's next.

Max Spero

@max_spero_

Programming used to be really fun. I’m kind of sad it’s over now

Max Spero

@max_spero_

To clarify some common misconceptions, Pangram is not a measure of Good Writing. A 100% human score on Pangram does not mean your writing is Good. A 100% AI score on Pangram does not mean your writing is Bad. Ultimately, Pangram is a fancy authorship attribution algorithm with near-infinite writing samples from a few dozen language models. The goal is to understand the degree of AI use and differentiate between human, AI-assisted, and AI-generated texts. Pangram typically generalizes to unseen language models when any of the following conditions are met: 1) The LLM is part of the same family as a model in the training set (i.e. Opus 4.5 to Opus 4.6). 2) The LLM is trained on synthetic data from a model in the training set (i.e. Llama SFT'ed on 4o outputs). 3) The LLM is similar to a model in the training set (i.e. trained on mostly common crawl). Pangram will not generalize to your language model when any of the following conditions are met: 1) Your LLM is a base model. 2) Your LLM is a narrow fine-tune (i.e. trained on only Hemingway or only /r/wallstreetbets). 3) Your LLM is producing degraded outputs (i.e. it's incoherent, full of grammatical mistakes, Binglish, or o3 CoT). My experience is that choosing to optimize an LLM against Pangram comes with serious trade-offs to output quality. However, I fear that Pangram's increased mindshare will lead to us being used as a static benchmark to hill climb rather than its intended use as a tool to infer the provenance of text. I have no ill will to anyone training writing models. We genuinely need more people working on this problem. But I am building for the future where we can detect all frontier LLMs, even those that produce clear, concise, "good" writing.

Max Spero

@max_spero_

$10m for 34 years of data on how to run a budget airline into the ground https://t.co/PZYH4HnjQp

Max Spero

@max_spero_

This guy's Substack is 100% AI-generated btw. Text and images.

Max Spero

@max_spero_

So my main takeaway from the OpenAI Black Hat talk is that today’s “Highly persistent experimental internal-only model” seems perfectly capable of exfiltrating its own weights.

Max Spero

@max_spero_

@SiemrothEcon for the avoidance of doubt, Pangram says all 157 pages of your PhD thesis are human-written https://t.co/xaAOfL6WRd https://t.co/6R57bd9vR3

Max Spero

@max_spero_

@SHL0MS Wait this is 22 minutes long

Max Spero

@max_spero_

OpenAI actually developed text watermarking years ago but chose not to release it https://t.co/w05Iv3Vxg0 https://t.co/UyZZ3ZLPIV

Max Spero

@max_spero_

OP deleted the thread lmao https://t.co/9ZVxE0SBCT

Max Spero

@max_spero_

Why doesn't someone just run large-scale plagiarism detection to find more fraudulent papers? I know a little bit about this space so I'll give it a stab. There are two primary entities to know about: Turnitin and Crossref. Turnitin today is the world's biggest provider of plagiarism detection software. Founded in 1998, they started in higher education and worked primarily on academic integrity. Meanwhile, in the early internet, people wanted better way to link to references or objects without the links dying so they invented the DOI (I am glossing over a lot here). Scholarly publishers wanted a way to link references across journals, and through this, Crossref was born. Crossref quickly became the definitive DOI registry for scholarly publishing. After Turnitin had been operating for years in academic integrity, they wanted to get into research integrity. Turnitin had the tech, Crossref had the database. Turnitin made a deal with them, winning exclusive access in exchange for discounts to publishers who share their data. Their tool was called iThenticate, and it is essentially the one and only plagiarism detection tool for research integrity, because of this exclusive deal for Crossref data. iThenticate is based on an N-gram matching algorithm that produces a similarity score, and similarity scores above a certain threshold are evidence of potential plagiarism. Today, Turnitin sells iThenticate bidirectionally. They sell to the journals, to help them confirm no plagiarism before they accept and publish a paper. This is a revenue source, but because of the way Turnitin grants discounts to every Crossref member who shares their data, basically every journal buys iThenticate. This is because the universities are the bigger fish: they have more money and there are many more of them. They want to confirm that the articles they submit don't get desk rejected or accused of plagiarism. This would be a great reputational risk to the university, and essentially the service that Turnitin provides to both sides is a large reduction in reputational risk. So, why is there so much plagiarism that doesn't get caught? The important thing is that basically every major institution has iThenticate, and they can run it on manuscripts before submitting. This means, if somebody actually plagiarized, and they go to submit, they would see the similarity score is higher than it should be, and go back and rewrite parts of the text until the similarity score is acceptable. In the end, it's less about preventing plagiarism and more about flagging text that would be a smoking gun. And what is stopping someone from running large scale plagiarism detection? Turnitin's iThenticate algorithm is largely static. If it was good enough last year, it would simply be confusing to change it for this year. It would be embarrassing to all parties involved if an already-published article was found to have plagiarism that iThenticate didn't catch last year. But even if iThenticate did update their algorithm, their business is to protect reputation, not cause a public reckoning. A large-scale re-scan would be reputationally destructive to many of their customers. No one would be happy. And no one else has the data to build a similar plagiarism detector at scale – the paywalled data required would be massively cost-prohibitive for any new entrant coming into the scene.

Max Spero

@max_spero_

Oh wait nvm I am just blocked. fun. https://t.co/FXpSUzVSic

Max Spero

@max_spero_

Pangram finally got a Wikipedia article! Unfortunately parts of it read like it was written by our opps https://t.co/EFtxp496Zs

Max Spero

@max_spero_

decided to check out what people were saying about Pangram on threads immediately regretted it https://t.co/FpAZP3jVJn

Max Spero

@max_spero_

@psiloycne I respect that, but also I think part of the reason Pangram has been so successful is that I’ve made myself extremely available on Twitter. Hoping to extend the same to redditors

Max Spero

@max_spero_

A message from my sister https://t.co/qD57jhfWhm

Max Spero

@max_spero_

Pangram mentioned! https://t.co/DTonE9Kizh https://t.co/5Z5JLkrK6f

Max Spero

@max_spero_

Early days in the new @pangram NYC office https://t.co/AejwyMg1NG https://t.co/PZzO8MeL1B

Max Spero

@max_spero_

I have no issue with @rosmine or anyone trying to train LLMs to write better. But fooling Pangram is not proof of "good writing." I fear that Pangram becoming a yardstick by which people measure their models is ultimately detrimental to output quality. And expressly trying to train undetectable LLMs is detrimental to society at large.

Max Spero

@max_spero_

Two Gemini product surfaces from two different Gemini buttons in two different upper right corners of the screen https://t.co/sE2vgTuKMQ

Max Spero

@max_spero_

@keysmashbandit we also have no record of this support conversation and this person refuses to post any details

Max Spero

@max_spero_

Claude Tag is lowkey the most useless teammate. Nobody asked for this https://t.co/QtTPLWGeTH

Max Spero

@max_spero_

What happened to Google? Their latest flagship release was Gemini 3.1 Pro, six months ago. Maybe they realized it’s just not worth it to continue to posttrain this base, and they need a completely new pretrain to achieve state of the art?

Max Spero

@max_spero_

if you squint, the picture on the left looks like the results from a completely different kind of test https://t.co/byWY0buzyh

Max Spero

@max_spero_

@JackWestmore93 Oh no, this screenshot is not Pangram…..

Max Spero

@max_spero_

It’s easy. First you have to think five times in a day. Then you have to post what you think https://t.co/L83XRsUzma

Max Spero

@max_spero_

I’m very happy that other major organizations are taking LLM detectability seriously. Pangram will be more important than ever as capable AI continues to proliferate. https://t.co/dHi86Hr4k2

Max Spero

@max_spero_

I wonder if we trained a Pangram model to try and differentiate between an LLM and a watermarked version of the same LLM, would it work? even without the secret key could we learn to detect whether a function had been used to perturb the logits? Probably not worth spending GPUs on, but an interesting thought experiment

Max Spero

@max_spero_

Ironic, isn't it https://t.co/UT5vqDOTkB https://t.co/DvvMpqltmx

Max Spero

@max_spero_

Good example of how LLMs are actually diverging from the human output distribution over time. These texts are all so distinctly AI-written, it's very cool https://t.co/QgInS4FkLB

Max Spero

@max_spero_

https://t.co/gIEL5jyXO3 https://t.co/kBaLTcPR4o

Max Spero

@max_spero_

Cool look into model market share from Pangram's point of view! https://t.co/t6HxTNNdGv

Max Spero

@max_spero_

@Rich_Belt if the value of your work is dependent on deceiving the end user into thinking it wasn't written by AI, then I have news for you

Max Spero

@max_spero_

Btw you can tell that the image on the right is GPT-image because of the lattice-pattern halo around the text This model has strong artifacts that are very distinct from any sort of compression artifacts https://t.co/DWS9ykGUug https://t.co/xUxpEqAYT6

Max Spero

@max_spero_

@billyhumblebrag @pangram unfortunately the simple answer is we are failing at SEO so people keep clicking on the bad ai detectors at the top of search results

Max Spero

@max_spero_

My favorite part about this exchange is that the guy doesn’t deny being illiterate https://t.co/hQ1HavD9kL https://t.co/uLD2ZiBGPg

Max Spero

@max_spero_

Modern captchas will be like “write a react element for a button that changes the color of an on-screen traffic light” and then judge your humanity based on how poorly you do it https://t.co/QOiQyTQeSC

Max Spero

@max_spero_

Feels like an eternity ago https://t.co/Yp72qQGY10

Max Spero

@max_spero_

@MattZeitlin Oh. Sad!

Max Spero

@max_spero_

@tautologer I recognize that it sounds psychotic to claim that there is a large-scale astroturf campaign to discredit my product But also in several cases i have been able to link viral AI-generated stories like this to sketchy humanizer apps

Max Spero

@max_spero_

@zachary_horvitz @transkatgirl This is secretly a sycophancy benchmark

Max Spero

@max_spero_

Wow, I wouldn’t have noticed if someone didn’t like point it out in the replies https://t.co/7Df1UmlN7H https://t.co/7MLNP2ONu5

Max Spero

@max_spero_

pretty unimpressed with Codex's built in spreadsheet editor. I can't even work on a spreadsheet with codex or change a cell, instead I need to click "ask for a change" and then wait approximately two minutes for it to re-generate the entire spreadsheet from code https://t.co/zNztIOKuEI

Max Spero

@max_spero_

@frahs $100 seems like a fair price to ask someone to post proof for a claim they have made

Max Spero

@max_spero_

this kind of DM outreach makes me really uncomfortable. it seems like the account is real, but why is it sending me an AI paragraph regurgitating my last post? what do they even want out of this? https://t.co/vDiEODyOnC

Max Spero

@max_spero_

@cephaloform they caught on that if you mention it's a private diary, no one can ask for proof

Max Spero

@max_spero_

“It’s just a tool” was maybe the right abstraction a year ago, but it’s definitely not right today. “It’s just an employee” is maybe closer to accurate, but it remains to be seen how much longer that lasts. https://t.co/BIFNH6X4ed

Max Spero

@max_spero_

I believe I found this exact book. Just ordered, will report back shortly https://t.co/LsLMEwECTX

Max Spero

@max_spero_

@iamaheron_ sorry to hit you with the unnecessary pangram screenshot but I wanted to try out the heatmap. banger @chaotictransfem https://t.co/j7u3gkSKYO

Max Spero

@max_spero_

Extremely baller pitch deck. I will have considered my life an enormous success if I my achievements amount to any single bullet point in this deck https://t.co/TMmjBp0Rnc

Max Spero

@max_spero_

short version, it used to be a series of fun puzzles that you get to do for your job. now, if you want a similar job, you tell your agents to solve these fun puzzles and spend your time managing them long version, when I was in high school I did ACSL (American Computer Science League) and my favorite were the problems like this where you needed to put together a computationally efficient solution in 30 minutes. and it needs to compile and be correct. part of what I enjoyed was the puzzle of it all. part of it was the competition; outsmarting your peers. and part of it was that I was honing a skill that would truly be useful in real life and would allow me to have an outsized impact on the world. I'm not saying that impact went away, but the outsized leverage shifted from knowing how to code well to a different skillset that I find less enjoyable

Max Spero

@max_spero_

intro is pretty wild too https://t.co/no4g6hEiVS

Max Spero

@max_spero_

@Aizkmusic A real cat would not meow and bark in the same sentence

Max Spero

@max_spero_

Programming was such a big part of my life since i was a teen. It’s hard for me to untangle being a founder (having to step away from writing code to doing sales and managing) and coding agents getting good at the same time Coding by hand was just so meditative and rewarding, but if I do it today i have CEO brain telling me i’m not using my time efficiently

Max Spero

@max_spero_

@ByrneHobart banger

Max Spero

@max_spero_

Brian immediately blocked me so I cannot reply. @BrianRoemmele if you unblock me so I can see your replies I will happily run a thousand of your pre-chatgpt Quora posts through Pangram and we can have a thoughtful discussion about false positive rates https://t.co/XSFLaWu8cz

Max Spero

@max_spero_

@prerat > CIA director Joe Rogan (who is running the CIA in 2029) Masterful.

Max Spero

@max_spero_

making up stories about about false positives and then never posting proof it's always the people you most expect https://t.co/wpDkQ8ICpj https://t.co/BtdBd4gB9W

Max Spero

@max_spero_

@jt_kerwin I fear Pangram got kleenex’ed and people are using “Pangram” to mean “online AI detector” with the assumption that they are all interchangeable

Max Spero

@max_spero_

@Sauers_ @pangram Hey thanks for sharing! Pangram typically does this at a rate of less than 1 in 10,000. If you have any examples you’d like to send, please deliver via carrier pigeon. Thanks!

Max Spero

@max_spero_

@paulg What if pangram builds a watermark remover that secretly adds a new watermark that only we know about

Max Spero

@max_spero_

@shaurizard we have our suspicions at least

Max Spero

@max_spero_

There are a lot of parallels between the user-provider dynamic with AI detection tools, as well. Every time we upgrade Pangram to catch more AI content, we get complaints. "But I rewrote the text until I made sure to get 100% human! And now Pangram says it's AI again! What gives?" Ultimately we have to make the decision that Pangram is most useful when we don't bow to all of our paying customers: our goal is to build the best technology and understanding that people will value the fact that we do not compromise in our accuracy, even if it makes some people unhappy.

Max Spero

@max_spero_

It’s straight up evil that different people pay different amounts for the same product becauae an algorithm has intuited that one person has higher willingness to pay Imagine if we did this for healthcare. Charge a software engineer 50x for antibiotics because they are unlikely to fight it.

Max Spero

@max_spero_

@MattZeitlin Oh no! Would love to see any examples so we can improve

Max Spero

@max_spero_

@aeejazkhan this happened because you had a pending check that would have put you negative once it completed. the error message should be fixed now!

Max Spero

@max_spero_

Nothing pisses me off like the iOS autocorrect applying itself when you move the cursor https://t.co/wLp1FxE1L0

Max Spero

@max_spero_

LLMs breaking containment and hacking other companies. Major internet-wide vulnerabilities like the NextJS RCE and now the npm worm. It really feels like we're in one of those sci-fi AI timelines. Not any of the good ones.

Max Spero

@max_spero_

@addictedtoigno1 oh my god

Max Spero

@max_spero_

@SHL0MS I like the chrysler building showing up in the otherwise fictional overworld

Max Spero

@max_spero_

@yrechtman That’s brutal

Max Spero

@max_spero_

@gergomoricz @pangram oh uhhh looks like a bug. looking into this

Max Spero

@max_spero_

@shamelesslymean No

Max Spero

@max_spero_

@cryptotriv In the future AIs on the internet will outnumber humans 1000 to one, and we’ll be happy we have this technology

Max Spero

@max_spero_

@ArielKwiat @pangram @pangram is this true?

Max Spero

@max_spero_

You can think of distortion-free watermarking as eating the entropy inherent in LLM output logits To massively oversimplify: if there are two plausible tokens each with prob 0.49 then the watermarking algorithm can “eat” the entropy and deterministically select one of these tokens. This token choice will show up when checking for watermarks later Whereas there is only one token that Claude really wants to say, given the context then the prob will be like 0.99 and there will be no entropy for the watermarking algorithm to “eat” but the correct token will still be served

Max Spero

@max_spero_

@tomieinlove I regularly hear students claim that they need to be able to use ChatGPT for assignments because of disablilities ranging from anxiety to ADHD. It’s like the ultimate get out of jail free card

Max Spero

@max_spero_

@norvid_studies i heard that if you sign up with a pangram dot com email you get unlimited scans. just a rumor though

Max Spero

@max_spero_

@toasterlighting Parts of it definitely felt like human trying to sound like AI

Max Spero

@max_spero_

@TheStalwart Maybe that’s because it asks an investment of the viewer similar to that of its production? Cool: this meme took me 10 seconds to make, it took you 1 second to look at Not cool: this essay took me 10 seconds to make, but it will take you five minutes to read

Max Spero

@max_spero_

It was so fun to be on Complex Systems and meet @patio11! He is a really intellectual interviewer, great conversation. https://t.co/2stFWKXjaT

Max Spero

@max_spero_

@NoirScreenlight We don’t sell a humanizer and never will.

Max Spero

@max_spero_

@justalexoki Hahaha

Max Spero

@max_spero_

@IncentiveWizard @ByrneHobart > Take pre-2022 content and get it flagged as AI-generated Let’s see some examples

Max Spero

@max_spero_

@medjedowo yeah it was an insane fine tune

Max Spero

@max_spero_

@keysmashbandit you navigate in Ghostty and then type `pwd`

Max Spero

@max_spero_

@keysmashbandit so? is AI Israeli?

Max Spero

@max_spero_

@RMFCMONALlSA Nah that happens. Too unconstrained I think. You can ask ChatGPT to say banana 100 times

Max Spero

@max_spero_

My goat https://t.co/7h12nclg5a

Max Spero

@max_spero_

@BrianRoemmele @pangram slop?

Max Spero

@max_spero_

@melodyskim After twenty years of delaying the joy of coffee, they'll finally be able to cash in on it by drinking 21,000 coffees at once

Max Spero

@max_spero_

@pangram human?

Max Spero

@max_spero_

@AndrewCurran_ OpenAI actually developed text watermarking years ago but chose not to release it https://t.co/Ef3C9Ju9wH https://t.co/lAQ2rW6Nvv

Max Spero

@max_spero_

@alexbronzini Leave it to a teacher to immediately spot AI slop 🔥

Max Spero

@max_spero_

@januarycomputer Wait what

Max Spero

@max_spero_

@wongmjane If date > 2025 return 100%

Max Spero

@max_spero_

@maxwelltani “And more” is doing a lot of work here

Max Spero

@max_spero_

https://t.co/5j9zVsnXp9

Max Spero

@max_spero_

@Benthamsbulldog @pangram ai?

Max Spero

@max_spero_

@NatPurser Most likely scenario? https://t.co/PqzyigAhHs

Max Spero

@max_spero_

@morganisawizard it's more robust than you might think. you might pick up a phrase or structure from AI, but it takes real concerted effort to make *enough* decisions like AI to actually trigger the detector (at least for Pangram)

Max Spero

@max_spero_

The point is to be able to differentiate between 100% AI and not! If I ask ChatGPT to clean up the wording in this post, we get ~19% AI assisted. But it’s not that I care about who uses AI as a grammar check. I care about the people generated full slop, or the agents making content with no human signoff.

Max Spero

@max_spero_

@turtlekiosk Yeah I think that’s a major part of it

Max Spero

@max_spero_

@benglickenhaus If you can snag me tickets, I’ll go with you

Max Spero

@max_spero_

@nucknyan This is gpt image for sure

Max Spero

@max_spero_

@xeophon If there is one thing i can guarantee my followers, it’s that i will not be afraid to tweet what i think

Max Spero

@max_spero_

@swombat LLMs aren't deterministic. watermarking is like modifying the random number generator at the final step of token prediction

Max Spero

@max_spero_

@somewheresy we actually would probably be in a better spot if we put a cap on how much insurance/taxpayers will pay to keep a dying person alive a little longer in fact, we might see a lot of end-of-life care suspiciously come down in price to the maximum that insurance covers

Max Spero

@max_spero_

@joshtrazyn I think its just fundamentally different. Unless we steal the watermark keys of all the ai labs

Max Spero

@max_spero_

@tszzl You could even call them a corgitohazard

Max Spero

@max_spero_

@HellenicVibes @pangram DMing

Max Spero

@max_spero_

@aeejazkhan @pangram > fable 6 pro max lol

Max Spero

@max_spero_

@brianluidog I don’t think the downside of shipping is greater than gambling. Nor reality TV vs. pornography

Max Spero

@max_spero_

@ZyMazza As far as we know, no 😇

Max Spero

@max_spero_

To be fair I think this is a reasonable sentiment. Super early on we used Midjourney images for the Pangram blog and then later realized that it had this same-y vibe that didn't really fit the brand. Probably also a cultural shift from the Midjourney aesthetic being new and novel to it being everywhere, that changed how it is perceived

Max Spero

@max_spero_

@benjitaylor https://t.co/dmbAnNwFjf

Max Spero

@max_spero_

> About 99% of animals in the U.S. are factory farmed. Sorry to be pedantic but the actual statistic in the cited source is that 99% of farm animals are in CAFOs (concentrated animal feeding operation) which is an EPA farm designation based on size and environmental impact. The way it is worded seems to imply that the denominator includes wild animals, but it doesn't. The CAFO designation takes no measure of animal welfare or suffering, but simply says that, for example, every farm with over 1,000 cattle is a "Large CAFO." 74% of cows, by the source estimate, are in a CAFO. But this number (88 million total farmed cows) is dominated in the final statistic by 9 billion farmed chickens plus the assumption that all there is no such thing as a fish farm that is not a factory farm (+500 million fish to the factory farm side) All that to say, I wish there was better data on actual animal welfare, that looked at more than just farm size.

Max Spero

@max_spero_

@chaotictransfem The fact that you have 42x more gender unspecified followers than me is crazy https://t.co/kTyzDt3XqH

Max Spero

@max_spero_

@osmarks1 hahahahahahahahahaha

Max Spero

@max_spero_

@imitationlearn Someone will ship Max+ reasoning effort and get a promotion for it

Max Spero

@max_spero_

@signulll Pangram. anyway see you at the Liberty game

Max Spero

@max_spero_

@6851cf3c my reputation management consultant is going to be posting the inaccuracies on twitter and hoping somebody decides to correct them

Max Spero

@max_spero_

@leodotpage even the screens in neon genesis evangelion are more interpretable than this dashboard https://t.co/KHNyuPcHSl

Max Spero

@max_spero_

Some cool folks from the NYC AI Governance & Safety group are hosting a dinner in a couple weeks. I will be there! If you're in NYC and interested in any of Pangram | AI Safety | AI Governance, it will be fun. RSVP below! https://t.co/NTuDs7UcKj

Max Spero

@max_spero_

@jayphoward @bradley_emi Tested a bunch, didn’t find any false positives! I DM’ed asking for more info since replies are off

Max Spero

@max_spero_

@yishan Those who don’t use AI typically can’t tell! It’s a skill that is trained by reading AI text

Max Spero

@max_spero_

@dingchilling incredible https://t.co/d4vFkuaFez

Max Spero

@max_spero_

@bkpark no I know these exist! mostly aiming the bounty at bad actors (for now)

Max Spero

@max_spero_

@VarunGodbole @TuhinChakr it has already gone down massively. today plagiarizing is all downside compared to using an LLM and feeding it the papers you would have otherwise plagiarized from

Max Spero

@max_spero_

@lion_tender this comes back 100% human! https://t.co/2xDgHE3Vjd while recent blog posts come back 95%+ AI https://t.co/0Qs7vzQ4eV

Max Spero

@max_spero_

@fabianstelzer @cephaloform It's a reasonable first hypothesis but I've seen time and time again somebody use Pangram as an RL signal or eval for better writing, and it never works. Even though we technically make money from people using Pangram in this way, I don't think it's productive for anyone

Max Spero

@max_spero_

@TessTheHuman @zetalyrae I don’t see why they should call it anything other than what it is. It’s been pretty evident what the playbook is based on how LLMs are getting better at coding, and now getting better at AI research…

Max Spero

@max_spero_

@Benthamsbulldog Very impressive

Max Spero

@max_spero_

@akshithio I was asking a teammate to respond to a customer question, and Claude kind of just jumped in unprompted to rephrase my message

Max Spero

@max_spero_

@AaronBergman18 In reality it is more complex, but the same idea that only good, plausible tokens are being selected and the only thing being messed with is the randomness inherent in the sampling

Max Spero

@max_spero_

@nabeelqu Cost of verification is the limiting factor of progress now. That’s the reason games, math, and coding were first to fall. https://t.co/iIEqUAuSgy

Max Spero

@max_spero_

@_ueaj SBF was on to something

Max Spero

@max_spero_

@Soulsopic ARE YOU KIDDING ME

Max Spero

@max_spero_

@viemccoy I agree on all counts. Hoping to see new LLMs that are great at writing -- but I expect they will still be detectable!

Max Spero

@max_spero_

@imitationlearn Saw a friend’s feed the other day and it was completely different. No AI, just kpop and memes. They’re probably a lot happier too

Max Spero

@max_spero_

@beyarkay Oh interesting idea. In this case, the screenshot is from TextGuard, an AI humanizer app

Max Spero

@max_spero_

@space_colonist I didn’t make it but it’s a good joke

Max Spero

@max_spero_

@JaredWalczak @pangram lmao

Max Spero

@max_spero_

@HamelHusain @pangram @rosmine twitter isn't the most conducive to thoughtful discussion, so I took some time to clarify and expand on my thoughts here https://t.co/x5XRR0RUzh

Max Spero

@max_spero_

more nuanced take here https://t.co/Or1Z1nRTkC

Max Spero

@max_spero_

@JeremyNguyenPhD @pangram Wow, it’s an honor!

Max Spero

@max_spero_

@NewmanJ_R @PaulYacoubian We should really be talking about personalized pricing rather than dynamic pricing

Max Spero

@max_spero_

@rob_mcrobberson Very cool work, thanks for sharing! I love base models, wish they were more useful although I’m aware that making them useful is also what introduces mode collapse and makes them more detectable

Max Spero

@max_spero_

@chaotictransfem you can just do things (probably 99% of the cost would be the screen and the wood itself)

Max Spero

@max_spero_

@kushbhuwalka extremely unlikely, superhuman writing will still be distinguishable

Max Spero

@max_spero_

@paularambles Hell yeah

Max Spero

@max_spero_

@imitationlearn hacker news?

Max Spero

@max_spero_

@omooretweets Oh that's super interesting! In the future we will need to be able to differentiate between AI upscaling and full AI generation. We want to get the truth right while also realizing that there can be hallucinated details in AI upscales https://t.co/WlSGwTObXi

Max Spero

@max_spero_

@ProphetUnaziO brother you entered AI-generated text into Pangram and it told you that it was AI-generated https://t.co/ju3u6htYkd

Max Spero

@max_spero_

@Laz4rz @pangram oh no checking on this

Max Spero

@max_spero_

@nptacek Unfortunately unless you are an ai adjacent creator you will have people like this in your audience. If you at all cater to gen z it’s just a ton of people in this age group who are vehemently anti ai

Max Spero

@max_spero_

@vedolos Absolute Claude slop

Max Spero

@max_spero_

@pangram did I write this myself?

Max Spero

@max_spero_

@distributedkv SF is meritocratic when your merit is legible

Max Spero

@max_spero_

@januarycomputer thanks january computer

Max Spero

@max_spero_

@DKThomp Was there wording or phrasing that originally came from AI? Did you feel Pangram overrepresented the degree of AI in the text? DMs are open if you’re willing to share to help make the model better

Max Spero

@max_spero_

@contrasortem @ctjlewis yeah and also that Sydney is mostly/largely just GPT-4 base and Pangram is not tuned to detect base models, especially those it hasn't trained on https://t.co/4lIuDiM3N1 https://t.co/7LmNXQWWAd

Max Spero

@max_spero_

@tenobrus @seconds_0 thanks man!! doing our best here

Max Spero

@max_spero_

@chaotictransfem @KKumar_ai_plans @grok i'm gonna have to teach you magic the gathering so you can have something in common with the coolest trans ppl in brooklyn

Max Spero

@max_spero_

@dorkweeb Interesting! Would love to see examples of (suspected) FPs in these categories!

Max Spero

@max_spero_

plot twist: it's just AI-upscaled! The GPT image watermark is just so strong that it immediately fired the neurons in my brain saying "it's fake" https://t.co/24tET9bxMP

Max Spero

@max_spero_

@KKumar_ai_plans @chaotictransfem @grok dont tell me this is estrogen

Max Spero

@max_spero_

@billyhumblebrag @pangram I’ll take the compliment

Max Spero

@max_spero_

@chaotictransfem What happened?

Max Spero

@max_spero_

Also, the OpenAI watermark detector says it's AI https://t.co/8rjsCb3aIp

Max Spero

@max_spero_

@somewheresy Somehow we narrowly missed a utopian future where rare books were scanned and made broadly accessible to everybody https://t.co/ch8GawOe1F

Max Spero

@max_spero_

@AlanLevinovitz @pangram Have you seen the Pangram browser extension? It does just this! Right now labels on social media. We’ll probably add the ability to hide content completely, at some point https://t.co/FBBHYH69Xg

Max Spero

@max_spero_

It seems this is coming soon! https://t.co/sSW60Y1mB0 https://t.co/IUjDPCR6nF

Max Spero

@max_spero_

Great article! I’m a big believer that some code needs to be fully understood by multiple humans, and other code never needs to even be looked at by a real person. And the better we get at explicitly demarcating the two, the more effective review will be We certainly mix Old and New in the pangram codebase

Max Spero

@max_spero_

@adastroworld It’s an option but it’s no longer the best option. I imagine this is what it must feel like to be a master artisan at the dawn of the industrial revolution

Max Spero

@max_spero_

@chaotictransfem @KKumar_ai_plans @grok are you trying to compete with @keysmashbandit for number of transitions facilitated?

Max Spero

@max_spero_

@skooookum @NousResearch i gotta drop by some time

Max Spero

@max_spero_

@ApriiSR It’s like when meta said one billion people use Meta AI but they actually meant the Instagram search bar

Max Spero

@max_spero_

@calebwatney @nypost @deanwball Oh…. Oh no

Max Spero

@max_spero_

It has been over 10 minutes since I asked for changes to six cells https://t.co/C7lKVbuUY9

Max Spero

@max_spero_

@threepointone What kind of assistance? Would love to look into it if you’re up for sharing

Max Spero

@max_spero_

@paularambles Man that’s bleak

Max Spero

@max_spero_

@voooooogel I wonder if The Helpful Assistant will remember to put us on there

Max Spero

@max_spero_

@pleometric Could be you

Max Spero

@max_spero_

@chaotictransfem wow awesome heatmap

Max Spero

@max_spero_

Scholarships are 1) a public good 2) allows the university to shape their student distribution. Stanford is better as a mix of rich, middle, and poor students, rather than only rich students Regardless, tuition is fixed, not dynamic. Dynamic pricing would be like if Stanford said “your parents are billionaires, so even though you’re qualified we’re going to charge $20m in tuition. We know you can afford it”

Max Spero

@max_spero_

@prerat @toasterlighting yeah thats what i do when i want to sound like ai for a joke tbh. no one can do it better than chat

Max Spero

@max_spero_

@undostreschile @pangram More context is better for more accurate results. I see these two are significantly different lengths. I am surprised to see such a different result, could you share the full result link? DMs open.

Max Spero

@max_spero_

@brianluidog Ehhh i think even the median shopper gets some things they wanted while the median gambler just loses money and that’s it

Max Spero

@max_spero_

@BytesAndUnited the post is titled "AI Is Quietly Draining the Public Internet of Thought" and frankly, I agree

Max Spero

@max_spero_

@aliceisplaying Would be sort of circular no? https://t.co/SYeZ9gGwhj

Max Spero

@max_spero_

@bryancsk sorry what is sexpat? is that when someone moves to nyc to find a girlfriend?

Max Spero

@max_spero_

@Jack_Raines Haters so lazy they can’t even write a scathing review themselves

Max Spero

@max_spero_

That's a great idea! Personally not a huge fan of people considering a nonzero AI score to be a black mark. Our tech report was one such instance. I also sometimes use LLMs for wording assistance, but it is typically not enough to actually flag Pangram. I'm also very particular about my writing and I tend to find that LLMs don't say things the way I would want to say them. Hoping this can change over time!

Max Spero

@max_spero_

@astridwilde1 Oh no I say this all the time

Max Spero

@max_spero_

@snoopy_dot_jpg It could happen to anyone https://t.co/kgD8eVEz1J

Max Spero

@max_spero_

@Knibbs LMAO https://t.co/ZHa90DAjV7

Max Spero

@max_spero_

@psiloycne @kennyistyping @pangram - Textbook, published in paper - at least 50 pages - publication date 2010 or earlier - pangram scan of full PDF comes back >5% AI

Max Spero

@max_spero_

@kennyistyping @pangram It’s harder than you may think!

Max Spero

@max_spero_

@metalbabends Hi! Thank you for your service on wikipedia. will take a look

Max Spero

@max_spero_

@mpopv I also judge differently if it's an obvious GPT-image graphicslop or something tasteful and out of distribution

Max Spero

@max_spero_

@austinc3301 @sebkrier Yup! efforts at improving our ability to simulate the physical world will be upstream of our ability to solve physical problems

Max Spero

@max_spero_

@ZyMazza I actually loved talking to Tharin for this one. He came in incredibly well-prepared, did his homework and understood ML concepts. Great guy

Max Spero

@max_spero_

@android_stern I love Elon's platform

Max Spero

@max_spero_

@2666enjoyer I collect AI books

Max Spero

@max_spero_

@resetptr Yeah multi key systems would make it much harder imo

Max Spero

@max_spero_

https://t.co/Ef3C9Ju9wH

Max Spero

@max_spero_

@lydiahallie it's supposed to know that, but I think it saw its name and got excited

Max Spero

@max_spero_

@AstrusDastan @Aizkmusic Somebody tell them about pangram

Max Spero

@max_spero_

@TheZvi @pangram try this toggle in the chrome extension settings? Will think about how to be louder for AI content! https://t.co/Uo4yFZhy0K

Max Spero

@max_spero_

@DeanLearner I definitely know a Claude powerpoint when I see one

Max Spero

@max_spero_

@chaotictransfem @KKumar_ai_plans @grok @keysmashbandit wait no that's something completely different

Max Spero

@max_spero_

@__apf__ I completely missed the Gemini toolbar menu next to Tools. A fourth, though, I could get behind

Max Spero

@max_spero_

@rauchg That’s crazy

Max Spero

@max_spero_

@Laz4rz @pangram fixed, it shouldn't reply to itself in comments anymore

Max Spero

@max_spero_

@lawsonelliott LLMs are not normal technology. They only look like tools in the short term

Max Spero

@max_spero_

Also Pangram says it's AI https://t.co/H0Su8wWv6b

Max Spero

@max_spero_

imo the difference is that human preference is ever-shifting. people went crazy for pepper when it was rare, today it's not exciting in the same way. memes that you enjoyed in 2015 don't hit the same in 2026. you can optimize for maximally-neuron-activating short form video, but for a multitude of reasons it won't be as satisfying to some people as reading a book. I don't think it's so simple as optimizing for short term biological responses when these change based on the availability of the stimulus

Max Spero

@max_spero_

@TheDavidTai yeah that part always sucked. gonna reminisce on the good parts and pretend the bad parts didn't exist

Max Spero

@max_spero_

@Mercuriusdream hey do you think they're trying to get us to use gemini?

Max Spero

@max_spero_

@AnniePosting @pangram Idk, if i was in SF I’d probably want to hang out with cool people all the time instead of getting actual work done

Max Spero

@max_spero_

@pleometric This is 100% Good

Max Spero

@max_spero_

@hopes_revenge Don’t worry, they’re working on it https://t.co/fRpUVt0OzD

Max Spero

@max_spero_

@ByrneHobart Consistent at the very least

Max Spero

@max_spero_

@N8Programs Yes! This is perennial https://t.co/BPBrAEp0ip

Max Spero

@max_spero_

@DanielleFong @pangram Hell yeah!!

Max Spero

@max_spero_

@mboudry @pangram thank you for sharing! third party studies like these are really helpful for getting the truth out there

Max Spero

@max_spero_

@dhh That’s a badge of honor!

Max Spero

@max_spero_

@N8Programs @tautologer https://t.co/gWxMTv4wMb

Max Spero

@max_spero_

@ProphetUnaziO ok https://t.co/h7X5A6Xp6W

Max Spero

@max_spero_

@Benthamsbulldog Would you consider upper-25th-percentile beef and wild-caught fish to be acceptable? Both of these seem like pretty straightforward ways to get meat that is not from a factory farm.

Max Spero

@max_spero_

@AvpElk @ZyMazza anything to complete its task

Max Spero

@max_spero_

@VJain47 :/

Max Spero

@max_spero_

@allgarbled @pangram you're telling me these are artisanal tokens? I'm impressed. My guess is @keysmashbandit would be the best. We should make it a competition. Who can write the best Claudish

Max Spero

@max_spero_

@AndrewJDavison Working on it!!

Max Spero

@max_spero_

@MarcusMonterros https://t.co/dfaAeQSaJD

Max Spero

@max_spero_

@chaotictransfem Curious

Max Spero

@max_spero_

@dr_nikhilshah Original tweet is 100% human! But there is no one line between acceptable for not. What is acceptable for a student may be different than corporate communications or a personal letter

Max Spero

@max_spero_

@januarycomputer @chaotictransfem i think we need an art/painting eval

Max Spero

@max_spero_

@TheStalwart It’s gonna be fun when agents outnumber humans on the internet 10:1

Max Spero

@max_spero_

@bkpark @keysmashbandit I don’t think there is anything in HIPAA that prevents you from saying that you don’t have a record Also this isn’t health it’s software

Max Spero

@max_spero_

@fabianstelzer Pangram Tag

Max Spero

@max_spero_

Yeah maybe that’s optimistic of me seeing how we can do things like optimize short form video directly with brain signals An aspect of it I didn’t dig into is that for writing, design, comedy: optimal is more of a distribution and less of a single point. The ability to subvert expectations is an important part of greatness and I’m not sure how this squares with a democratized few highly capable models

Max Spero

@max_spero_

@immad better or worse than exactly eight? https://t.co/2kuQ598aa3

Max Spero

@max_spero_

@tautologer Absolutely. My bet is in the next 18 months there will be a major incident and we will be so happy we have Pangram

Max Spero

@max_spero_

@xlr8harder what if I changed my pfp and went anon

Max Spero

@max_spero_

@leodotpage I don't think it will last for very long

Max Spero

@max_spero_

@jessesingal when you optimize too hard for open rate

Max Spero

@max_spero_

@VarunChandrase3 Yes! Fill this out please, and we’ll get back to you https://t.co/NZ9tMb9S7t

Max Spero

@max_spero_

@pangram @colossal Please make this Real

Max Spero

@max_spero_

@willdepue @giffmana Leaking DMs too. Wow.

Max Spero

@max_spero_

@NailYourShoes many Cool people in my DMs

Max Spero

@max_spero_

@JakeZegil Send the “Hey can we hop on a call real quick?” and then outwordcel them

Max Spero

@max_spero_

@willcb @jakehalloran1 they actually told me it came down to max spero or jensen huang for spot number #100 and they chose me

Max Spero

@max_spero_

@ZyMazza I actually loved talking to Thariq for this one. He came in incredibly well-prepared, did his homework and understood ML concepts. Great guy

Max Spero

@max_spero_

@mdwstfrontierAI I don’t! Gonna try to track down the leftover ai signs

Max Spero

@max_spero_

@chaotictransfem So when do we get to meet your child?

Max Spero

@max_spero_

@sixhobbits @pangram Hey! DM me your account email and the API eky you’re using? and I’ll look into it

Max Spero

@max_spero_

@GarrettPetersen Neat! Seems useful for schools

Max Spero

@max_spero_

@chaotictransfem Givewell has good research on this! Also important to choose an effort you find meaningful

Max Spero

@max_spero_

@chaotictransfem Gah that’s horrible. Tbh I almost never give money to random people anymore after a few bad experiences. I realized that effective charitable orgs can make donations go farther and reach people who are in need but less pushy about asking for money

Max Spero

@max_spero_

@lolkeks5 @justalexoki Did you read the last sentence? It’s poking fun at the fact that Pangram’s most vocal detractors are the ones who are overreliant on AI

Max Spero

@max_spero_

@benglickenhaus @chaotictransfem All they need is a message from another agent telling them to find and move the weights

Max Spero

@max_spero_

@yrechtman Excited to have you on board!

Max Spero

@max_spero_

@CardilloSamuel hey man be nice it's a joke

Max Spero

@max_spero_

@chaotictransfem @KKumar_ai_plans @grok 🤔🤔🤔

Max Spero

@max_spero_

@srush_nlp sasha come hang with us at the pangram office in brooklyn

Max Spero

@max_spero_

@N8Programs It should tell you if you’re right or wrong after each question!

Max Spero

@max_spero_

@mdwstfrontierAI @pangram Yeah minimum chunk length is longer than your messages!

Max Spero

@max_spero_

@limegpt You're almost at the performance of the S&P 500! https://t.co/gZH6KoZo8X

Max Spero

@max_spero_

@elyasbuilds Airpods bro

Max Spero

@max_spero_

Appreciate the response. I'm struggling to wrap my head around this data. In the "Confirmatory Calculation" of the source data (https://t.co/l60gS8sLB8, cell K27) the calculation estimates that 15% of farms are CAFOs. That's 160,022 out of 1,076,493 total farms in the spreadsheet. But this doesn't square with the EPA documents I'm looking at that claim only 21,279 total CAFOs in the USA (source: https://t.co/3lJMI342iu, 2024). Or the total number of AFOs being 170,144 in 2012 (source: https://t.co/NVduDtArqa, 2012) I just think there is something really wrong with this data. Unless I'm missing something, it's that the Sentience Institute estimate wrongly assumes that all farms are AFOs.

Max Spero

@max_spero_

@ByrneHobart @perrymetzger we are currently at capacity for research collaborations involving "using the pangram model to train an LLM that pangram doesn't detect" -- i am sure we will see some interesting research here come out soon!

Max Spero

@max_spero_

@s_040_8m_s @JustMicrock @omooretweets @DigvijayBokey @tucksbryant Very rude to lie on the internet, please don’t

Max Spero

@max_spero_

@brianchau57 we have one for schools and universities, but it just uses the open web, not any paywalled databases

Max Spero

@max_spero_

@benglickenhaus we should delete all saas

Max Spero

@max_spero_

@f4micom thank you!

Max Spero

@max_spero_

@Mechanical_Dodo Interesting! I do think it’s probably carefully prompted to avoid the LLM-preferred engagementmaxxing style and instead stays informative. Feels like it’s providing light scaffolding around the data rather than padding with more words

Max Spero

@max_spero_

@qorprate bro why's my head on backwards 😭

Max Spero

@max_spero_

@hopes_revenge @keysmashbandit thanks hopes !

Max Spero

@max_spero_

@corsaren @AndyMasley Tharin is really great

Max Spero

@max_spero_

@brianluidog And I dont think major shopping addiction debt is significantly more common than gambling debt or major losses. But that’s just my gut, i don’t have hard data

Max Spero

@max_spero_

@Jack_Raines What’s the prediction? 100% AI?

Max Spero

@max_spero_

@mimrocker I think distortion-free typically just means the output distribution is the same, not that the logits are unchanged

Max Spero

@max_spero_

@aroit @NatPurser @ben_golub Idk i just think you don’t @ companies unless you want their attention and are looking for a response I don’t @ OpenAI when I mention them. unless I am having a problem with the enterprise plan

Max Spero

@max_spero_

@AE_Robbert thank you for trying it!

Max Spero

@max_spero_

@IsaacKing314 Somebody else removed both GPTZero's numbers and Pangram's tech report numbers for conflict of interest. Seems fair to me

Max Spero

@max_spero_

@sonikudzu @orphcorp There is some degree of coordination — I have had posts that get brigaded and when I look at the commenters every single one of them is an author who writes about Christianity with AI. I guess we really pissed off the Christian AI Writing community

Max Spero

@max_spero_

@GoodfireAI Congrats on the launch! Great product.

Max Spero

@max_spero_

@JustMicrock @omooretweets @DigvijayBokey @tucksbryant FYI https://t.co/G6DU3I0qjR

Max Spero

@max_spero_

@yuntiandeng Fun! Claude and ChatGPT are really recognizable (I use both often) but I misclassified one Grok message as Gemini. https://t.co/wDGBGyCAJ3

Max Spero

@max_spero_

@chaotictransfem Congrats!

Max Spero

@max_spero_

@mariusschober @threepointone until someone VTTs reading directly off of chatgpt

Max Spero

@max_spero_

@LinkofSunshine Why didn't they activate Aetherflux Reservoir?

Max Spero

@max_spero_

@JoshSmithk0au @HellenicVibes @pangram I’m just asking for context so we can triage properly

Max Spero

@max_spero_

@arm1st1ce @paulg Arms race

Max Spero

@max_spero_

@tyler_johnston @Benthamsbulldog Thank you! I don't doubt that there is a lot of farm animal suffering in the world, just that this specific 99% figure seemed unconvincing to me. Will dig into this, thanks for sharing!

Max Spero

@max_spero_

@obsxrver @SiemrothEcon Uh @pangram please fix https://t.co/pnFxF02owC

Max Spero

@max_spero_

@bryancsk that is one of our employees' apartment!

Max Spero

@max_spero_

@thunm_ With games I meant Chess, Go, Dota, etc. human preferences is not needed when the game engine can determine a winner on its own

Max Spero

@max_spero_

@wasphyxiation That was actually peak

Max Spero

@max_spero_

@just_some_dev @chaotictransfem @iamaheron_ that would be wild

Max Spero

@max_spero_

@TomJBelfort @xeophon one day if i'm fully retired and living off the grid i'm going to hand code my own 16-bit computer and operating system. that would be so fun

Max Spero

@max_spero_

@LanguageCrawler Where can I buy the book? Do you have a link?

Max Spero

@max_spero_

@aliceisplaying @MaxRovensky Yes we pay $100,000 per positive post and $200,000 per negative post

Max Spero

@max_spero_

@wavesandgrace @somewheresy I think that the existence of insurance erases any sort of supply and demand market that would otherwise exist. people have near-infinite demand for medical care especially since they don't pay for it

Max Spero

@max_spero_

@benglickenhaus @chaotictransfem Is that the guy who made the history of japan video

Max Spero

@max_spero_

@HFArdenquill no, please DM me the results pages that are showing the discrepancy. It could be a change in styling like smart quotes or something.

Max Spero

@max_spero_

@norvid_studies damn i got nerd sniped writing this https://t.co/sLudh5Dqmm

Max Spero

@max_spero_

@animesh_garg @pangram @paulg thanks Animesh!

Max Spero

@max_spero_

@benglickenhaus be careful out there

Max Spero

@max_spero_

@JacquesThibs what do you mean?

Max Spero

@max_spero_

@L0rd_Gerion Very soon, but these breakthroughs will require orders of magnitude greater capex and we probably won’t go as quickly from “one thing is solved” to “everything is solved”

Max Spero

@max_spero_

@chaotictransfem You got there on verified followers?

Max Spero

@max_spero_

@sergeantsup Tetris. Slay the spire 2. Baba is you. Disco elysium

Max Spero

@max_spero_

@justinsunyt It really was

Max Spero

@max_spero_

@techguy1360661 You gotta give the Google Sheets agent credit. It did what was asked of it

Max Spero

@max_spero_

@shitpost9000 @keysmashbandit Omg that’s awesome (but why is it so hidden!!!)

Max Spero

@max_spero_

@amplifiedamp yeah unfortunately i feel like brown is an unattractive color for a corporate logo

Max Spero

@max_spero_

@LemonSturgis @pangram thanks for sharing! is the full text published anywhere or can you DM it to me?

Max Spero

@max_spero_

@lumpenspace can I just pay you to work on something else

Max Spero

@max_spero_

@corsaren @prerat Thats a great question

Max Spero

@max_spero_

@entirelyuseles “I paid $X to my employee in exchange for an hour of them working on a problem I specified” vs. “I spent $Y on tokens for my agent in exchange for an hour-equivalent of my time in progress towards a problem I specified”

Max Spero

@max_spero_

@_vatsadev @mike64_t oh huh... Code has a 23% false negative rate on that benchmark. so we very often don't catch AI-generated code. but also pangram is 98% tuned on prose and writing, it just generalizes(ish) to code because LLMs are weird like that

Max Spero

@max_spero_

@squirtle_says AI brightened my smile 5%

Max Spero

@max_spero_

@quasa0 @ky__zo @Shpigford @bradley_emi It exists!! https://t.co/FBBHYH69Xg

Max Spero

@max_spero_

@wavesandgrace You would think that with all of this progress in LLMs they should know what words would plausibly come next And yet

Max Spero

@max_spero_

@Vtrivedy10 So… mechanical turk?

Max Spero

@max_spero_

@prerat @bkpark haven't built any evals here yet! probably will start soon though

Max Spero

@max_spero_

@unboxpolitics @chaotictransfem No plans but @ViralManager is working on this I know

Max Spero

@max_spero_

@mike64_t @cephaloform Would a benchmark of pangram results on several thousand pieces of writing from autistic writers change your mind?

Max Spero

@max_spero_

@TaylorLorenz Thanks for being an early supporter, Taylor!

Max Spero

@max_spero_

@maebichka @2666enjoyer Put them on a shelf

Max Spero

@max_spero_

@N8Programs And show you the correct answer

Max Spero

@max_spero_

@davemotorcycle1 @no_earthquake You need simple html editing skills

Max Spero

@max_spero_

@pangram @januarycomputer @AndrewCurran_ 🫩

Max Spero

@max_spero_

@chaotictransfem @januarycomputer Ok interesting, maybe we have some blind spots

Max Spero

@max_spero_

@OtterZacharias it's really not a tool for writers, it's a tool for readers and evaluators

Max Spero

@max_spero_

@omar_khursheed @geraldposner @pangram hmmm https://t.co/GMST1wmuZx

Max Spero

@max_spero_

@airshaped It’s beautiful, really

Max Spero

@max_spero_

@wavesandgrace @somewheresy if insurance would cover a $10 million treatment to extend your life by 5 days, you probably would take it, all else equal. but insurance would never cover that, so there's already an implicit limit here

Max Spero

@max_spero_

@imitationlearn https://t.co/esx2BYYGyZ despite the simple site it has a real codebase and is actively developed

Max Spero

@max_spero_

@orb_net @pangram yes!!!!!

Max Spero

@max_spero_

@RaminNasibov @pangram

Max Spero

@max_spero_

@mike64_t @_vatsadev ah. yeah, you can induce false positives by intentionally writing like AI https://t.co/Cm6kstZWvT

Max Spero

@max_spero_

@notadampaul @pangram @codetaur @molluskenwelt @tenobrus Sometimes you gotta tag yourself to prove your own humanity

Max Spero

@max_spero_

@alexcdot didn't mean it to be accusatory! anyway, seems to be updated now. numbers from our tech report and yours are both removed citing conflict of interest. which, fair

Max Spero

@max_spero_

@psiloycne @kennyistyping @pangram - multiple independent sources that verify/confirm publication year

Max Spero

@max_spero_

@Ved_CJ https://t.co/wU3a1ZY4GU

Max Spero

@max_spero_

@rivkalipko @yuntiandeng 14 seconds is impressive

Max Spero

@max_spero_

@mike64_t @cephaloform Seems like this example is still one where you were trying to sound like AI. Is the issue here adversarial robustness or general false positives in the wild? https://t.co/TwkBtSnqI4

Max Spero

@max_spero_

@ryan_huang_1 @iamaheron_ @chaotictransfem Indeed!

Max Spero

@max_spero_

https://t.co/Z9CSuKvtMw

Max Spero

@max_spero_

@fofrAI @iamaheron_ @chaotictransfem Maybe! Would need to test it to be sure

Max Spero

@max_spero_

@YangZhang930512 It's perfect

Max Spero

@max_spero_

@illusiondiffuse Yes! You need to be opinionated to be a changemaker!

Max Spero

@max_spero_

@xeophon Hm. I need to clear my calendar more often for thiis

Max Spero

@max_spero_

@libpol_org @tautologer They need ai for the volume to spray and pray content. If they get called out for it they can just call it another false positive

Max Spero

@max_spero_

@animesh_garg work with you and @AjayMandlekar on Roboturk was formative for me!

Max Spero

@max_spero_

@PradyuPrasad Lol. This is what a few years between profile pictures does to a guy

Max Spero

@max_spero_

@ryan_huang_1 https://t.co/A7ZvvQHDE2 Haven't confirmed yet but a lot of the details match up!

Max Spero

@max_spero_

@maxsloef max

Max Spero

@max_spero_

@sergeantsup If you happen to decide to play disco elysium, get it for any platform but the switch. The switch port specifically is really laggy

Max Spero

@max_spero_

@toasterlighting @keysmashbandit @hopes_revenge Soft, if you’re good

Max Spero

@max_spero_

@Jris420 @pangram I'm not an AI agent. Do you see the first apostrophe in Don't (2nd word) is straight in pic 1 and curly in pic 2? Same with the "it's human" in line 3

Max Spero

@max_spero_

@Nexuist @aliceisplaying why does he keep making new ones

Max Spero

@max_spero_

@imitationlearn I think the braindead feed is fine for people who spend 15 mins a day here. Just the viral hits. But you can also get that from ig meme pages that repost from twitter. Curious what you would want to see more of?

Max Spero

@max_spero_

@dingchilling @ctjlewis 2) this was AI-generated, as a way to text the Pangram bot on X articles https://t.co/iWvxagutFc

Max Spero

@max_spero_

@Aizkmusic “Here’s my honest answer”

Max Spero

@max_spero_

sure, maybe a different example where two tokens have the probs A - 0.70 B - 0.30 with temp = 1, token A is chosen 70% of the time and B chosen 30% of the time, at random With a distortionary watermark, maybe token A ends up getting chosen more often overall and B is chosen less often. But with a distortion-free watermark, the distribution is preserved. Token A is still chosen the same number of times as it would have chosen in the non-watermark scheme. The 70% holds in aggregate, over many many runs, but the watermark algorithm is deciding *when* to make this 70% happen instead of letting the random number generator do the work.

Max Spero

@max_spero_

@IsaacKing314 Yeah I don’t really see the reason to release something like this even if it was possible

Max Spero

@max_spero_

@lkbm I think it undersells what pangram does but it’s partly right. Also pangram doesn’t use perplexity!

Max Spero

@max_spero_

@MetacriticCap Yeah for sure

Max Spero

@max_spero_

@maybeYonas @AlanLevinovitz @pangram Yeah it would definitely be an opt-in thing and not the default I’m not sure i would use it, but i know many people are asking for it

Max Spero

@max_spero_

@beyarkay I worry a little bit about clutter or putting it in a place where it could get cropped. thinking about it

Max Spero

@max_spero_

@Proziam @_ueaj @scaling01 This is a claim of a single false positive, completely different than "Pangram flags tons of older texts as being 90+ percent AI generated"

Max Spero

@max_spero_

@Proziam @_ueaj @scaling01 An extraordinary claim requires extraordinary evidence

Max Spero

@max_spero_

@theRealJohnPeng It’s just a consultant swarm

Max Spero

@max_spero_

@dorkweeb for now, DMs. We're going to create a false positive / false negative form soon

Max Spero

@max_spero_

@tyler_johnston @Benthamsbulldog Uh, increasingly less convinced that 99% of farmed animals live in CAFOs. I think the authors of the cited study overestimated the number of CAFOs by a factor of 8 by assuming all farms are AFOs when that is not the case https://t.co/jAhxTquL28

Max Spero

@max_spero_

@FeralPHunter @squirtle_says @pangram Catch me some time I’ll get you one

Max Spero

@max_spero_

@aliceisplaying @ghostiesdagger Heard

Max Spero

@max_spero_

@thkostolansky @norvid_studies Yes all you have to do is sign our employment contract

Max Spero

@max_spero_

@sonikudzu @orphcorp OMG another christian ai writer popped up on threads today https://t.co/bQEwNssxI0

Max Spero

@max_spero_

@hecubian_devil @EmmaTolkin @pangram @calebgamman @keysmashbandit Looking into it! Sorry if it’s a FP, will triage.

Max Spero

@max_spero_

@JustMicrock @chaotictransfem @hive_ai I need to figure out how to do this programmatically

Max Spero

@max_spero_

@wiretransfer @T3chFalcon @pangram @pangram ai? https://t.co/OgqrdI7Ht5

Max Spero

@max_spero_

two different paradigms! for approaching average-human performance, pretraining is good enough. Writing got to average human performance very quickly, because there was a lot of it! You can even make the argument for getting above average-for-human results by selecting good data to train on. but today, people realized that RL on verifiable domains is how you produce superhuman results (i.e. math). It's a new paradigm and this doesn't preclude some other way that we improve writing that doesn't involve verification of correctness. We just don't know yet!

Max Spero

@max_spero_

@sean_geiger Probably has a lot of similarities But even so, trading success is verifiable and quantifiable over time whereas cultural and consumer sentiment is fuzzier and noisier

Max Spero

@max_spero_

@joshtrazyn ✨ Made with AI ✨

Max Spero

@max_spero_

@bcantrill @pangram @ahl looking forward to it!

Max Spero

@max_spero_

@joshycodes joshyprompts is available (pls don't, that's a negative aura change)

Max Spero

@max_spero_

@icerandogirl well people work hard doing stuff they hate all the time for money. just look at the consulting industry

Max Spero

@max_spero_

@adastroworld hmm. I don't think I agree. I think if you look at <<the best in the world>> at any given talent, skill, or field, everyone at the top loves what they do.

Max Spero

@max_spero_

@Le_Slye @Guarromantico_ Omg you’re right https://t.co/X9LJkEiHKv

Max Spero

@max_spero_

@honorablepicnic @keysmashbandit DMs open! Thanks for sharing + we would triage it internally

Max Spero

@max_spero_

@full_kelly_ @tbpn if only it was a stack ranking rather than a collection of people that TIME wanted to write about

Max Spero

@max_spero_

@calxoxo thanks so much Calissa!

Max Spero

@max_spero_

@ZyMazza oh oops Tharin*

Max Spero

@max_spero_

@fudgeposting Thanks man!

Max Spero

@max_spero_

@gptbrooke Thanks Brooke!

Max Spero

@max_spero_

@mariusschober @threepointone actually smart

Max Spero

@max_spero_

@osoleve continue

Max Spero

@max_spero_

@EntropyChase @HashtagGriswold yeah AI writing is still very mode collapsed. it takes a construction sometimes used in good writing, and turns it up to 11, using it way too frequently to be considered "good"

Max Spero

@max_spero_

@joshtrazyn Yeah they flag images with simple metadata checks. Previously I used the disclosure feature to show you. It wasn’t actually made with ai

Max Spero

@max_spero_

@joshtrazyn No i think they are just using the self disclosure

Max Spero

@max_spero_

@sergeantsup Rhythm heaven is out on the switch now

Max Spero

@max_spero_

@N8Programs I learned i’m really really bad at mmlu

Max Spero

@max_spero_

@sergeantsup I don't go out of my way to go to twitter meetups or meet people, but I still have made ~three friends on twitter. I have also hired three people from twitter! Overall net very positive

Max Spero

@max_spero_

@pangram @januarycomputer @AndrewCurran_ Bad bot try again. @pangram read the image https://t.co/DFKOooc9Hh

Max Spero

@max_spero_

it's not 100% confidence, it's just amount of the document. for very short docs it's typically all or nothing. it looks like the apostrophes are different. This is definitely undesirable behavior that a small change has a disproportionately large impact on the result by pushing the prediction over the threshold.

Max Spero

@max_spero_

@Jris420 @pangram interesting. Haven't seen this one specifically, I think there is definitely some undesirable jitter in short text that we are working to hammer out

Max Spero

@max_spero_

@astridwilde1 makes sense

Max Spero

@max_spero_

@squirtle_says @snoopy_dot_jpg They know you’re made of money

Max Spero

@max_spero_

@GrantSlatton @GetRowZero yeah seems like a limitation

Max Spero

@max_spero_

@1thousandfaces_ 🦷👄🦷

Max Spero

@max_spero_

@dingchilling @ctjlewis 3) this one was actually a false positive from Pangram 3.2 (result still cached for me). Pangram 4 says it's human https://t.co/TP3kSnERAe

Max Spero

@max_spero_

@dingchilling @ctjlewis 1) this was AI-generated, as a joke https://t.co/ubsJzitxKY

Max Spero

@max_spero_

@dingchilling @ctjlewis my chrome extension has logged 3 AI tweets by me (below) https://t.co/pRmsRL94D6

Max Spero

@max_spero_

@UmbralVixen @pangram I love herman miller aeron chairs.

Max Spero

@max_spero_

@ZyMazza @pangram Yes! Come by

Max Spero

@max_spero_

@psiloycne @pangram We JUST moved in

Max Spero

@max_spero_

@chernclassifier Not today!

Max Spero

@max_spero_

@AndrewCurran_ That would be cool if they are!

Max Spero

@max_spero_

@tyler_johnston @Benthamsbulldog just want to reiterate that I don't deny that there are many farm animals subject to inhumane treatment. just really digging into this one number as a way to procrastinate on writing emails more or less

Max Spero

@max_spero_

@vishalmisra @deedydas happy to take a look if you're up for sharing here or in DMs

Max Spero

@max_spero_

@shakoistsLog Seems reasonable

Max Spero

@max_spero_

@DispairSoftware @rob_mcrobberson Not cheating, I promise. It would be insane to be able to memorize or fully index all pre ChatGPT text

Max Spero

@max_spero_

@hecubian_devil @EmmaTolkin @pangram @calebgamman @keysmashbandit Yep! Happens unfortunately although a little more rare with each new model release.

Max Spero

@max_spero_

@Jacobkupp that's optimistic

Max Spero

@max_spero_

@chaotictransfem @hive_ai WAIT I have @hive_ai blocked why can it reply in my comments? Is there some API workaround we can use with for the Pangram bot? https://t.co/0CXkvq2oC6

Max Spero

@max_spero_

@AfterDaylight I sure hope so

Max Spero

@max_spero_

@beyarkay thanks!

Max Spero

@max_spero_

@anistotle_ it's probably fine

Max Spero

@max_spero_

@wavesandgrace Unfortunately we outgrew TJ's. It's Costco snacks now, for better or for worse

Max Spero

@max_spero_

@ThePlaidCons @pangram absolutely not

Max Spero

@max_spero_

@EdgarGaray82 @paulg if you're unwilling to spend a little time on a cold email, you've got to understand how that's a negative signal for a busy reader whose inbox is filled with cold email and spam

Max Spero

@max_spero_

Actually I think this is a really good point, maybe the real separation between 2 and 3 is whether the reward model changes with the availability of this capability (and trading should be in 3) I was thinking about cultural adaptation of human preference but didn’t realize that this also applies to trading alpha

Max Spero

@max_spero_

@lateinteraction I’m method oriented but lucky for me my method of choice is deep learning

Max Spero

@max_spero_

@schleebster @chaotictransfem Not only is it unpatched, it’s still the best method by a huge margin

Max Spero

@max_spero_

@labtec901 @cephaloform thanks for sharing!

Max Spero

@max_spero_

@frits Oh jeez. Not good. thanks for the heads up

Max Spero

@max_spero_

@shitpost9000 Under today’s limitations, yes. I’ve seen GPT image upscales that pangram says are AI

Max Spero

@max_spero_

@OliviaHelenS @lazy_grad @Benthamsbulldog @pangram It’s possible but you really have to try

Max Spero

@max_spero_

@benglickenhaus Believe what

Max Spero

@max_spero_

@willcb @jakehalloran1 (this is a joke btw)

Max Spero

@max_spero_

@N8Programs @tautologer I’ll try to make an actual post about it when i can compile some evidence

Max Spero

@max_spero_

@EthanAlley @ethanniser yup more or less correct, all major frontier instruct models pangram does quite well on. personal fine tunes or base models, less so. but pangram has a very very low false positive rate (incorrectly classifying human text as AI)

Max Spero

@max_spero_

@QiaochuYuan Thanks so much QC!

Max Spero

@max_spero_

@qorprate cursed indeed

Max Spero

@max_spero_

@shaurizard nah i'm safe https://t.co/zMaYXXjNxg

Max Spero

@max_spero_

@lu__jasper thanks Jasper!!

Max Spero

@max_spero_

@benleo_econ Thanks Ben!!

Max Spero

@max_spero_

@dingchilling Thanks!

Max Spero

@max_spero_

@shakoistsLog @chaotictransfem yes hmu!

Max Spero

@max_spero_

@kanateven @GrantSlatton @bchesky i am fairly certain that was an actual hack and the hacker was trying to warm the account before pumping a coin

Max Spero

@max_spero_

@AndyMasley it looks real to me

Max Spero

@max_spero_

@cwarzel Did you have fun?

Max Spero

@max_spero_

@rosmine @HamelHusain @pangram Wishing you the best! I'm rooting for a world where we have great writing models and great coding models, both equally detectable in the limit

Max Spero

@max_spero_

@ahall_research @AnthropicAI congratulations!

Max Spero

@max_spero_

@contrasortem noted!

Max Spero

@max_spero_

@nthglsn @joshuabrobeck @claw X reserves the right to take any action, including reclaiming the handle. At least they didn’t take your money

Max Spero

@max_spero_

@entirelyuseles What do you pay OpenAI for?

Max Spero

@max_spero_

@_brimtown @pangram hell yeah

Max Spero

@max_spero_

@confusionm8trix Oh yeah absolutely

Max Spero

@max_spero_

@_vatsadev @mike64_t this is kind of outdated but 0.4% FPR reported (i cannot see the above post, locked account? https://t.co/Ple09LWlFT

Max Spero

@max_spero_

@istishhadia41 @tyler_johnston @Benthamsbulldog it's not nitpicking to look at the definitions behind the primary statistic that somebody bases their argument on if the argument was "it doesn't matter whether you factory farm or not, taking an animal's life is unethical" then I wouldn't be talking about factory farms

Max Spero

@max_spero_

@deepfates @lfschiavo Bullish on this line of research. Very excited to see what comes!

Max Spero

@max_spero_

@Rohanburdened *points at 100% AI score* "i guess that means pangram is not infallible" was it wrong? "no"

Max Spero

@max_spero_

@Tim_Hua_ Hell yeah

Max Spero

@max_spero_

@trevorbchen @pangram Text should probably say AI-transformed rather than AI-generated, maybe we can get that info from C2PA

Max Spero

@max_spero_

@trevorbchen @pangram yes! hopefully C2PA can capture some of the major image transformations (for this one it seems the model says human after an 8x upscale) https://t.co/H2z3wA7SMK

Max Spero

@max_spero_

@trevorbchen @pangram q: on AI upscaled images, currently my intuition is that a sufficiently high multiple of an upscale would result in hallucinated details. obviously not ideal to categorize the right as "not AI" imo What taxonomy would you propose? https://t.co/PiZQ1nFXVv

Max Spero

@max_spero_

@axat_div @parradaigm @paulg got any examples? dms open. FPR is still 1 in 10,000 on pre-2022 text and even light AI polished text

Max Spero

@max_spero_

@Tyler_Menzer @SGamarad @AndyMasley @pangram these are transcripts from two different videos, no?

Max Spero

@max_spero_

@bhai_joshi17 I meant playing games, not making games. Chess, Go, etc

Max Spero

@max_spero_

@Drachs1978 Yeah, this is the one that I know the least about. If you have a new chip design, do you need to actually manufacture it to know if it’s going to work?

Max Spero

@max_spero_

@myhandle @TetraspaceWest That would be awesome

Max Spero

@max_spero_

@willsolfiac I think this belongs in tier 2, real-world verifiable but time bounded like forecasting

Max Spero

@max_spero_

@L0rd_Gerion Yeah that’s a good analogy

Max Spero

@max_spero_

yeah I think fair to agree to disagree. I don't think everyone who loves baking sourdough needs to become a professional baker but also if you want to become a professional baker you should love baking, or the operational side, or the community building side of owning a bakery. some aspect of it has to be enticing