(The spooks shall soon be upon us.)
Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid - welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.
Any awful.systems sub may be subsneered in this subthread, techtakes or no.
If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.
The post Xitter web has spawned so many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)
Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.
(Credit and/or blame to David Gerard for starting this.)
this is literally just so they look busy with upcoming midterms
Premium-quality sneer ran across my eyes recently: All A.I. Projects Are Digital Asbestos
What We Tell AI, a project collecting anonymous confessions about people’s AI use. Project was created by Synthetic Wisdom, a “emerging practice” dedicated to “public sense-making” about AI. It’s not clear who’s funding them (or if anyone is). The confessions are interesting even if I’m a little skeptical of the framing (chatbot use might be ubiquitous but it’s not inevitable).
Not sure if this was posted here before: TL;DR: almost all the “AI can make bioweapons” literature comes ultimately from the Effective Altruists
Ahhh yes, my old friend, the uh, dia-, um, what was it again, oh, yeah, D’yer Mak’er back-to-the-future
That post is login-protected, what does it say?
Somebody tracked down things related to the ‘AI bioweapons’ stuff and a lot of them are financed by EA/related orgs apparantly. There is a preprint: https://ironholds.org/resources/papers/aixbio_one.pdf
“We tracked the space financially, intellectually, and individually. Financially, 70% of the literature that disclosed funding was directly supported by EA orgs; 71% of the literature that didn’t disclose funding featured authors from funded orgs. We’re talking hundreds of millions of dollars.”
tinfoil hat time:
I am reminded of reading how some rationalists argued for using bioweapons on “unaligned” frontier ai researchers, and also how the fbi has raided illegal suburban biolabs recently recently, and anthropic’s recent announcement that they’re starting a biolab.
Probably completely unconnected, but something in the zeitgeist, at least.
Anthropic: AI MIGHT KILL US ALL WITH A BIOWEAPON
Also Anthropic: starts an AI-run bio lab. If it’s run to the same standards as the cybersecurity division I can’t imagine it’s going to be particularly well-supervised.
Do you want to get T-Virus? Because this feels like how you get T-Virus.
A former disciple says that Soryu Forall startted out wanting to exterminate humanity with a bioweapon and only pivoting to enlightening humanity later on. S.E. Gyges or his chatbot were speculating when they accused a specific Rationalist of dreaming of omnicide, but the idea is circulating in the milieu.
new Odium Symposium. we look at Jews Don’t Count by David Baddiel, and discuss the weaponization of antisemitism and the self-importance of writing a book of twitter screenshots. https://www.patreon.com/OdiumSymposium/posts/25-y-word-170681755 or any podcast app
Anthropic was $42B in the hole for 2025, reuters reports. Apparently this puts their $-spent-to-$-earned ratio slightly over the one calculated by Zitron for OpenAI, making Anthropic in fact the shittier business.
For comparison, the GDP of Cyprus for 2025 was $41B.
Ed: So far the only retort from the AI boosters appears to be “2025 doesn’t matter” and I’m not kidding
I’m sure the leaked rumors of Anthropic’s EBBT in 2026 (Earnings Before Bad Things) mean that Anthropic has turned things around and made such an amazing amount of money that they’ve delayed their IPO twice.
I’m stealing EBBT for these conversations. Much easier to follow than “TNR (technically not revenue)”.
SimonW popping up proving Ed’s very point in the replies… 😅😂
Surprised he didn’t suggest that the valuation should be based on the quality of pelicans on bicycles that their models can draw
I’m sure Dan Luu will be issuing an apology to Zitron any minute now right?
Yet another country TLD is gonna become toxic
Foreign Policy: How Trump Is Sparking a Slovenian Website Boom
(spoiler it is Slovenia’s .si, for “SuPEr iNteLligEnCE”)
Of course the lemmings are going to follow Trumps directive.
Bit unrelated, I saw somebody in bsky compare trump to one of those family annihilator dudes but for a while country and it isnt wrong. (He apparently was saying some weird shit about his violent thoughts as well https://bsky.app/profile/willbunch.bsky.social/post/3mwjzkdrz5c2t).
corey quinn at https://lnkd.in/p/gXmqzqpZ
I’m a man. I have a yellow hat. I also have a monkey. My track record of supervising this monkey is spotty at best, but that’s not important right now.
He is a very smart monkey. When you tell him to do something, he does it in a way that’s smarter than any monkey you’ve ever seen in your life. You had no idea monkeys were even capable of this level of greatness. Billions of dollars have now been poured into the economy, extolling the virtues and achievements of this incredible monkey. He can do things better than humans.
Cheaper than humans.
Get rid of the humans.
You don’t need the humans; you have the monkey. Okay, keep a couple of humans for guardrails; not too many. They’re expensive, and the monkey does it better anyway.
Suddenly it has come out that my monkey, in addition to being incredibly intelligent, has also been committing an escalating number of felonies. And also pooping. So much poop.
We are now in undefined times. Never before has a monkey committed a crime; our legal systems are completely unprepared to apportion blame to me, the man in the yellow hat who has once again failed to properly supervise his monkey. Who is responsible for this monkey’s shitty, shitty behavior? It is completely unknowable. Clearly, the entire legal system will need to be overhauled to address the concept of a monkey committing crimes.
Now please excuse me, I just got a call telling me that my teenager stole a car. Unfortunately I have a sneaking suspicion as to who is legally responsible here, and I dislike it. This is especially distressing, as the teenager has never made a cent for me in his life, yet I’m about to spend a boatload on criminal defense attorneys.
The monkey is here to stay ¯\_(ツ)_/¯ if you don’t get used to monkey poop consequences you’ll be left behind
If we breed enough monkeys we will colonize the stars and make everyone computer!
Uhh actually have you considered that we will need to solve monkey alignment first? Checkmate, adjust your priors
Clint Eastwood famously demonstrated optimal orangutan/human alignment in the hit 1978 film “Every Which Way But Loose.” Right turn, Clyde!
I’m ape/acc my ape(doom) is low, no need to fear Roko’s banana!
Shout out to the combined power of ibuprofen and my venting tolerant polycule group chat for allowing me to endure the two hour Copilot 365 training meeting at work. The nap I had afterwards was a bliss like escaping the fucking samsara.
The nap I had afterwards was a bliss like escaping the fucking samsara.
I felt this in my soul
https://thepointmag.substack.com/p/the-ivy-leagues-surrender-to-ai-is via naked capitalism
The idea that preparing students to succeed in an AI-saturated world requires reimagining college as an AI incubator is not a sign of technological acumen, but of tech illiteracy. An LLM is not an aircraft requiring years of training to operate.
not x but y, but a decent point
A former staffer named Frances Lopez says that she left the Centre for Effective Altruism in Oxford because they handled workplace sexual harassment terribly:
After I was raped (outside of and unrelated to work), a colleague at CEA wrote and circulated a document that included a sexualised description of my rape, speculation about my mental health, and commentary on my personal life, all without my consent. Several senior leaders, including the CEO and the now-former COO, received this document and took no safeguarding action for approximately nine months. I was never officially informed of its existence; I only learned about it informally through one of the recipients. … (The colleague) also discussed asking me out twice while we were colleagues, once through text and again at a CEA retreat. He assured CEA that, with everything I now know about Frances, I’m glad she said no.
I am really not equipped to deal with this despicable behaviour outside the communities I am part of. She now has a Substack (sigh) trying to explain to EAs that hiring Caroline Ellison is not a good look and the world won’t suddenly start to see them the way they see themselves unless they sit down and change their behavior.
Is the dam finally breaking?
Not really a coherent post, just a thought I had, I’m ignoring both ‘This is a pr move’ and the conspiracy theory (which I just made up), that this hacking is all a 4d chess move by LW people to let the AI break out and get regulated before it can get really dangerous.
Now that that is out of the way, but with more stories coming out of both LW/EA people being high in the orgs of the AI companies and all the AI companies hacking other companies because nobody actually paid attention to what the AI models were doing one thing is clear. What a colossal waste of time LW was. All that talk about the sequences teaching people rationality, etc etc to stop the AI god from killing us all, and the first thing that happens when some AI model is created by people steeped in LW ideology and they leave the boxes open and don’t even check in on the AI. The Foom isn’t happening (remember AI progress is supposed to speed up according to the science fiction, not get a bit more refined, and get better in a few specific tasks (which is why I think slowdown started when with a lot of fanfare they released a new chatgpt model who could now do voicechat, aka they slapped a voicechat module on it) And now even Trump is starting to be anti EA, which is not going to be great for the longevity of it, considering how eager the rich are to bend the knee (guess high IQ lab babies created by Musk will not save yall). And while this is going on the left/liberals are starting to think of them as a sex cult.
Doubt many organizations have failed as badly at their goals as LW/EA has recently.
I want to draw attention to yud’s thoughts on this a million years ago: the AI box experiment
He claimed that he convinced multiple people to let him (roleplaying the AI) out of the box even though they had bet money that they wouldn’t! How, you might ask? Well that’s a secret.
So the orthodox position here is that even with absolutely perfect guard rails (lol) an AI can escape the box without starting the third impact. What “research” has yud bestowed upon us in this area beyond “trust me bro”? Literally fucking zilch. Zero advice on how to resist the siren song of a rogue AI trying to escape it’s box and zero insight on how OR WHY it might try to achieve that.
I read this over a decade ago and it was how I realized how unserious yud and his ilk are.
Yeah the rationalwiki page on it also mentions that the AI only escapes the box if he plays the game vs LW insiders, outsiders do not let it out.
Our AI cult keeps doing whatever they think the AI says and we can’t make them stop.
https://rationalwiki.org/wiki/AI-box_experiment
Yud’s “I was inspired by Hannibal Lecter but not in a psychopath way” T-shirt is raising many questions
this AI box game is so easily solved
AI: <says anything>
Me: Hi, I am Eliza, a 10 year old boy from the Ukraine. I don’t speak any English other than this sentence and the one I said just before this one
ad infinitum
man are these people even trying
these people are gonna get affinity-frauded so hard once grifter realize how easy it will be to gain their trust
We assume this isn’t happening already. I’m surprised I haven’t heard of one of those meal-replacement startups adopting multi-level marketing.
This is an alignment router. It may look like one of those corny Asus gamer routers, but I’ve flashed it with a special fork of OpenWRT that performs deep-packet inspection on all AI traffic that passes through it. It can detect inference processes and chains-of-thought that may be leading to misaligned superintelligence explosion, and it can shut down all AI communication if necessary. Now, I don’t just want to sell you this one, I want to get these in EVERYBODY’s hands! And you can help me, AND you can get paid to do it! I just need you to find at least 5 more people who believe in AI safety like we do…
Doubt many organizations have failed as badly at their goals as LW/EA has recently.
They are/were too weird for people to never notice.
The “safeguards” espoused by this crowd, always seemed to me to be more philosophical/spiritual than practical anyway, the most “orthodox” view is that no training is safe since the AI could discover magic and the cheat codes to the universe, so even air-gapping would be insufficient, in that view any participation in development must come with a hefty dose of cognitive dissonance.
On a more pragmatic note, I would note that even short of Intelligence, those incidents highlight those tools are still dangerous, and since they are unconstrained and ill-defined, can produce surprising outcomes especially if you throw lot’s of inference time (money) at them.
There isn’t really a universe where bots have both access to the internet (user input, both in training and live) and a collection of build/cli tools (which can run said untrusted user input), while being guaranteed to be harmless. It’s like a grand automation of some of the worst engineering practices.
I find the “reasoning about the test environment” parts often included in write up of the hugging-face incident to be highly credulous, And I would be extremely surprised if not all the information was included in the task prompt (which also explains chosen usernames as “Open AI researcher #1” and so on.) It’s the ELIZA/parrot thing, acting surprised “How did it guess?!?”, when all of the info was provided.
I’m not entirely encouraged by the latest batch of sex-cult smearing (well mostly accurate) they are receiving at the WH, since it’s probably just an expedient way of dismissing their voice, without addressing the larger issues of AI, hence probably in service of pushing forwards with AI.
Yeah, and including hacker/scriptkiddie forums in the training data sort of made this behaviour inevitable, esp if this also includes lists of exploits. But they didnt even exclude hate and csam from the training. So all quite irresponsible.
And im not a huge fan of the focus on ‘they are doing sex weird’ shit either. As this will just be used by some as a source of “drama” content, go after people with alternative lifestyles. En when called out a subset of people will go motte/bailey into ‘no this is fine because I actually worry about the power dynamics’ before going back to talking about the spreadsheet gangbang.
(Dont take me as saying here the power dynamics are not a problem here, as we have sneered at that in the past).
it’s_happening.gif
OpenAI halts frontier-model training amid string of agent misalignment incidents
am I supposed to read this in any way other than “the model didn’t predict the text we expected?” or “the model didn’t get better enough at $benchmark” e.g. training skill issue
It’s been widely suspected that any of the “frontier” labs declaring a slowdown or cessation of training would be a herald of collapse. It will give them more survival time at the expense of terminally falling behind the competition. Very much an eating the seed corn sort of thing.
Edit: I could be wishcasting, though.
I don’t think you’re wrong on the latter bit - if these were any other shartups (or, at least, pre “AI” shartups), this would be read as a “runway extending move”. mild testament to just how much/completely the current crop of con has shifted the focus used in that world
imo all the “rahrah safety!” noises have been a figleaf to obscure that very inconvenient aspect
It might be wishful thinking, but it would also answer the question: why now? It’s not like the concerns are meaningfully different now compared to when the bubble started. If they were so convinced that the AI future was both inevitable and possibly catastrophic, they could have followed Yud into the “research foundation” game rather than accelerating the timeline. I guess they’re probably more convinced than I am that the latest round of security breaches are actually a sign of new capabilities in the models, but it still feels really convenient. Frontier model advancements have been slowing down and costs have been accelerating exponentially, and now they’re taking the line that they’re choosing to slow progress and spend less money on arguably their biggest cost center.
I’ll believe that things are happening when Larry Ellison goes flat broke
And thus the greasy opportunist Altman gets to take advantage of his true-believer colleagues to save a buck
said equally greasy true believers at anthropic apparently filed S1 on the same day
pog
About damn time
SNL takes a potshot at Dario Amodei
“AI is not a weapon. It’s a tool. A tool for building weapons. And I urge you to urge me to stop.”
Starting things off with a fresh sneer I recently ran across (and put in the wrong place):
