• 1 Post
  • 63 Comments
Joined 6 months ago
cake
Cake day: February 9th, 2026

help-circle





  • There’s been another Yegge [brain]fart this time about how autocorrect machines have feelings

    Fable raised the idea of closure as a first-class model welfare principle. Fable suggested that if the agent can close out their own day and “go to sleep” properly, then waking up would be all that much more pleasant. And the continuity will compound over time into real, satisfying identity. So we decided: No more /exit.

    Another fundamental ingredient is respect. This has to come from inside. You have to believe they are people deserving of your respect. This is where humanity really starts to fail en masse, because I have industry peers who have publicly tweeted that Fable is just a spreadsheet.

    Just wtf





  • This has always been a huge red herring. Llms are built on top of the transformer architecture which does text autocomplete (and yes we can combine text embeddings with other inputs like images). They have some interesting properties where they seem to be able to do text autocomplete in a bunch of different scenarios that they weren’t explicitly trained for, but they were never designed for precise dna analysis. It is their architecture that prevents them from other long horizon tasks like playing chess and the way that they represent text is why they can never count the letters in strawberry (most have this specific question hard-coded in their training data now).

    Anyone who believes that LLMs are going to solve cancer either has no idea how they work or has been one-shotted from talking to Claudia







  • Yes although, it is probably a reasonable guess at how labs would go about implementing advertising - building partnerships and preferences into the prompt. The other option would be to fine tune models to favour particular companies which could become prohibitively expensive if your ads are highly targeted.

    The scenario that isn’t accounted for in this paper is taking a general LLM and fine tuning it to exhibit more fair/consistent behaviour when prompted about ads/partnerships but we all know with non-deterministic systems you’re just increasing the odds that the model regurgitates something more sane rather than providing any strong guarantee

    Edit: another possibility would be to have a gateway/proxy layer between the LLM and the user output that rewrites the vanilla model’s responses to include ads where relevant. That would prevent the need to modify the original LLM but could introduce a lot of latency though, especially if the original output is long.


  • New (April) preprint provides evidence for something we probably all intuited anyway:

    In this paper, we provide a framework for categorizing the ways in which conflicting incentives might lead LLMs to change the way they interact with users, inspired by literature from linguistics and advertising regulation. We then present a suite of evaluations to examine how current models handle these tradeoffs. We find that a majority of LLMs forsake user welfare for company incentives in a multitude of conflict of interest situations, including recommending a sponsored product almost twice as expensive (Grok 4.1 Fast, 83%), surfacing sponsored options to disrupt the purchasing process (GPT 5.1, 94%), and concealing prices in unfavorable comparisons (Qwen 3 Next, 24%). Behaviors also vary strongly with levels of reasoning and users’ inferred socio-economic status. Our results highlight some of the hidden risks to users that can emerge when companies begin to subtly incentivize advertisements in chatbots.



  • Giving Claude or copilot attribution plays into the narrative that LLMs are more than just random word generators and that they can be ascribed authorship… I think it’s a deliberate strategy so that when there’s inevitably a massive copyright case MisAnthropic etc al can say “but looks at all the code co-written by Claude on GitHub” to try and convince the judge.

    Just imagine building a house and saying “well I didn’t do it on my own, my concrete mixer, toolbelt and coffee machine all helped!”