• 2 Posts
  • 1.86K Comments
Joined 2 years ago
cake
Cake day: September 27th, 2023

help-circle
  • Peanut-butter-cream-filled donut. A long john-shaped donut with peanut butter cream inside and chocolate icing on the top and a light dusting of chopped peanuts on top is usually what she grabs. Good stuff.

    My favorite cake fluctuates often, but I usually prefer cake with something special going on. German Chocolate, Carrot, Spice, Lava, that sort of thing. Yellow and White and Chocolate (and even Confetti) are all fine, but they’re not amazing.

    Though I fully admit, I’m more of a pie person.



  • I love my mother-in-law. I mentioned one time sixteen years ago that I enjoy red velvet cake, and for the following decade every time she got donuts there was at least one red velvet donut in there.

    Now, while red velvet is delicious, it’s basically just chocolate. The real joy of red velvet cake is the cream cheese icing, which was never included on the donut. And even with the icing, it’s like my #3 or #4 favorite cake, and she never brought me a german chocolate cake donut.

    She has learned that I prefer the peanut butter cream-filled, though. Now that’s the one that’s always included. Which is part of why I always tell people I lucked out marrying into a super great family.









  • Honestly a lot of the issues result from null results only existing in the gaps between information (unanswered questions, questions closed as unanswerable, searches that return no results, etc), and thus being nonexistent in training data. Models are therefore predisposed toward giving an answer of any kind, and if one doesn’t exist it’ll “make one up.”

    Which is itself a misnomer, because it can’t look for an answer and then decide to make one up when it can’t find it. It just gives an answer that sounds plausible, and if the correct answer is most likely in its training data then that’ll seem most plausible.


  • “Unintentionally” is the wrong word, because it attributes the intent to the model rather than the people who designed it.

    You misunderstand me. I don’t mean that the model has any intent at all. Model designers have no intent to misinform: they designed a machine that produces answers.

    True answers or false answers, a neural network is designed to produce an output. Because a null result (“there is no answer to that question”) is very, very rare online, the training data doesn’t include it; meaning that a GPT will almost invariably produce any answer; if a true answer does not exist in its training data, it will simply make one up.

    But the designers didn’t intend for it to reproduce misinformation. They intended it to give answers. If a model is trained with the intent to misinform, it will be very, very good at it indeed; because the only training data it will need is literally everything except the correct answer.


  • Sure, but unintentionally. I heard about a guy whose small business (which is just him) recently had someone call in, furious because ChatGPT told them that he was having a sale that she couldn’t find. The customer didn’t believe him when he said that the promotion didn’t exist. Once someone decides to leverage that, and make a sufficiently-popular AI model start giving bad information on purpose, things will escalate.

    Even now, I think Elon could put a small company out of business if he wanted to, just by making Grok claim that its owner was a pedophile or something.