• SillyDude@lemmy.zip
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    9
    ·
    2 days ago

    I asked gpt5 and it told me to check the clutch safety switch. The thing you fixed.

    • skulblaka@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      17
      ·
      2 days ago

      5-10 years ago, you could be pretty sure this was a thing that actually needed checked, since the post about the clutch safety switch was posted by a real person who presumably had the same problem as you and fixed it with this method.

      Now, there’s no way to know if that’s actually the case, or if “clutch safety switch” is just a likely string of words to feed someone who is having car trouble. You might get lucky, or you might get sent on eight consecutive goose chases because an LLM fundamentally doesn’t know what factual knowledge is, it only knows how to reorder and regurgitate things that other people have said in other contexts.

      • fta@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        2 days ago

        I agree with the larger point you’re making, but chatbots are getting better at referencing posts / websites from which they’re taking a solution.

        That’s if and only if of course they used a web search tool to answer, and if that website is still alive — made less likely due to AI.

        But for debugging something like this, it is actually helpful for now with citations enabled.

        • CmdrShepard49@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          2 days ago

          The problem is that right now would be the peak of this information being available. What are you going to find in 20 years when everyone has abandoned forums in favor of asking ChatGPT for all the answers? There would be nothing left to train the models on.

    • CmdrShepard49@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 days ago

      Did it give a diagram and troubleshooting steps from the factory service manual too? This is all stuff you would typically find in forums. There’s always some dealer tech around who can copy and paste from their service equpiment/library

    • PlantJam@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      2 days ago

      I tried giving minimal information and still got similar results.

      When I think about what got worse about the internet, it’s mostly the life stories before recipes, the novel length pages to maybe answer a simple question, and pretty much anything else related to SEO.