• 100@fedia.io
    link
    fedilink
    arrow-up
    28
    arrow-down
    1
    ·
    4 months ago

    time to fill sites code with randomly generated garbage text that humans will not see but crawlers will gobble up?

    • SerotoninSwells@lemmy.world
      link
      fedilink
      arrow-up
      13
      ·
      4 months ago

      I don’t think it’s a bad idea but it’s largely dependent on the crawler. I can’t speak for AI based crawlers, but typical scraping targets specific elements on a page or grabbing the whole page and parsing it for what you’re looking for. In both instances, your content is already scrapped and added to the pile. Overall, I have to wonder how long “poisoning the water well” is going to work. You can take me with a grain of salt, though; I work on detecting bots for a living.