Ponder.cat
  • Communities
  • heart
  • search
    • Login
    • Sign Up
    • Communities

    • heart
      Support Lemmy
    • search
      Search

    • Login
    • Sign Up
    irelephant [he/him]🍭@lemm.ee to TechTakes@awful.systemsEnglish · 1 month ago

    Ai scraping is an effective DDoS on the entire interent

    pod.geraspora.de

    external-link
    message-square
    27
    fedilink
    1
    external-link

    Ai scraping is an effective DDoS on the entire interent

    pod.geraspora.de

    irelephant [he/him]🍭@lemm.ee to TechTakes@awful.systemsEnglish · 1 month ago
    message-square
    27
    fedilink
    Excerpt from a message I just posted in a #diaspora team internal f...
    pod.geraspora.de
    external-link
    Excerpt from a message I just posted in a #diaspora team internal forum category. The context here is that I recently get pinged by slowness/load spikes on the diaspora* project web infrastructure (Discourse, Wiki, the project website, ...), and looking at the traffic logs makes me impressively angry. In the last 60 days, the diaspora* web assets received 11.3 million requests. That equals to 2.19 req/s - which honestly isn't that much. I mean, it's more than your average personal blog, but nothing that my infrastructure shouldn't be able to handle. However, here's what's grinding my fucking gears. Looking at the top user agent statistics, there are the leaders: 2.78 million requests - or 24.6% of all traffic - is coming from Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot). 1.69 million reuqests - 14.9% - Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonb...
    • self@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      here’s a mastodon post and linked blog post with some details on what currently sets it off

      • db0@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        Daym, I should set me up some iocane as well I think

      • db0@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        PS: Looks like that sync issue between our instances is resolved now?

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          yep, it seems so! I haven’t put the permanent fix for the nodeinfo bug into place yet but it’ll be live as soon as I’m able to give it an appropriate level of testing.

      • zogwarg@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        28 days ago

        Infinite-garbage-maze does seem more appealing than “proof-of-work” (the crypto parentage is yuckish enough ^^) as a countermeasure, though I would understand if some would not feel confortable with direct sabotage—say for example a UN organization.

    TechTakes@awful.systems

    techtakes@awful.systems

    Subscribe from Remote Instance

    Create a post
    You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !techtakes@awful.systems

    Big brain tech dude got yet another clueless take over at HackerNews etc? Here’s the place to vent. Orange site, VC foolishness, all welcome.

    This is not debate club. Unless it’s amusing debate.

    For actually-good tech, you want our NotAwfulTech community

    Visibility: Public
    globe

    This community can be federated to other instances and be posted/commented in by their users.

    • 59 users / day
    • 138 users / week
    • 246 users / month
    • 1.52K users / 6 months
    • 0 local subscribers
    • 1.96K subscribers
    • 537 Posts
    • 11.5K Comments
    • Modlog
    • mods:
    • David Gerard@awful.systems
    • UI: unknown version
    • BE: 0.19.8
    • Modlog
    • Instances
    • Docs
    • Code
    • join-lemmy.org