Ponder.cat
  • Communities
  • heart
  • search
    • Login
    • Sign Up
    • Communities

    • heart
      Support Lemmy
    • search
      Search

    • Login
    • Sign Up
    sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 1 day ago

    The Open-Source Software Saving the Internet From AI Bot Scrapers

    www.404media.co

    external-link
    message-square
    21
    fedilink
    • cross-posted to:
    • 404media@rss.ponder.cat
    • opensource@lemmy.ml
    • opensource@programming.dev
    131
    external-link

    The Open-Source Software Saving the Internet From AI Bot Scrapers

    www.404media.co

    sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 1 day ago
    message-square
    21
    fedilink
    • cross-posted to:
    • 404media@rss.ponder.cat
    • opensource@lemmy.ml
    • opensource@programming.dev
    Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
    • FundMECFS@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      11
      ·
      1 day ago

      This thing Anubis always flags me for some reason. I use mullvad and safari (ios) with some add and tracker blocking extensions.

      • Appoxo@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        2
        ·
        11 hours ago

        I wonder why traffic from known VPN companies are under more scrutiny than traffic from domestic households…

      • Photuris@lemmy.ml
        link
        fedilink
        arrow-up
        5
        ·
        22 hours ago

        More sites in general are blocking mullvad traffic lately (in my experience), and I’m not sure what, if anything, can be done about it.

        • FundMECFS@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          5
          ·
          22 hours ago

          I expect better from a popular FOSS tool being used by privacy aware people though.

          • Lime Buzz (fae/she)@beehaw.org
            link
            fedilink
            English
            arrow-up
            1
            ·
            21 hours ago

            Can you open an issue, or see if one is open already for this?

        • Powderhorn@beehaw.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          18 hours ago

          Agreed. Luckily, they don’t seem to have the full list of Mullvad IPs, so if I really want to read something, I just try another tunnel.

      • simple@piefed.social
        link
        fedilink
        English
        arrow-up
        6
        ·
        24 hours ago

        Do you have javascript or cookies disabled? That might stop you from getting past.

        • FundMECFS@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          3
          ·
          24 hours ago

          nope

    Technology@beehaw.org

    technology@beehaw.org

    Subscribe from Remote Instance

    Create a post
    You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org

    A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

    Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

    Subcommunities on Beehaw:

    • Free and Open Source Software
    • Programming
    • Operating Systems

    This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

    Visibility: Public
    globe

    This community can be federated to other instances and be posted/commented in by their users.

    • 314 users / day
    • 1.03K users / week
    • 2.64K users / month
    • 7.74K users / 6 months
    • 2 local subscribers
    • 39.5K subscribers
    • 1.37K Posts
    • 14.4K Comments
    • Modlog
    • mods:
    • Chris Remington@beehaw.org
    • alyaza [they/she]@beehaw.org
    • TheRtRevKaiser@beehaw.org
    • gyrfalcon@beehaw.org
    • rs5th@beehaw.org
    • coldredlight@beehaw.org
    • Leigh@beehaw.org
    • UI: unknown version
    • BE: 0.19.8
    • Modlog
    • Instances
    • Docs
    • Code
    • join-lemmy.org