Brought to you by the Department of Erasing History.

  • girsaysdoomEnglish
    arrow-up
    27
    arrow-down
    2
    ·
    5 months ago
    link
    fedilink

    It might be that someone wanted to change something that was on a website before the archive could get to it too.

    • KairuByteEnglish
      arrow-up
      34
      arrow-down
      1
      ·
      5 months ago
      link
      fedilink

      That’s a ridiculous amount of effort to go through to slow down a scraper for one site, especially when that site could just be turned off.

      • Saik0English
        arrow-up
        12
        arrow-down
        0
        ·
        5 months ago
        link
        fedilink

        If you own the domain you can disable the crawler on it. And remove previous scrapes.

        • KairuByteEnglish
          arrow-up
          15
          arrow-down
          0
          ·
          5 months ago
          edit-2
          5 months ago
          link
          fedilink

          Then it still makes no sense, as you being unable to take down the content means you also very likely can’t edit the content. I can’t think of a situation where you:

          1. Need content to not be scraped
          2. Need time to remove/edit that content
          3. Have access to do the above
          4. Don’t have access to pull the content immediately
          5. Have control of a large enough botnet to take down Internet Archive
          6. Don’t have a big enough botnet to take down the aforementioned content
          • Saik0English
            arrow-up
            7
            arrow-down
            0
            ·
            5 months ago
            link
            fedilink

            Well that’s my point It doesn’t make sense because you can just go after the fact and make the request to take it all down.

            You have to be stupidly paranoid and obscenely stupid to believe that a DDOS is the correct answer if this is the case.

          • r3df0x ✡️✝☪️English
            arrow-up
            1
            arrow-down
            0
            ·
            5 months ago
            link
            fedilink

            On an individual level, having a massive archive of everything you’ve ever posted isn’t always a good thing, especially when mentally ill people will quote mine a single post and then try to misuse it.