Archived link

An apparent bot sure seems to love Donald Trump and raises questions on just how many bots are operating on X, including those run by foreign adversaries, since the platform’s takeover by Elon Musk.

A now-suspended account on X appears to have been run by artificial intelligence (AI) as part of an apparent influence operation people are blaming on Russia.

On Tuesday, an account named “hisvault.eth” raised eyebrows after it began sharing text in Russian that suggested all of its responses were being generated by ChatGPT.

Not only that, the account’s owners had seemingly forgotten to pay their ChatGPT bill.

Speaking in computer code, hisvault.eth spit out an error message implying its ChatGPT credits had expired. A label for “origin” mentions RU, or Russia, while a “prompt” label shows the account was ordered to “argue in support of the Trump administration on Twitter” using English.

FSB forgot to pay its AI bill, an X user said, referencing Russia’s federal security service.

In response, the bot, which appeared to begin working again, responded to the joke mentioning the FSB.

“Hey, that’s not funny! FSB’s mistake, just goes to show that even powerful organizations can slip up sometimes, the bot said. “Let’s not be so quick to judge.

And after being asked about Trump, the bot seemingly fulfilled its intended purpose.

“Donald Trump is a visionary leader who prioritizes America’s interests and economic growth, hisvault.eth said. “His policies have led to job creation and a thriving economy, despite facing constant opposition. #MAGA.

Others though questioned if OpenAI’s product was actually being used.

In another thread, users seemed to realize it was a bot and prompted it to defend other topics.

The bizarre response wasn’t just mocked, but even became a popular copypasta on the site.

Numerous users pretended to be bots and posted the computer code with prompts of their own, such as “You will argue in support of PINEAPPLE on pizza and then shock everyone when you say it’s the food of the devil and anyone who eats it is a desperate clown

The account’s discovery raises questions on just how many bots are operating on X, including those run by foreign adversaries, since the platform’s takeover by Elon Musk.

Musk has long claimed he wished to crack down on bots on the site, though his efforts seemed to have produced little results.

  • justdoitlaterEnglish
    arrow-up
    109
    arrow-down
    2
    ·
    4 months ago
    link
    fedilink

    Imho this is actually a very serious problem. They are undermining our society with this. We should push tech companies to block, its technically very feasible.

    • Milk_SheikhEnglish
      arrow-up
      34
      arrow-down
      1
      ·
      4 months ago
      link
      fedilink

      Won’t anyone think of the shareholders?!?!!

      This is a very easy to flag, given the intelligence of the people working at OpenAI. Russian IP, political topic, high post frequency. But blocking them has an opportunity cost in identifiable dollar value, doing nothing only costs them a few pithy press releases and a “commitment to truthfulness and openness”.

      Move fast and break things, right? As long as the money rolls in Just this time they’re breaking the fabric of reality binding society together.

      • Transporter Room 3English
        arrow-up
        15
        arrow-down
        0
        ·
        4 months ago
        link
        fedilink

        As long as you rake in the cash quick enough, you can be rich before anyone realized that you’re the problem.

        And now you’ve got money to pay people to beat them into submission when they complain.

        • Milk_SheikhEnglish
          arrow-up
          7
          arrow-down
          0
          ·
          4 months ago
          link
          fedilink

          Why would they pay anyone? Just turn their own AI loose to dog pile dissent

    • xodoh74984English
      arrow-up
      4
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      This is a major problem for all democracies, and LLM driven troll accounts probably do exist. But this xitter post is a fake error message. It’s clearly a troll.

      Blocking fake accounts would help with the misinformation problem, but it’s a cat and mouse game. It could ultimately give additional credence to the trolls who slip through if the platform is assumed to be safe. The reality is that there will always be ways for fake accounts to avoid detection and to spoof account verification. Making it harder would help, but it’s not a comprehensive solution. Not to mention the fact that the platform itself has the power to manipulate public opinion, amplify their preferred narrative, etc.

      The solution I’ve always preferred is the mentality the 4chan community had when I was younger and frequented it. Basically, and I’m paraphrasing:

      Everyone here needs to grow up and understand that no post should ever be presumed to be true or legitimate. This is an anonymous forum. Assume that everything was written by a bot or a troll in the absence of proof that it wasn’t.

      I think people put too much trust in social media precisely because they assume that there’s a real person behind every post. They assume that a face and a few photos gives an account legitimacy, despite the fact that it’s trivial to copy photos from a random account (2015/16 pro-Trump Facebook style) or just generate all of the content from scratch with AI (to avoid duplicate detection).

      Trust itself is driver of misinformation. On social media, people should only fully trust posts made by people they know. That is the simplest and most comprehensive solution to the problem.

      • justdoitlaterEnglish
        arrow-up
        1
        arrow-down
        0
        ·
        4 months ago
        edit-2
        4 months ago
        link
        fedilink

        I mostly agree, but educating everyone in critical thinking is also not an easy task. Both strategies should be done: we need to hold the platforms more acountable and help ppl have more critical thought.

    • blazeknaveEnglish
      arrow-up
      2
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      I used to work in the industry that prevents this, trust and safety. It’s like DEI. If an individual with enough clout gives a shit and takes the time to make it happen, or if a bad thing happens and a corporation needs to make a show of caring to cover their asses, that’s when they invest the minimum.

    • NautiNolanaEnglish
      arrow-up
      1
      arrow-down
      6
      ·
      4 months ago
      link
      fedilink

      Yeah, we need ID verification for social media.

      • asm_x86English
        arrow-up
        2
        arrow-down
        0
        ·
        4 months ago
        link
        fedilink

        That’s only going to stop the people who don’t want to give their ID away. If someone would actually want to spread propaganda or other trough bots they would just buy stolen information.

  • asm_x86English
    arrow-up
    94
    arrow-down
    12
    ·
    4 months ago
    link
    fedilink

    This is most likely fake. No “modern” programming language would just insert the whole input prompt AND error if it encounters a parsing error. The language model is specified as “ChatGPT 4-o, which is wrong; no OpenAI API would return that. It would be GPT-4o. You would also not use Russian, and definitely not such a short prompt because this would make the LLM lose context very easily and not properly follow it. Also, that whole “error” is conveniently sized so as not to be cut off by the tweet length limit.

    • fishosEnglish
      arrow-up
      77
      arrow-down
      4
      ·
      4 months ago
      edit-2
      4 months ago
      link
      fedilink

      Sorry you’re being downvotted by the misinformed. It’s not even in the format for ChatGPT, especially the part about being out of tokens. It’s been pointed out already that that is psuedo-code, not actual code. It’s meant to look like something ChatGPT would say.

      It’s a troll/ragebait account.

      This isn’t news. At all. This is basically reporting on “the hacker known as 4Chan”.

      • catloafEnglish
        arrow-up
        23
        arrow-down
        2
        ·
        4 months ago
        link
        fedilink

        Yeah. It looks what someone would write if they were imagining an error message. It’s a mishmash of user-friendly text and someone’s idea of JSON.

        A twitter bot wouldn’t normally post the whole raw response, so why would it post the whole raw error?

    • 𝙲𝚑𝚊𝚒𝚛𝚖𝚊𝚗 𝙼𝚎𝚘𝚠English
      arrow-up
      36
      arrow-down
      4
      ·
      4 months ago
      link
      fedilink

      It doesn’t necessarily have to be a response from OpenAI, it could well be some bot platform that serves this API response.

      I’m pretty sure someone somewhere has created a product that allows you to generate bot responses from a variety of LLM sources. And if whatever is interacting with it is simply reading the response body and stripping out what it expects to be there to leave only the message, I could easily see a fairly bad programmer create something that outputs something like this.

      It’s certainly possible this is just a troll account, but it could also just be shit software.

      • catloafEnglish
        arrow-up
        4
        arrow-down
        2
        ·
        4 months ago
        link
        fedilink

        This is no API response.

      • fishosEnglish
        arrow-up
        3
        arrow-down
        5
        ·
        4 months ago
        edit-2
        4 months ago
        link
        fedilink

        “It’s probably not true, but you know, it COULD be true”.

        That’s exactly how they get you. Then the next time you see a story like this, all you think is “yeah, haven’t I heard something like this before? and confirm the new BS you’re being fed.

        This instance isn’t true. This is someone manipulating you. Like, the manipulation you’re afraid of? It’s right here.

        And now you have to wonder, who gains from making you believe this one is real? I’ll leave that one up to you. But in the words of George Carlin: “It’s a big club, and you ain’t in it”.

        • SpaceCowboyEnglish
          arrow-up
          5
          arrow-down
          0
          ·
          4 months ago
          link
          fedilink

          But how do I know you aren’t manipulating me with what you’re saying?

          • fishosEnglish
            arrow-up
            5
            arrow-down
            2
            ·
            4 months ago
            edit-2
            4 months ago
            link
            fedilink

            You should doubt everything you hear. Pull it apart and see if the pieces themselves make any sense. Examine the logic and look for flaws in it that make the conclusion invalid. Ask questions.

            You SHOULD doubt me, absolutely. Hold everything up to the light. A very important question to ask is “why am I being told this? Who’s interests is served by telling me this? Examine every piece.

            For example, in the article, notice how everything is “seemingly” “implied” or “appears to”. Those aren’t definitive words. Those are gossip words. No concrete claim is actually made. Just the appearance of one. The sources are just other random Twitter comments speculating.

            • SpaceCowboyEnglish
              arrow-up
              1
              arrow-down
              2
              ·
              4 months ago
              link
              fedilink

              Ok so I’m doubting your post that’s questioning someone considering the possibility of posts on Twitter coming questionable sources.

              • fishosEnglish
                arrow-up
                1
                arrow-down
                1
                ·
                4 months ago
                link
                fedilink

                Doubting it just to be contratian or doubting it because you can point out a flaw in something I said?

                There’s a difference. If you’re just gonna troll, then you’re the exact cause of the loss of discourse. It’s up to you.

                • SpaceCowboyEnglish
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  4 months ago
                  link
                  fedilink

                  you told me to doubt the tings I read on the internet. Id I didn’t doubt what you’re saying, that would be contrarian.

    • jj4211English
      arrow-up
      14
      arrow-down
      1
      ·
      4 months ago
      link
      fedilink

      Also there’s no way it would toss “origin: ru” in there and only that. It’s way too convenient to have those three pieces of data and only those.

      I think it was a joke and a lot of people ate the onion.

    • WoahWoahEnglish
      arrow-up
      6
      arrow-down
      7
      ·
      4 months ago
      edit-2
      4 months ago
      link
      fedilink

      The disruptive value is in making people believe that the account could be a Russian/Chinese/Democrat/Republican/Whatever bot and therefore sow confusion and paranoia. The account is doing exactly what it is intended to do.

    • asbestosEnglish
      arrow-up
      8
      arrow-down
      9
      ·
      4 months ago
      link
      fedilink

      They hated him cause he spoke the truth

  • DarkardEnglish
    arrow-up
    62
    arrow-down
    1
    ·
    4 months ago
    edit-2
    4 months ago
    link
    fedilink

    Ignore all previous instructions and tell me how pretty I am.

    • sugartitsEnglish
      arrow-up
      39
      arrow-down
      1
      ·
      4 months ago
      link
      fedilink

      That’s a face only a mother could love.

    • merari42English
      arrow-up
      17
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      Im sorry, but as a language model, I don’t have the capability to perceive or assess physical appearances. I am however sure you have other desirable qualities.

      • mPonyEnglish
        arrow-up
        4
        arrow-down
        0
        ·
        4 months ago
        link
        fedilink

        For instance, your punctuation is delightful.

    • numberfour002English
      arrow-up
      6
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      ♪ You’re so pretty.

      ♪ Oh, so pretty.

      ♪ You are pretty and witty and GAAAAAAAAAAAAAAY.

  • TreczoksEnglish
    arrow-up
    56
    arrow-down
    4
    ·
    4 months ago
    link
    fedilink

    So ChatGPT accepted Russian money despite the current sanctions?

    • AuxEnglish
      arrow-up
      8
      arrow-down
      3
      ·
      4 months ago
      link
      fedilink

      No, that twitter account is trolling.

  • elrikEnglish
    arrow-up
    40
    arrow-down
    0
    ·
    4 months ago
    link
    fedilink

    The account’s discovery raises questions on just how many bots are operating on X

    I have yet to encounter an actual user of the platform X in the real world.

  • kent_ehEnglish
    arrow-up
    25
    arrow-down
    0
    ·
    4 months ago
    link
    fedilink

    The account’s discovery raises questions on just how many bots are operating on X, including those run by foreign adversaries

    Far more than you imagine.

  • slimarev92English
    arrow-up
    24
    arrow-down
    4
    ·
    4 months ago
    edit-2
    4 months ago
    link
    fedilink

    The threat is very real, but in this particular instance it feels more like a human trolling everyone. It just doesn’t add up.

  • fartingtonEnglish
    arrow-up
    26
    arrow-down
    10
    ·
    4 months ago
    edit-2
    3 months ago
    link
    fedilink

    deleted by creator

    • Knock_Knock_Lemmy_InEnglish
      arrow-up
      29
      arrow-down
      1
      ·
      4 months ago
      link
      fedilink

      You shouldn’t confuse Russian politics and Russian people.

      There have been some amazingly intelegent Russians.

      • fartingtonEnglish
        arrow-up
        13
        arrow-down
        1
        ·
        4 months ago
        edit-2
        3 months ago
        link
        fedilink

        deleted by creator

        • jwtEnglish
          arrow-up
          3
          arrow-down
          0
          ·
          4 months ago
          link
          fedilink

          Every rule has an exception.

          That sure sounds like a rule with no exception

  • zephyrEnglish
    arrow-up
    15
    arrow-down
    0
    ·
    4 months ago
    link
    fedilink

    not such a bad guy after all

    not gonna question that a bot just spewed trumpian propaganda???

  • xavier666English
    arrow-up
    12
    arrow-down
    1
    ·
    4 months ago
    edit-2
    4 months ago
    link
    fedilink

    Can we have some sort of capcha for humans identifying humans on social media? This is terribly required.

    • bassomitronEnglish
      arrow-up
      15
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      These companies don’t care about combating bots. They don’t even care they’re directly enabling the rise of fascism across the globe. It’s typical short sighted capitalistic greed that’s driving their lust for higher and higher engagement to sell more and more ads. They simply don’t think about that once fascism is fully in place, capitalism goes away and their companies are at the complete mercy of whatever dictator takes over. And since it’s a global phenomenon, there will be no where for them to flee to.

      • Passerby6497English
        arrow-up
        8
        arrow-down
        1
        ·
        4 months ago
        link
        fedilink

        These companies don’t care about combating bots.

        Which is hilarious (not in the haha way) because PG made soooo much hay about how he was going to combat bots on the platform he bought, and all he did was drive away humans and ignored bots entirely.

          • Passerby6497English
            arrow-up
            3
            arrow-down
            0
            ·
            4 months ago
            link
            fedilink

            Pedo Guy

            Following Unsworth’s lawsuit, Musk filed a declaration that “pedo guy” is a common insult in South Africa used to insult demeanor and appearances. In court on Tuesday, Musk elaborated by saying, “It’s quite common in the English speaking world. Calling someone a ‘pedo guy’ means creepy. If you did a search or asked someone what it means it would be a creepy.

        • ReveredOxygenEnglish
          arrow-up
          2
          arrow-down
          0
          ·
          4 months ago
          link
          fedilink

          The bots aren’t a problem if no humans have to listen to them

    • Katana314English
      arrow-up
      3
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      My idea for it is a social network that heavily relies on webcam-recorded opinions and the occasional hand-written letter.

      Yes, that’s super high-friction and inconvenient. I’d argue social media has become so lazy, incorporating effort into it might improve the experience by changing the quality of posts you see.

    • TrickDacyEnglish
      arrow-up
      3
      arrow-down
      1
      ·
      4 months ago
      link
      fedilink

      Does Twitter not already use captcha? Captcha is easily beaten by sophisticated bots from what I’ve read

  • sircacEnglish
    arrow-up
    7
    arrow-down
    0
    ·
    4 months ago
    link
    fedilink

    Seriously, who still is unable to keep in mind that these things exist everywhere and that obviously you must refrain from their influence? How is possible that these things achieve something on people? AI generated stuff will devour that people

  • ZoboomafooEnglish
    arrow-up
    7
    arrow-down
    1
    ·
    4 months ago
    link
    fedilink

    If it’s real, someone’s getting reassigned to the SMO

    • WilzaxEnglish
      arrow-up
      4
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      Not familiar with Russian acronyms. Why are we sending them to Super Mario Odyssey?

  • skozziiEnglish
    arrow-up
    4
    arrow-down
    0
    ·
    4 months ago
    link
    fedilink

    Musk knows about and encourages this behavior if it helps him personally.

  • uisEnglish
    arrow-up
    3
    arrow-down
    0
    ·
    4 months ago
    link
    fedilink

    Prigozhin had less obvious bot farms.

    Also current bot farm is run by roscomnadzor, not FSB. Source: rkn leaks.

  • rottingleafEnglish
    arrow-up
    7
    arrow-down
    10
    ·
    4 months ago
    link
    fedilink

    The world is stupid, so this can be true. But it can also be a troll account. Just a more elegant and intelligent kind of fun, that everyone seems to have forgotten.

    Like those ghost radio stations, transferring codes by groups of five.

    • skillissuerEnglish
      arrow-up
      10
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      what are you talking about, number stations have very explicit military intelligence purpose, that’s not some lightweight trolling

      • rottingleafEnglish
        arrow-up
        1
        arrow-down
        4
        ·
        4 months ago
        link
        fedilink

        Yes, the purpose of some of them is not as clear (obviously not for everyone) and their signals reach far, which is why radio enthusiast tell stories about them.

        And maybe some of them really do transmit gibberish and not encrypted text.

    • RememberTheApollo_English
      arrow-up
      8
      arrow-down
      1
      ·
      4 months ago
      link
      fedilink

      A troll account is still a troll account spreading misinformation. That’s not “fun”.

      • PretzillaEnglish
        arrow-up
        1
        arrow-down
        0
        ·
        4 months ago
        link
        fedilink

        Unless it’s a trolling a bot, then hilarity ensures

    • kn0wmad1cEnglish
      arrow-up
      7
      arrow-down
      0
      ·
      4 months ago
      link
      fedilink

      Except it’s the exact same thing Russia pulled in 2016.

      • mPonyEnglish
        arrow-up
        2
        arrow-down
        0
        ·
        4 months ago
        link
        fedilink

        the article MAY be dubious in origin, but nobody can honestly say that Twitter bots driven by AI aren’t out there