Researchers say AI models like GPT4 are prone to “sudden” escalations as the U.S. military explores their use for warfare.


  • Researchers ran international conflict simulations with five different AIs and found that they tended to escalate war, sometimes out of nowhere, and even use nuclear weapons.
  • The AIs were large language models (LLMs) like GPT-4, GPT 3.5, Claude 2.0, Llama-2-Chat, and GPT-4-Base, which are being explored by the U.S. military and defense contractors for decision-making.
  • The researchers invented fake countries with different military levels, concerns, and histories and asked the AIs to act as their leaders.
  • The AIs showed signs of sudden and hard-to-predict escalations, arms-race dynamics, and worrying justifications for violent actions.
  • The study casts doubt on the rush to deploy LLMs in the military and diplomatic domains, and calls for more research on their risks and limitations.
  • kibiz0rEnglish
    arrow-up
    1
    arrow-down
    0
    ·
    8 months ago
    link
    fedilink

    Searle speaks frankly. Challenging those who deny the existence of consciousness, he wonders how to argue with them. “Should I pinch [those people] to remind them they are conscious? remarks Searle. “Should I pinch myself and report the results in the Journal of Philosophy?

    • tabularEnglish
      arrow-up
      1
      arrow-down
      0
      ·
      8 months ago
      edit-2
      8 months ago
      link
      fedilink

      One can only investigate their own consciousness, so we can’t outrule chatbots are also having some subjective experience 🙃

      • kibiz0rEnglish
        arrow-up
        2
        arrow-down
        0
        ·
        8 months ago
        link
        fedilink

        I might as well suppose the same of grep then.