OpenAI Revises Pentagon Deal After CEO Admits Initial Agreement Was ‘Sloppy’

OpenAI is amending its recent agreement to provide artificial intelligence to the U.S. Department of War following criticism and an admission from CEO Sam Altman that the deal was "opportunistic and sloppy." The rapid agreement, struck after the Pentagon dropped its previous AI contractor, Anthropic, had raised concerns about potential misuse for domestic surveillance and autonomous weapons.

Key Takeaways

• OpenAI CEO Sam Altman acknowledged the initial Pentagon deal was "sloppy" and "opportunistic."
• The company is amending the deal to explicitly prohibit the use of its technology for domestic mass surveillance or by defense intelligence agencies.
• The move comes after significant backlash from users and concerns raised by employees and former researchers.
• Anthropic, the previous contractor, was dropped by the Pentagon after refusing to allow its AI for certain military applications.

Shifting Sands of AI and Defense

OpenAI’s hastily arranged contract with the Department of War (DoW) has come under intense scrutiny. CEO Sam Altman admitted that the deal was struck too quickly after the Pentagon severed ties with Anthropic, its previous AI provider. Altman stated that while the intention was to de-escalate, the execution appeared "opportunistic and sloppy."

Addressing Surveillance and Weaponry Concerns

In response to widespread criticism and fears echoing the Snowden revelations, OpenAI is implementing amendments to its deal. The company will explicitly bar its AI technology from being used for domestic mass surveillance or by defense department intelligence agencies like the NSA. This comes despite initial assurances that the contract included "more guardrails than any previous agreement for classified AI deployments."

Employee and Public Backlash

The deal sparked an online backlash, with campaigns urging users to "delete ChatGPT." Furthermore, nearly 900 employees from OpenAI and Google signed an open letter calling on their leadership to refuse the DoW’s demands for AI use in surveillance and autonomous killing without human oversight. OpenAI confirmed that its agreement includes a red line against the "use of OpenAI technology to direct autonomous weapons systems."

Anthropic’s Stance and OpenAI’s Approach

Anthropic had previously insisted that using its AI for mass domestic surveillance was incompatible with democratic values, a stance that led President Trump to direct federal agencies to cease using its technology. OpenAI’s approach, according to Altman, differed by focusing on applicable laws rather than specific contractual prohibitions, a move that allowed them to secure the deal where Anthropic could not. However, legal experts note that OpenAI’s contract may not provide the same level of independent prohibition rights as Anthropic sought, relying more on the assumption that the Pentagon will adhere to existing laws.

Future Implications

The situation highlights the complex ethical considerations surrounding the use of advanced AI in military and intelligence operations. The amendments by OpenAI aim to appease internal and external critics, but the long-term implications for AI development, government contracts, and the balance between technological advancement and ethical safeguards remain a subject of ongoing debate.

Sources

• OpenAI amends Pentagon deal as Sam Altman admits it looks ‘sloppy’ | OpenAI, The Guardian.
• OpenAI’s ‘compromise’ with the Pentagon is what Anthropic feared, MIT Technology Review.

IntelligentHQ

Founder Dinis Guarda

IntelligentHQ Your New Business Network.

IntelligentHQ is a Business network and an expert source for finance, capital markets and intelligence for thousands of global business professionals, startups, and companies.

We exist at the point of intersection between technology, social media, finance and innovation.

IntelligentHQ leverages innovation and scale of social digital technology, analytics, news, and distribution to create an unparalleled, full digital medium and social business networks spectrum.

IntelligentHQ is working hard, to become a trusted, and indispensable source of business news and analytics, within financial services and its associated supply chains and ecosystems