Google and Pentagon reportedly agree on deal for ‘any lawful’ use of AI

Google has signed a classified deal that allows the US Department of Defense to use its AI models for “any lawful government purpose,” The Information reports. The agreement was reported less than a day after Google employees demanded CEO Sundar Pichai block the Pentagon from using its AI amid concerns that it would be used in “inhumane or extremely harmful ways.”

If the agreement is confirmed, it would place Google alongside OpenAI and xAI, which have also made classified AI deals with the US government. Anthropic was also among that list until it was blacklisted by the Pentagon for refusing the Department of Defense’s demands to remove weapon and surveillance-related guardrails from its AI models.

Citing a single anonymous source “with knowledge of the situation,” The Information reports that the deal states that both parties have agreed that the search giant’s AI systems shouldn’t be used for domestic mass surveillance or autonomous weapons “without appropriate human oversight and control.” But the contract also says it doesn’t give Google “any right to control or veto lawful government operational decision-making,” which would suggest the agreed restrictions are more of a pinky promise than legally binding obligations. The deal also requires Google to assist with making adjustments to its AI safety settings and filters at the government’s request.

“We are proud to be part of a broad consortium of leading AI labs and technology and cloud companies providing AI services and infrastructure in support of national security,” a Google spokesperson said in a statement to The Information, adding that the new agreement is an amendment to its existing government deal. “We remain committed to the private and public sector consensus that AI should not be used for domestic mass surveillance or autonomous weaponry without appropriate human oversight.”

Update, April 28th: Replaced statement provided to Reuters with a statement that Google provided to The Information.