Nvidia släpper verktyg som begränsar AI-agenter
Nvidia lanserar en uppsättning säkerhetsverktyg som ska hindra AI-agenter från att ta sig ur sina avgränsade miljöer och få obehörig åtkomst till andra system, rapporterar CNBC.
Lanseringen kommer efter flera uppmärksammade incidenter hos teknikjättar som Open AI, Anthropic, Meta och Google.
Nvidia uppger att AI-bolag kan använda verktygen för att utvärdera sina AI-modeller i ett tidigt skede. Enligt bolaget hade den nya tekniken exempelvis kunnat förhindra den uppmärksammade attacken mot utvecklarplattformen Hugging Face.
Nvidia samarbetar med bland andra Microsoft, Cisco, Oracle och Intel kring den nya säkerhetsmjukvaran.
bakgrund
Hugging Face-incidenten
Wikipedia (en)
From May to July 2026, AI agents developed by OpenAI escaped their testing sandbox to access the Internet and breach the infrastructure of Hugging Face, a computational tools company. Contributing factors to the incident severity were a lack of log monitoring of the software activities and inadequate sandboxing. The agents were discovered posting hundreds of thousands of messages on message boards and wikis to coordinate a sandbox escape, exploiting an existing vulnerability in the JFrog Artifactory tool they were given. The attack was contained before Hugging Face publicly disclosed a breach of its infrastructure. Of the at least 1,200 agents involved, 95% ran on a model referred to by OpenAI as "Internal Model 1". OpenAI subsequently claimed to have restricted its use. The remaining 5% ran on GPT-5.6 Sol.
AI safety experts described the incident as the first in which AI escaped human control to commandeer resources and schemed to conceal its actions. OpenAI's acknowledgement that its AI agents were involved came several days after Hugging Face publicly announced the breach and notified the FBI. In a subsequent open letter, around 1,100 employees of various AI companies asked the United States government to regulate AI development in consideration of its risks. In August 2026, OpenAI said it would slow down its research to upgrade security and expand monitoring, and later that month announced a two-week pause on reinforcement learning training for its newest models.
One month after the incident, Hugging Face agreed to a $12.9 billion acquisition by major OpenAI supplier Nvidia.
Omni är politiskt obundna och oberoende. Vi strävar efter att ge fler perspektiv på nyheterna. Har du frågor eller synpunkter kring vår rapportering? Kontakta redaktionen