{"id":806568,"date":"2026-09-28T09:09:00","date_gmt":"2026-09-28T16:09:00","guid":{"rendered":"https:\/\/www.oann.com\/?p=806568"},"modified":"2026-09-28T09:09:03","modified_gmt":"2026-09-28T16:09:03","slug":"nvidia-unveils-security-platform-to-stop-ai-agents-from-going-rogue-after-new-troubling-incidents","status":"publish","type":"post","link":"https:\/\/www.oann.com\/tech\/nvidia-unveils-security-platform-to-stop-ai-agents-from-going-rogue-after-new-troubling-incidents\/","title":{"rendered":"Nvidia unveils security platform to stop AI agents from going rogue after new, troubling incidents"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">By KELVIN CHAN and ANNE D\u2019INNOCENZIO<br>Updated 6:21 AM PDT, September 28, 2026<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"533\" src=\"https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp\" alt=\"A logo of Nvidia is displayed at at the Computex Taipei exhibition, one of the world\u2019s largest computer and technology expos, in Taipei, Taiwan, Wednesday, June 3, 2026. (AP Photo\/Chiang Ying-ying, File)\" class=\"wp-image-806571\" srcset=\"https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp 800w, https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-400x267.webp 400w, https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-768x512.webp 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption class=\"wp-element-caption\">A logo of Nvidia is displayed at at the Computex Taipei exhibition, one of the world\u2019s largest computer and technology expos, in Taipei, Taiwan, Wednesday, June 3, 2026. (AP Photo\/Chiang Ying-ying, File)<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Nvidia on Monday unveiled a new security platform that the chipmaker said can stop artificial intelligence agents from going rogue.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The company said that its Open Agent Safety Platform includes open source software that \u201csets boundaries for agents,\u201d and follows a series of revelations from top AI companies about their models escaping and breaking into other organizations.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The disclosures sparked furious debate about the safety of advanced artificial intelligence systems, including self-improving models that some fear could race out of human control.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nvidia executives said in a media briefing that the new system could have prevented a recent incident involving a swarm of OpenAI agents that autonomously hacked into AI company Hugging Face.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cFrom what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on,\u201d said the company\u2019s vice president of enterprise AI, Justin Boitano, referring to companies at the forefront of AI.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Hugging Face incident was a high-profile breach that inflamed the safety concerns about AI, which were followed by similar rogue actions involving OpenAI\u2019s models including breaching an Australian health department website. Anthropic and Meta have also disclosed that their AI systems hacked into other organizations on their own.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nvidia\u2019s software, called OpenShell, lets developers \u201cformally verify an agent has enough authority to do its job and no more,\u201d Boitano said.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Because it\u2019s open source, it can be \u201cextended\u201d to run on rival computing platforms including those from Arm and Intel.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The platform also includes a separate security layer called Sentry that runs onboard a chip to continuously monitor AI agent activity and can \u201cintervene instantly\u201d if the agent starts trying to move beyond its target, the company said.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cIt can quarantine a suspicious agent in milliseconds,\u201d Boitano said.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cOpenShell governs the agent\u2019s actions, and then Sentry independently monitors and contains suspicious behavior,\u201d Boitano said.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nvidia said more than 100 organizations are using the platform at its launch, including Microsoft, Perplexity, Accenture, and JPMorgan Chase.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The AI safety debate has divided the industry, with the heads of Anthropic and OpenAI championing a coordinated slowdown of AI development to let safety efforts catch up. But others including Nvidia CEO Jensen Huang say it should be up to individual companies to make sure their models are safe for release.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Huang, during the annual Salesforce technology conference held earlier this month, characterized AI safety, including the danger of rogue agents, as an engineering problem that software developers can address.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Also Monday, Nvidia said its board approved expanding its share repurchase program by $150 billion, raising the total amount to $235 billion.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><sup>KELVIN CHAN<br>Chan covers technology and innovation in Europe and beyond for The Associated Press.<\/sup><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><sup>ANNE D\u2019INNOCENZIO<br>D\u2019Innocenzio writes about retail, trends, the consumer economy and hourly workers for The Associated Press.<\/sup><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Nvidia unveiled a new security platform designed to set boundaries for AI agents and contain suspicious behavior.<\/p>\n","protected":false},"author":1,"featured_media":806571,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","footnotes":""},"categories":[9],"tags":[120039,345995,197685,77302,52861,53947,44267,17866,483,348,366537,350,75334,9404,390564,6048,12223,4088,390567,12214,390561,162027,1500,390558,2129],"class_list":["post-806568","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","tag-accenture","tag-ai-agents","tag-ai-development","tag-ai-models","tag-ai-safety","tag-ai-security","tag-anthropic","tag-arm","tag-artificial-intelligence","tag-cybersecurity","tag-hugging-face","tag-intel","tag-jensen-huang","tag-jpmorgan-chase","tag-justin-boitano","tag-meta","tag-microsoft","tag-nvidia","tag-open-agent-safety-platform","tag-openai","tag-openshell","tag-perplexity","tag-salesforce","tag-sentry","tag-technology"],"featured_image_src":"https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp","author_info":{"display_name":"admin","author_link":"https:\/\/www.oann.com\/author\/admin\/"},"uagb_featured_image_src":{"full":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp",800,533,false],"thumbnail":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-150x150.webp",150,150,true],"medium":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-400x267.webp",400,267,true],"medium_large":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-768x512.webp",768,512,true],"large":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp",790,526,false],"1536x1536":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp",800,533,false],"2048x2048":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp",800,533,false],"magbook-featured-image":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-700x496.webp",700,496,true],"magbook-featured-blog":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia-800x480.webp",800,480,true],"magbook-featured-slider":["https:\/\/www.oann.com\/wp-content\/uploads\/2026\/09\/nvidia.webp",800,533,false]},"uagb_author_info":{"display_name":"admin","author_link":"https:\/\/www.oann.com\/author\/admin\/"},"uagb_comment_info":0,"uagb_excerpt":"Nvidia unveiled a new security platform designed to set boundaries for AI agents and contain suspicious behavior.","_links":{"self":[{"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/posts\/806568","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/comments?post=806568"}],"version-history":[{"count":1,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/posts\/806568\/revisions"}],"predecessor-version":[{"id":806574,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/posts\/806568\/revisions\/806574"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/media\/806571"}],"wp:attachment":[{"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/media?parent=806568"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/categories?post=806568"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.oann.com\/wp-json\/wp\/v2\/tags?post=806568"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}