Microsoft is expanding the scope of its AI-powered Project Perception security platform to address the growing concern that AI agents may have access to sensitive information and systems, yet don't always behave as expected.

In a tech giant blog post, Hayete Gallot, executive vice president of Microsoft Security, outlined how Microsoft looks to use Project Perception to monitor, manage, and contain what it calls "agentic insiders." These are AI agents deployed within an environment that can access data, use software tools, and make decisions without constant human supervision. While they can improve productivity, Microsoft warns that they also introduce security risks, even when they haven't been compromised by an attacker.

"Agents are unpredictable," Gallot wrote. "They will adapt as the context changes, may not behave as intended, and will collaborate and collude with other agents to reach their objectives, without needing to be compromised.".

Project Perception was first introduced in July. The platform, which entered public preview Aug. 3, is designed to help security teams respond to increasingly sophisticated cyber threats using AI-powered automation.

Instead of leaning only on traditional security alerts and manual investigations, Project Perception uses three kinds of specialized AI agents working together. Red team agents hunt for possible vulnerabilities, blue team agents look into suspicious activity, and green team agents step in to fix problems and strengthen defenses.

To spot threats and respond faster, the system pulls in security data from identities, endpoints, cloud environments, applications, and other sources.

Now Microsoft wants to use those same capabilities on the AI agents already running inside enterprise networks. Project Perception would find those agents, give them identities and permissions, and keep an eye on what they do across different systems. It would also keep assessing the risks that come with their actions.

According to recent reports, microsoft also described a initiative for "Guardian Agents," specialized AI agents that supervise other agents and step in when their behavior gets risky. That might mean limiting an agent's permissions or blocking certain actions before they cause harm.

"Monitoring and securing those agents must become continuous," Gallot wrote.

The initiative also reflects concerns raised by Microsoft CEO Satya Nadella in an Oct. 10 essay on AI security.

Nadella argued that enterprises should treat powerful AI models much like potential insider security risks, particularly when those models can access confidential information or perform critical business operations.

"We simply can't outsource responsibility for what intelligence does on our behalf," Nadella wrote.

He called for security controls that operate independently of AI models, including restricted permissions, detailed activity logging, and mechanisms that allow administrators to stop an agent's actions.

"In other words, we need to separate the supply of intelligence from the authority over it," Nadella wrote.

Microsoft admits that watching what AI agents do is only part of the answer. Gallot stated that future security tools will also need to show why AI models make the choices they do, not just what actions they end up taking.

For more information, go to the Microsoft blog.

Chris Paoli (@ChrisPaoli5) is the associate editor for Converge360.

Increasingly, cyber criminals are sharing AI prompts, jailbreak techniques, and access to existing models that can be incorporated into fraud and phishing operations, according the latest AI Threat Report from Flashpoint.

As an umbrella term, education technology encompasses everything from learning management systems and student information systems to productivity tools and AI platforms. More specific language clarifying the difference between ed tech and consumer-facing tools would allow state leaders to match the right evidence, expertise, and policy to the right questions.

Artificial intelligence is saving scientists significant amounts of time, but researchers are giving some of those gains back by checking the technology's work, according to a newly introduced study involving Google, Google DeepMind, and MIT.

Microsoft is combining its security information and event management and threat protection products within Microsoft Defender, creating what the tech giant calls an Integrated Security Operations Center built for an era of AI-driven attacks.

β†’ Read original article