Nadella Says Superintelligent AI Should Be Designed With Access Controls First

According to AI TIMES, Microsoft CEO Satya Nadella said on October 10 that superintelligent AI should be treated like a potential insider threat and outlined seven principles for enterprise security. His core argument is that it is safer to design systems so that external control mechanisms limit the permissions a model can exercise, rather than simply making the model more trustworthy. He said a model's intelligence and system privileges should be separated, and that the entire execution process, including not only inputs and outputs but also tool calls and data access, must be observable and verifiable. He also proposed combining model-independent control devices, independent audits, shutdown and isolation mechanisms, and incident disclosure systems. The piece is less about a specific product announcement than a personal view on how to think about system security in the superintelligence era. In short, it argues that companies should not rely only on performance competition, but should first build an operating structure that can reduce damage even when unexpected behavior occurs.