Gov. Gavin Newsom has adopting artificial intelligence oversight regulations that could require developers to build emergency shutoffs for AI systems.
Read more North Carolina man dies in training accident at Fort Hood, Texas, US Army says
On Friday, Newsom issued an executive order requiring the Government Operations Agency and the Office of Emergency Services to convene experts to create an AI safety guide by Nov. 16.
The order also accelerates the timeline for implementing two recent laws from Assemblymember Rebecca Bauer-Kahan, D-Orinda, and Sen. Jerry McNerney, D-Pleasanton, regulating how outside auditors oversee AI safety.
Under the order, GovOps would be required to create third-party safety criteria for AI developers by May 2027 and implement them by December 2027. Newsom said the accelerated timeline was in the absence of any federal oversight.
“The federal government’s abject failure to create any form of meaningful AI oversight or accountability should alarm every American, especially when AI CEOs themselves are begging for regulation,” Newsom said, referencing recent incidents like OpenAI agents’ hack of rival company Hugging Face. “We’re not waiting to act — we’re going to speed up our work on substantial and responsible AI oversight before it’s too late. We’re going to do this thoughtfully but with urgent velocity; the stakes are too high to wait or delay action.”
Public concern over AI has reached a fever pitch in recent weeks after an Anthropic researcher publicly resigned, claiming neither that company nor rival OpenAI were taking seriously the technology’s threat to humanity.
Democrats have seized upon AI safety to boost their chances of retaking congressional control in the midterms. President Donald Trump has dismissed alarms as a “hoax.”
Read more Driver arrested in 2025 hit-and-run that killed 80-year-old Elk Grove woman
Industry executives like xAI’s Elon Musk, OpenAI’s Sam Altman and Nvidia’s Jensen Huang have publicly called for more guardrails while privately trying to persuade the White House to take a light approach to regulation.
Newsom is expected to discuss his executive order in an episode of his podcast that will air later Friday. In a video teaser, he called upon Congress to adopt a version of his executive order.
“(House Speaker) Mike Johnson should return from vacation and follow California’s lead by passing national legislation,” Newsom said. “If Congress won’t act, California will.”
Under his executive order, GovOps and OES will convene experts to offer recommendations by Nov. 16 to strengthen existing state AI rules.
Newsom said forthcoming proposals could include requiring companies to include hacks like the Hugging Face episode in existing critical safety incident reports, adopting a “kill switch” emergency shutoff system for AI models and embedding designated independent verification organizations onsite in their labs to regularly audit and evaluate AI systems.
Read more As Sacramento home tour features Dorothea Puente house, a forgotten lie comes to light
