All eyes are on California Governor Gavin Newsom after the California Senate passed Senate Bill 1047 (SB 1047), a landmark bill aimed at regulating the use and development of advanced artificial intelligence (AI) systems. Introduced by Senator Scott Wiener, the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act is designed to impose strict safety and security protocols on developers of powerful AI models, particularly those that could pose critical risks to public safety.
The bill reflects California’s proactive approach to managing the potential dangers associated with AI technology. The legislation specifically targets developers of AI systems that require substantial computational resources, defined as models costing over $100 million to train. These systems are subject to rigorous testing for safety, cybersecurity protections, and regular audits by third-party experts. The bill also requires developers to create a comprehensive safety and security protocol that must be shared with the California Attorney General, ensuring transparency and accountability in the development process.
Senator Wiener emphasized the importance of balancing innovation with public safety, noting that while AI holds immense promise, the risks associated with its misuse are equally significant. “Innovation and safety can go hand in hand—and California is leading the way,” said Wiener. “The Legislature has taken the truly historic step of working proactively to ensure an exciting new technology protects the public interest as it advances.”
The bill has garnered widespread support from key figures in the AI community, including Geoffrey Hinton and Yoshua Bengio, two of the most cited AI researchers globally. Hinton, often referred to as one of the “Godfathers of AI,” praised the legislation for its sensible approach to addressing the real risks posed by advanced AI systems. He highlighted the importance of having legislation with “real teeth” to prevent potential harms while still allowing AI to advance in beneficial ways, such as in science and medicine.
SB 1047 also introduces the establishment of CalCompute, a public cloud computing cluster that will support startups, researchers, and community groups in developing AI systems responsibly. This initiative aims to democratize access to the computational resources necessary for AI development, ensuring that innovation is not limited to large corporations but is accessible to a broader range of stakeholders. The bill also includes provisions for whistleblower protections, enabling employees within AI labs to report safety concerns without fear of retaliation.
Despite the broad support, the bill has faced criticism from some quarters. Speaking on KQED’s Forum, former Speaker of the House Nancy Pelosi criticized the bill, arguing that it does not fully address the complexities of AI regulation. “California is the home, the birthplace of AI. In our view. It has the knowledge, the technological knowledge, it has the entrepreneurship, and it has the responsibility to do the right thing, not to pass a bill that does not do the job because it is as well-intentioned as it is ill-informed,” Pelosi stated. Her comments underscore the ongoing debate about the best approach to regulating AI, with some experts calling for more nuanced legislation that fully captures the rapid advancements in the field.
Support for SB 1047 extends beyond the AI research community, with public polling showing overwhelming bipartisan support for the bill. Tech workers, in particular, have expressed strong backing for the legislation, recognizing the need for robust safety measures in the rapidly evolving AI landscape. Nathan Calvin, Senior Policy Counsel at CAIS Action Fund, noted that the bill is a critical step toward ensuring that AI development is both safe and innovative. “The vast majority of Californians support this bill and it’s great to see lawmakers agree. By putting in place safety testing requirements and guardrails, SB 1047 would drive both safety and innovation at the frontier of generative AI,” Calvin said.
Governor Newsom has until September 30 to sign SB 1047 into law, or veto it.
Need Help?
If you’re wondering how California’s AI bill, or any other AI regulations and laws around the world, could impact you and your business, don’t hesitate to reach out to BABL AI. Their Audit Experts can answer your concerns and questions while offering valuable insight.
