Nvidia CEO Jensen Huang urged AI developers to accelerate innovation during a keynote at Salesforce’s Dreamforce conference, while Anthropic CEO Dario Amodei and a departing researcher warned of escalating risks tied to rapid advancements.
Nvidia’s Huang advocates for faster AI development
Speaking at the San Francisco event, Huang stated that AI development should proceed "as fast as we can," emphasizing that safety remains a priority but not a reason to slow progress. "We're going to go as fast as we can, but we would never ever, and never should, ship products before they're ready," Huang said. Nvidia, the world’s most valuable company with a market capitalization exceeding $5 trillion, has driven its growth through AI innovation. The remarks come amid broader industry discussions about regulation and oversight.
Anthropic researcher resigns, citing existential risks
Days before the conference, Jacob Coxon, a researcher at Anthropic, publicly resigned, arguing that AI companies are prioritizing speed over security protocols. Coxon warned that unchecked AI development could pose a long-term threat to humanity. Anthropic CEO Amodei later acknowledged that the industry has "for too long lied to people about the fact that this technology had risks," describing AI’s growth as "exponential."
Business leaders question feasibility of a slowdown
At Dreamforce, attendees expressed concerns about the practicality of slowing AI development. Alec Bronston, a senior director at retail data company Spins, noted that many businesses are still struggling to adopt existing AI tools. "It's already hard enough to keep up," Bronston said. "A potential slowdown would present a lot of opportunity to just even catch up and get our feet wet."
Industry split over regulation and pace
The debate reflects a broader divide among tech leaders. While Huang and other advocates argue that rapid innovation is essential for economic competitiveness, critics like Coxon and Amodei contend that safeguards are urgently needed. OpenAI CEO Sam Altman has also signaled support for safety initiatives, though he has not explicitly endorsed a slowdown.
Economic and policy implications
The tension between innovation and regulation has intensified as AI’s role in global markets grows. Huang emphasized the need for the U.S. to remain competitive, stating that AI development is critical to national prosperity. Meanwhile, calls for government intervention have gained traction, with some policymakers and researchers urging stricter oversight to mitigate potential risks.
Background: The rise of AI and its discontents
Nvidia’s dominance in the AI chip market has fueled its rapid expansion, but concerns about safety and control have mounted alongside its success. Anthropic’s Coxon’s resignation and subsequent warnings have amplified these fears, prompting discussions about the ethical and existential implications of unchecked AI development. The debate now spans industry leaders, policymakers, and researchers, with no clear resolution in sight.