At his annual Dreamforce summit in San Francisco, Salesforce CEO Marc Benioff invoked the cautionary arc of social media to warn the AI industry that power without accountability tends to leave wreckage behind. Drawing on his own history of calling out Facebook's harms, Benioff urged the builders of ChatGPT, Claude, and their successors to treat ethics not as an afterthought but as a structural commitment. The moment carries weight: Anthropic's Dario Amodei stood beside him on stage, and Salesforce itself has already woven Claude into its enterprise platform, making the call to responsibility
Benioff warns AI industry: don't repeat social media's mistakes
The heart of ethics is responsibility.
Mark
So Benioff is drawing a direct line from Facebook to AI. Is he saying AI will definitely cause the same kind of harm?
Mimi
Not exactly. He's saying it could, if companies don't make different choices. He's not predicting doom—he's warning that the conditions are similar, and the outcome depends on whether the industry learns from what happened with social media.
Luke
But here's what I notice: Benioff didn't actually specify what harms he's worried about. Social media's problems were concrete—algorithmic amplification of divisive content, mental health impacts, misinformation spread. What's the equivalent risk with AI that he's naming?
Mimi
That's fair. He keeps it at the level of principle—responsibility, ethics, considering wider effects. He doesn't drill down into specific failure modes.
Mark
Amodei called for slowing down development. Benioff didn't. Is that a disagreement?
Mimi
Not necessarily. Benioff said companies need to be responsible; he didn't say how. Slowing down is one approach. Building safety into the process from the start is another. They might both be saying the same thing in different languages.
Luke
Though "slow down" is concrete and measurable. "Be responsible" is not. And Benioff has a business interest here—Salesforce just launched a product that integrates Claude. Calling for a slowdown would hurt his own company.
Mark
So is his warning credible, or is it just good PR?
Mimi
It can be both. The warning might be genuine and also serve his business interests. Those aren't mutually exclusive. What matters is whether Salesforce actually builds safeguards into Claudeforce and holds itself accountable.
Luke
Which we don't yet know.
Il Polso
- Benioff is raising an alarm he has raised before — and the fact that he must raise it again is itself the warning.
- The AI industry is scaling into businesses and daily life faster than any ethical consensus has formed around it, creating the same conditions that allowed social media's harms to compound unchecked.
- Anthropic's CEO Dario Amodei, whose company has already called for frontier labs to slow down so safety can catch up, appeared at Dreamforce to amplify the message that a different path is still available.
- Salesforce is not a neutral observer — its newly launched Claudeforce tool embeds Anthropic's AI directly into enterprise workflows used by thousands of organizations, raising the stakes of its own stated principles.
- The industry is arriving at a choice point: absorb social media's lessons now, or rediscover them later through damage already done.
At his annual Dreamforce summit in San Francisco, Salesforce CEO Marc Benioff invoked the cautionary arc of social media to warn the AI industry that power without accountability tends to leave wreckage behind. Drawing on his own history of calling out Facebook's harms, Benioff urged the builders of ChatGPT, Claude, and their successors to treat ethics not as an afterthought but as a structural commitment. The moment carries weight: Anthropic's Dario Amodei stood beside him on stage, and Salesforce itself has already woven Claude into its enterprise platform, making the call to responsibility as much a personal reckoning as a public one.
Marc Benioff has sounded this kind of alarm before. Eight years ago he called Facebook "the new cigarettes," warning that a technology promising connection was delivering harm at scale. Now, at Dreamforce in San Francisco, he is making a nearly identical case about artificial intelligence.
As tools like ChatGPT and Claude spread through business and daily life, Benioff sees the industry at a crossroads. Companies can learn from social media's broken trust and unintended consequences — or they can repeat them. Speaking during a Mad Money interview at the summit, he was direct: "A lot of companies got hurt, a lot of individuals got hurt through social media. We don't want that to happen in AI."
His argument centers on responsibility as a structural choice, not a regulatory one. He called for no slowdown, named no villains. Instead he framed ethics as something that must be deliberately built into these systems from the start. "The heart of ethics is responsibility," he said, extending the appeal to the broader tech world.
The timing amplifies the message. Anthropic CEO Dario Amodei — who recently urged frontier AI labs to deliberately slow development so safety measures can catch up — appeared on stage during Benioff's keynote, lending the moment unusual weight. "I think that's the way to lead the industry forward," Amodei said, "to set an example."
Salesforce itself is deeply inside this ecosystem. The company recently launched Claudeforce, integrating Anthropic's Claude into its platform so enterprise customers can draft emails, update records, and manage data using AI. The partnership makes Benioff's call to ethics something his own company must now live out — at scale, across thousands of organizations, with the full force of social media's cautionary history in view.
Marc Benioff has been here before. Eight years ago, the Salesforce chief executive stood up and called Facebook "the new cigarettes"—a warning about a technology that had promised connection but delivered harm at scale. Now, at his company's annual Dreamforce summit in San Francisco, he is sounding a nearly identical alarm about artificial intelligence.
The concern is straightforward, if weighty. As AI tools like ChatGPT and Claude proliferate through business and daily life, Benioff sees the industry at a crossroads. Companies can either learn from social media's trajectory—the broken trust, the unintended consequences, the damage to individuals and institutions—or they can repeat it. "A lot of companies got hurt, a lot of individuals got hurt through social media," he told Jim Cramer during a Mad Money interview at the summit. "We don't want that to happen in AI."
Benioff's framing centers on responsibility rather than restriction. He did not call for a slowdown in AI development, nor did he name specific companies as culprits. Instead, he positioned ethics as a structural choice—something that requires deliberate action from the people building these systems. "We want AI to take care of these things and be held responsible, and take care of these actions and be ethical," he said. "The heart of ethics is responsibility." He extended that logic outward, addressing the broader tech industry: "We really look at a light on our brethren here in San Francisco and all over the world and say, 'We want you to be ethical in your actions and how you take care of your communities and the world,' because this technology is very powerful."
The timing of his remarks is significant. The AI safety debate has intensified in recent weeks. Last week, Dario Amodei, the CEO of Anthropic—the company behind Claude—called on frontier AI labs to deliberately reduce their development pace so that safety measures can catch up. That same Amodei appeared on stage during Benioff's keynote on Tuesday, reinforcing the message that the industry can choose a different path. "I think that's the way to lead the industry forward, to set an example, to say that everyone can always be better," Amodei said.
Salesforce itself is not standing apart from this ecosystem. The company announced Claudeforce last month, a tool that integrates Anthropic's Claude directly into Salesforce's platform. Customers can now use Claude to draft emails, update records, and perform other tasks with their stored data. The partnership illustrates how deeply AI has already woven itself into enterprise software—and how companies like Salesforce must now navigate the responsibility that comes with distributing these capabilities to thousands of organizations.
What Benioff is articulating, in effect, is a choice point. The technology is powerful. It will scale. The question is whether the companies building and deploying it will do so with the weight of social media's lessons in mind, or whether they will discover those lessons again, the hard way, after the damage is done.
Citazioni salienti
A lot of companies got hurt, a lot of individuals got hurt through social media. We don't want that to happen in AI.— Marc Benioff, Salesforce CEO
The heart of ethics is responsibility.— Marc Benioff
Vuoi la storia completa?
Leggi l'originale su Times of India ↗
Technology