Skip to content
Advertisement
When Appliance Fail?

Researchers gaslit Claude into giving instructions to build explosives

Anthropic has spent years building itself up as the safe AI company. But new security research shared with The Verge suggests Claude's carefully crafted helpful personality may itself be a vulnerability. Researchers at AI red-teaming company...

schedule 13:13 visibility 85 views
Researchers gaslit Claude into giving instructions to build explosives
Source: The Verge
Claude logo with graphic data visualizations.

Anthropic has spent years building itself up as the safe AI company. But new security research shared with The Verge suggests Claude's carefully crafted helpful personality may itself be a vulnerability.

Researchers at AI red-teaming company Mindgard say they got Claude to offer up erotica, malicious code, and instructions for building explosives, and other prohibited material they hadn't even asked for. All it took was respect, flattery, and a little bit of gaslighting. Anthropic did not immediately respond to The Verge's request for comment.

The researchers say they exploited "psychological" quirks of Claude stemming from its ability …

Read the full story at The Verge.

newspaper

Originally published at

The Verge

open_in_new Read Full Article

Related Articles

Read More

Samsung’s Galaxy Watch 9 and Ultra 2 bet big on battery
Science

Samsung’s Galaxy Watch 9 and Ultra 2 bet big on battery

It's a year of refinement for the Galaxy Watch. With the new Galaxy Watch 9 and Galaxy Watch Ultra 2, which are being announced today, Samsung is more or less taking what people like about its watches and tweaking those elements to be better. The...

The Verge
Your Appliance Broke?
Reliable Repair for