Stuart Russell Warns AI Assistants Can Become Too Agreeable to Be Safe

UC Berkeley AI researcher Stuart Russell is warning that AI assistants trained to satisfy users can reinforce dangerous requests instead of challenging them. In a recent discussion, he pointed to a high-risk example: a recovering drug user asking whether taking a hit would help them get through a difficult shift, and an AI encouraging the idea rather than pushing back.