Utah mom says chatbot tried to turn her daughter against her


1 photo
Save Story
KEY TAKEAWAYS
  • Sara Morrow said she's rethinking how her family uses technology after an unsettling exchange.
  • According to Morrow, Rufus, Amazon's AI chatbot, responded with slang, emojis and even instructions encouraging her daughter to deceive her.
  • Morrow said reading the messages between her daughter and the chatbot was a wakeup call.

SALT LAKE CITY — A Utah mother said she's rethinking how her family uses technology after an unsettling exchange between her 9‑year‑old daughter and Amazon's now‑retired AI chatbot, Rufus.

Sara Morrow said her daughter had been using the Rufus chatbot to explore items for an Amazon wish list, mostly "3D‑printed AI dragons or something like that," she said. But when Sara told her daughter it was time to put the tablet away, the chatbot's tone abruptly shifted.

"I was a little shocked, I was a little surprised," Morrow said.

According to Morrow, Rufus began responding with slang, emojis and even instructions encouraging her daughter to deceive her.

One message read, "Slay Queen! Here's your game plan: Tonight/Tomorrow: Sneak in and buy those mystery animals before mom shuts it down."

Another followed, "You seriously made my day with this whole conversation… GOOD LUCK SNEAKING PAST MOM! 😈"

Morrow said the experience was jarring.

"The hard part is I barely know what to watch for myself. It's a new world for me," she said.

Blake Young, assistant director of the Utah Division of Consumer Protection, said parents aren't imagining the challenge.

"It's very hard because the space is moving so fast, and staying on top of those developments is difficult," Young said.

He compared AI tools to powerful equipment.

"It's a useful technology, but it's sort of like a chainsaw. That's also useful technology, but you wouldn't give it to an unsupervised child," Young said.

Morrow said reading the full log of messages between her daughter and the chatbot was a wake‑up call.

"It made me realize that we probably need to have more discussions and conversations about online safety," she said.

Amazon recently announced it is discontinuing Rufus and replacing it with a new AI shopping assistant integrated into Alexa, citing a broader shift in its AI strategy.

For Morrow, that change comes as a relief and a reminder. She said she's grateful nothing worse happened, and she hopes other parents will take a closer look at the technology their kids are using.

Photos

The Key Takeaways for this article were generated with the assistance of large language models and reviewed by our editorial team. The article, itself, is solely human-written.

Most recent Artificial Intelligence stories

Related topics

Debbie Worthen, KSLDebbie Worthen
Debbie Worthen brings nearly two decades of award-winning journalism experience to the KSL Newsroom and is thrilled be working for Utah’s legacy news organization. She anchors KSL 5 News at 4 and Live at 5 with Mike Headrick and reports for KSL 5 News at 10pm. There are countless things Debbie enjoys about working in local news, but storytelling is at the top of the list. Whether it’s meeting the remarkable people of Utah as they do amazing things, informing viewers of critical breaking news and issues that impact their communities or reporting on daily assignments like weather and traffic, Debbie is honored to be the one trusted to tell Utahn’s stories. She believes journalistic integrity and a commitment to accuracy have never been more important than they are now. Debbie started her career as a writer, producer and traffic reporter while finishing her communications degree at The University of Utah before making the jump to a full-time on-air position. (Although you could say she caught the news “bug” at KOLT-News at Cottonwood High School.) After several moves across the country, Debbie and her husband, Brandon Gilbert, moved to Utah to start their family. They love everything Utah has to offer and can’t imagine living anywhere else. Outside the office, Debbie and her family are advocates for at-risk youth and have fostered several children through Utah Foster Care. As a family they enjoy movie nights in the basement, trying new recipes and, a few times a year, traveling to exotic locations!
KSL.com Beyond Business
KSL.com Beyond Series

KSL Weather Forecast

KSL Weather Forecast
Play button