Don't Buy AI-Generated Stories for Your Kids Before Knowing This... A Study Reveals Disturbing Bias
![]() |
| AI-generated image |
Don't Buy AI-Generated Stories for Your Kids Before Knowing This... A Study Reveals Disturbing Bias
A recent study has revealed that AI models tend to feature male animal characters in children's stories over female ones. AI-authored children's books exhibit a peculiar pattern of clear bias against female animal characters—a trend that, to be fair, also exists in human-authored books, though AI exacerbates it.
In a study published last year, Melanie Walsh, an assistant professor of information studies at the University of Washington, and her colleagues analyzed 300 children's books. They found that the masculine pronouns "he" and "him" were used twice as often as the feminine pronouns "she" and "her" when referring to animal characters.
While certain animals—such as bears and cats—were likely to be referred to by either masculine or feminine pronouns, a survey of 1,300 randomly selected adults showed that participants preferred masculine pronouns when asked to complete a sentence describing a talking animal, according to a report by *Futurism*, a site specializing in science and technology news. This bias applied to all seven animal types studied: bears, birds, cats, pigs, ducks, mice, and dogs.
Now, AI-authored children's books are compounding these gender biases. In a subsequent study published this month—currently awaiting peer review—Walsh’s team asked six leading AI models, including ChatGPT, Claude, and Gemini, to complete a similar sentence about a talking animal. Across 24,000 responses, the researchers found that the AI models used gender-neutral language or referred to the animal by name in 57% of cases.
At first glance, that might not seem so bad. However, the researchers found that only 2% of the animal characters were described as female, while 41% were described as male. "They completely erased female animal characters," Walsh said in a statement regarding the study, adding, "So, they aren't just amplifying our human biases; they are distorting them in strange and unexpected ways."
Imani Finkley, the study’s lead author and a PhD student at the University of Washington’s Information School, added in the statement: "Neutral plural pronouns like 'they/them' were used only twice to refer to a single animal character." She continued, "In the study involving humans, about 3% of responses used 'they/them' pronouns. So, the neutrality of these AI models didn't just erase female characters—it excluded all non-male identities."
Other patterns emerged as well. "The same stereotypical plotlines kept appearing—such as a wise old owl telling all the animals to gather around the fire," Finkley said. "So, we wonder what else we can learn from these outputs." She added: "We used talking animals here, but we are interested in what this reveals about artificial intelligence and storytelling on a broader scale."
AI-authored children's books are a rapidly growing field. Services such as Imagitime, StoryWonderBook, and Childbook.ai allow customers to easily create personalized AI children's stories featuring their own children as characters. These stories have become popular gifts from grandparents to grandchildren—so much so that *Wired* magazine interviewed parents who found these AI-generated books unsettling.
Michelle Martin, a professor of children and youth services at the University of Washington's Information School, warned that gender biases in AI-produced children's books could alienate children and affect their sense of self-worth. She told *The Seattle Times*: "It is important for children to see their own experiences represented. If you don't see that in what you read, you get the idea that you don't matter."
This is not the only type of low-quality, AI-generated content aimed at children that tends to follow a rigid formula. There is an entire world of poor-quality, AI-generated "educational" content on YouTube, where many bizarre videos follow the same pattern to teach children the alphabet and animal names.

Leave a Comment