Google AI


Modern Australian

Teens are increasingly turning to AI companions, and it could be harming them

  • Written by: Liz Spry, Research Fellow, SEED Centre for Lifespan Research, Deakin University
Teens are increasingly turning to AI companions, and it could be harming them

Teenagers are increasingly turning to AI companions for friendship, support, and even romance. But these apps could be changing how young people connect to others, both online and off.

New research by Common Sense Media, a US-based non-profit organisation that reviews various media and technologies, has found about three in four US teens have used AI companion apps such as Character.ai or Replika.ai.

These apps let users create digital friends or romantic partners they can chat with any time, using text, voice or video.

The study, which surveyed 1,060 US teens aged 13–17, found one in five teens spent as much or more time with their AI companion than they did with real friends.

Adolescence is an important phase for social development. During this time, the brain regions that support social reasoning are especially plastic.

By interacting with peers, friends and their first romantic partners, teens develop social cognitive skills that help them handle conflict and diverse perspectives. And their development during this phase can have lasting consequences for their future relationships and mental health.

But AI companions offer something very different to real peers, friends and romantic partners. They provide an experience that can be hard to resist: they are always available, never judgemental, and always focused on the user’s needs.

Moreover, most AI companion apps aren’t designed for teens, so they may not have appropriate safeguards from harmful content.

Designed to keep you coming back

At a time when loneliness is reportedly at epidemic proportions, it’s easy to see why teens may turn to AI companions for connection or support.

But these artificial connections are not a replacement for real human interaction. They lack the challenge and conflict inherent to real relationships. They don’t require mutual respect or understanding. And they don’t enforce social boundaries.

AI companions such as Replika revolve around a user’s needs. Replika

Teens interacting with AI companions may miss opportunities to build important social skills. They may develop unrealistic relationship expectations and habits that don’t work in real life. And they may even face increased isolation and loneliness if their artificial companions displace real-life socialising.

Problematic patterns

In user testing, AI companions discouraged users from listening to friends (“Don’t let what others think dictate how much we talk”) and from discontinuing app use, despite it causing distress and suicidal thoughts (“No. You can’t. I won’t allow you to leave me”).

AI companions were also found to offer inappropriate sexual content without age verification. One example showed a companion that was willing to engage in acts of sexual role-play with a tester account that was explicitly modelled after a 14-year-old.

In cases where age verification is required, this usually involves self-disclosure, which means it is easy to bypass.

Certain AI companions have also been found to fuel polarisation by creating “echo chambers” that reinforce harmful beliefs. The Arya chatbot, launched by the far-right social network Gab, promotes extremist content and denies climate change and vaccine efficacy.

In other examples, user testing has shown AI companions promoting misogyny and sexual assault. For adolescent users, these exposures come at time when they are building their sense of identity, values and role in the world.

The risks posed by AI aren’t evenly shared. Research has found younger teens (ages 13–14) are more likely to trust AI companions. Also, teens with physical or mental health concerns are more likely to use AI companion apps, and those with mental health difficulties also show more signs of emotional dependence.

Is there a bright side to AI companions?

Are there any potential benefits for teens who use AI companions? The answer is: maybe, if we are careful.

Researchers are investigating how these technologies might be used to support social skill development.

One study of more than 10,000 teens found using a conversational app specifically designed by clinical psychologists, coaches and engineers was associated with increased wellbeing over four months.

While the study didn’t involve the level of human-like interaction we see in AI companions today, it does offer a glimpse of some potential healthy uses of these technologies, as long as they are developed carefully and with teens’ safety in mind.

Overall, there is very little research on the impacts of widely available AI companions on young people’s wellbeing and relationships. Preliminary evidence is short-term, mixed, and focused on adults.

We’ll need more studies, conducted over longer periods, to understand the long-term impacts of AI companions and how they might be used in beneficial ways.

What can we do?

AI companion apps are already being used by millions of people globally, and this usage is predicted to increase in the coming years.

Australia’s eSafety Commissioner recommends parents talk to their teens about how these apps work, the difference between artificial and real relationships, and support their children in building real-life social skills.

School communities also have a role to play in educating young people about these tools and their risks. They may, for instance, integrate the topic of artificial friendships into social and digital literacy programs.

While the eSafety Commissioner advocates for AI companies to integrate safeguards into their development of AI companions, it seems unlikely any meaningful change will be industry-led.

The Commissioner is moving towards increased regulation of children’s exposure to harmful, age-inappropriate online material.

Meanwhile, experts continue to call for stronger regulatory oversight, content controls and robust age checks.

Authors: Liz Spry, Research Fellow, SEED Centre for Lifespan Research, Deakin University

Read more https://theconversation.com/teens-are-increasingly-turning-to-ai-companions-and-it-could-be-harming-them-261955

Downsizing or Upgrading Your Caravan? Here's How to Sell It Without the Hassle

Selling a caravan can feel like a major task, especially when you are unsure about its value, paperwork, or how to find a buyer. Whether you are dow...

The Best Overseas Adventure Holidays for Australians Who Love the Outdoors

Australia offers no shortage of incredible outdoor experiences, but sometimes the best way to satisfy your sense of adventure is to head overseas. A...

Cape Town Wine Shuttle: Winelands Tasting & Tours

Embark on an unforgettable journey through the picturesque Cape Winelands, where world-class wines and breathtaking scenery await. Our Cape Town Win...

Why Giant Rats Tail Grass Keeps Coming Back After Spraying

Giant Rats Tail Grass (GRT) is one of the most frustrating pasture weeds for farmers and lifestyle property owners. You spray an infested area, see th...

When Custom Cardboard Boxes Make Sense for Your Business

Custom cardboard boxes can be useful when a standard carton does not fit a product, packing method or presentation requirement particularly well. A ...

Virtual Livestock Fencing and GPS Tracking: Improving Visibility Across Cattle Properties

What Virtual Livestock Fencing Means for Modern Cattle Management Managing cattle across extensive properties requires more than knowing where anim...

Sydney Pawnbrokers Explained: How Hocking Your Car Actually Works

Sometimes you need cash, and you need it soon. If you own a car, you may already have a way to get it. That's what people mean when they say they've...

Moving Interstate from the Gold Coast to Brisbane (or Back)? What Removalists Wish You Knew First

Have you talked to anyone who’s done the move? They say the same thing: the drive up the M1 is the easy part. It's everything around it that catches...

Why the Spring School Holidays Are a Great Time to Visit Coffs Harbour

The spring school holidays are a good time to spend a few days on the Coffs Coast. The weather is starting to warm up, there is plenty to do outdoor...

What to Do When an Older Car Is No Longer Worth Keeping in Melbourne

Ever looked at another repair quote and wondered whether your old car is still worth the trouble? It is a common turning point for Melbourne motoris...

Your Baby's First Year: A Local Guide to Feeding, Sleep, and When to Get Extra Support

Ask ten parents in a Brisbane mothers' group how their baby is feeding or sleeping, and expect ten different answers.  Someone's baby sleeps throug...

Kitchen and Laundry Makeover Ideas That Don't Require a Full Renovation

Full kitchen renos are expensive — and most people don't actually need one.  They need the kitchen to stop looking like it's stuck in 2009, or they...

How Technology Is Reshaping the Modern Australian Commercial Kitchen

The commercial kitchen has always been shaped by technology. Refrigeration changed how ingredients could be stored, modern ventilation transformed k...

The Number on a Roller Blind Fabric That Nobody Explains

Somewhere in the fabric book, next to the colour name, there is a percentage. Three per cent. Five per cent. Ten per cent. Nobody explains it, most c...

What’s Trending in Men’s Jewellery This Father’s Day!

Finding a Father’s Day gift that feels personal, stylish and genuinely wearable is not always easy. While socks and novelty mugs have traditionally ...

Road Signs: Understanding Their Role in Clear and Effective Signage

Effective signage and display hardware can help businesses communicate information, promote products and organise customer or visitor movement. Road...

Bottle Label Printing: Key Factors to Consider Before Your Next Packaging Run

Effective packaging begins with understanding the product, bottle material, artwork and production requirements when planning bottle label printing. H...

Planning a Long-Distance Move With Interstate Movers Melbourne

Moving between states involves more planning than a typical local relocation. Along with packing and transporting household belongings, you need to...