When parents think about AI and children, they tend to think about ChatGPT. That's understandable. It's the most visible AI tool in public conversation right now. But by the time most children encounter a tool like ChatGPT for the first time, they've already spent years being influenced by AI systems they never recognized as AI.

The parent's guide at parentsguidetoai.ca makes this point in Section 5:

"Students often use many AI tools without realizing they are AI-powered, so parents should assume that AI is already present in: phones and tablets, search engines, Snapchat and Instagram features, TikTok recommendation systems, homework helper applications, gaming communities and Discord bots, photo editing apps, video editing software, translation tools, and browser extensions."

This post unpacks what that actually looks like, and why it matters for how you talk to your children about AI.


TikTok's recommendation engine

TikTok's "For You" page is one of the most powerful AI systems in daily use by teenagers. It is not a list of popular videos. It is a highly personalized recommendation engine that watches what you watch, how long you watch it, what you skip, whether you replay, whether you comment or share. It uses all of that to build a detailed model of what will keep you watching.1

The algorithm is genuinely impressive, which is partly what makes it concerning. It surfaces content that teenagers didn't know they wanted. Over time, it can create feedback loops. A teenager who watches a few videos about body image, or anxiety, or self-harm, can find themselves in a narrowing funnel where the algorithm keeps surfacing similar content because that's what their engagement data says they respond to.2

This is not a TikTok-specific problem. Instagram Reels and YouTube Shorts use similar systems. The underlying mechanism (AI optimization for engagement) is the same.

What's worth discussing with your child: the For You page was designed for them by an AI that has been watching them, not a neutral reflection of what's popular or true.


Snapchat filters and AI image tools

Most children using Snapchat have used its AI-powered filters: the ones that smooth skin, reshape faces, change hair colour, or add effects. It's easy to read them as fun overlays. They're actually generative AI tools applied in real time.

The implications are worth knowing:

Beauty filters alter appearance in ways tied to real psychological effects. Research has documented that prolonged use of filters that alter facial features (particularly those that smooth skin, enlarge eyes, or alter facial proportions) is associated with increased body dissatisfaction and, in some cases, a condition researchers have called "Snapchat dysmorphia": a growing trend of people seeking cosmetic procedures to match their filtered selves.3

AI image tools in these apps are learning from your child's face. Filters and "photo enhancers" in social apps typically process images on the platform's servers. The photos your child uses with these tools may contribute to training data. Terms of service vary.

Snapchat's My AI (covered briefly in Post 15 on AI companions) is embedded in the app by default. Many parents don't know it's there, and many teens don't think of it as an AI they're "using."


Gaming: AI in matchmaking, characters, and moderation

Gaming is one of the largest daily AI touchpoints for children and teenagers, and it gets almost no attention in conversations about AI literacy.

Matchmaking systems in games like Fortnite, Apex Legends, and Valorant use AI to match players of similar skill levels. In some implementations, they also aim to keep players engaged. Engagement-optimized matchmaking can mean that the system occasionally matches players against easier opponents after a losing streak, to maintain momentum and prevent them from quitting. The experience of the game (including how good your child feels about their performance) is partly being managed by an algorithm.

NPC behaviour and adaptive difficulty in single-player games use increasingly sophisticated AI. This is less concerning from a manipulation standpoint, but it's worth children understanding that the "enemy" they're fighting is a system responding to their play patterns.

Discord bots and AI features in gaming communities include everything from automated moderation (AI deciding what content gets flagged or removed) to AI-powered server tools that generate summaries, translate messages, or roleplay characters. Many Discord servers used by teenagers have AI bots running in them, often without announcement.

In-game purchase optimization is one of the more subtle applications. Some games use AI to identify players who are likely to make purchases and to tailor the experience to encourage spending, including timing offers to appear when a player is most emotionally engaged after a good result.


Google Search and AI-generated answers

Google has progressively integrated AI into search results. "AI Overviews" (the AI-generated summaries that appear at the top of many search results pages) are now a default feature of Google Search.4

This matters for children doing homework research. When a student Googles a question and reads the summary at the top of the page, they may not realize they are reading AI-generated content rather than a direct quote from a reliable source. The summary was generated by an AI synthesizing multiple sources. Like all AI-generated content, it can contain errors, oversimplifications, or missing context.

The advice in Post 5 of this series applies directly here: click through to the actual source. The AI Overview is a starting point, not the answer.


Homework apps and AI tutors

Apps like Photomath, Socratic, Khanmigo (Khan Academy's AI tutor), Grammarly, and others are AI tools designed specifically for student use. Most are legitimately useful. A few are worth knowing about in more detail.

Photomath allows students to photograph a math problem and receive a step-by-step solution. Used well, this is a learning tool: you can follow the steps and understand the method. Used carelessly, it is homework-completion software. The distinction depends entirely on whether the student is learning from the steps or just copying the answer.

Grammarly uses AI to suggest grammar, tone, and style improvements. Most schools consider this acceptable use in the same category as spell-check. But the newer versions can rewrite entire paragraphs, which may cross into territory the teacher didn't intend to allow.

AI tutoring apps vary enormously in quality. Some are genuinely excellent at adapting to a student's pace and explaining concepts clearly. Some produce confident wrong answers.

The test from the parent's guide applies here too: if your child can explain the concept without the app, they've learned something. If they can't, the app may have done the learning for them.


What to do with this information

The goal of naming these tools is not to alarm parents or prompt a device audit. It is to change the starting point of the conversation.

When you talk to your child about AI, starting from "AI is a new thing you might start using" is inaccurate and immediately signals to your child that you don't understand their world. Starting from "AI is already part of almost everything you use, including things that don't call themselves AI" is more accurate, and more likely to open a genuine conversation.

A few good conversation starters:

  • "Your TikTok For You page was built for you by an AI that's been watching what you watch. Does that seem weird to you? Does it show you things you actually like?"
  • "When you look at photos through Snapchat filters, do you think about what it would look like without the filter?"
  • "When you look something up on Google and there's a summary at the top, do you read the sources it came from?"
  • "Do you think the matchmaking in [game they play] is fair? Do you ever wonder how it decides who you're matched with?"

These are genuine questions, not gotchas. The answers will tell you what your child already understands about the AI in their daily life. That's a better foundation than starting from scratch.


The short version:

  • Most children are already using AI every day through TikTok's recommendation engine, Snapchat filters, Google AI Overviews, gaming systems, homework apps, and Discord bots.
  • Much of this AI is designed to maximize engagement, not learning. The effects of engagement-optimized AI on teenagers are genuinely uncertain.
  • Conversations about AI literacy are more credible when they start from your child's actual experience, not from ChatGPT as a new thing.
  • The AI Traffic Light from the parent's guide applies here too: understanding what kind of AI you're dealing with is the first step to using it thoughtfully.

Read the full parent's guide: parentsguidetoai.ca: Section 5, School AI vs. AI at Home.

Canada's digital literacy resource for families: MediaSmarts has specific resources on algorithmic recommendation systems and how to talk to children about them.


Notes


  1. TikTok Newsroom. "How TikTok Recommends Videos #ForYou." TikTok, June 18, 2020. https://newsroom.tiktok.com/en-us/how-tiktok-recommends-videos-for-you 

  2. TikTok Newsroom. "An Update on Our Work to Safeguard and Diversify Recommendations." TikTok, 2023. https://newsroom.tiktok.com/en-us/an-update-on-our-work-to-safeguard-and-diversify-recommendations 

  3. Rajanala, Susruthi, Mayra B.C. Maymone, and Neelam A. Vashi. "Selfies — Living in the Era of Filtered Photographs." JAMA Facial Plastic Surgery, vol. 20, no. 6, 2018. https://pubmed.ncbi.nlm.nih.gov/30073294/ 

  4. Google. "About AI Overviews." Google Search Help, 2024. https://support.google.com/websearch/answer/14901683