SIAgentNews.com
← All news
DevelopingPolicySecurity

Zeta's maker adds a safety team and age limits after Apple pauses new downloads

ScatterLab, maker of the AI chat app Zeta, is adding age-based protections after Apple stopped new downloads, a sign of how AI companion apps are being pushed on teen safety.

· First reported by aitimes.com

3 hoursplanned daily cap for teen use in Korea

The short version

  • ScatterLab created a Trust & Safety Team that reports directly to its CEO.
  • Story content will be reviewed in three stages: creation, launch and exposure to users.
  • Reminders that users are talking to an AI, plus help information if self-harm content is detected.
  • In Korea, teen use is to be capped at 3 hours a day, with a monthly payment limit, by year's end.
  • The company says it will keep talking with regulators, app stores and the content industry.

Why it matters

AI chat apps that role-play stories are popular with young people, and app stores can cut off their growth. Expect more of these apps to ask your age, limit teen use and spell out what content is allowed.

What ScatterLab announced

As aitimes.com reported, ScatterLab has set up a Trust & Safety Team that answers directly to the company's leadership. It covers content safety policy as well as building and checking the company's own AI models.

The announcement follows Apple's halt of new Zeta downloads in the App Store. The article's headline asks whether this is a response, but the company's statement as reported does not say so.

How the checks will work

Zeta users play through "plots", which are story setups an AI character acts out with them. Each plot will be reviewed three times: when it is made, when it is released and when it is shown to users. At each step, reviewers look at the theme, text and images and assign a rating.

ScatterLab also plans standards for each country, naming Korea, Japan and the US. Which plots a user can open will depend on the result of an age check.

Protections during chats

The company plans to release its own AI that blocks inappropriate conversation as it happens, with speech rules set by age. Users will get regular reminders that they are talking to an AI. If suicide or self-harm content is detected, the app will show relevant help information.

In Korea, the company plans to limit teen use to 3 hours a day and cap payments at 10만원 a month. Both are due this year. The company aims to refine its models and moderation by the end of the year.

What to watch

The plan is mostly a list of intentions with year-end targets. Whether it satisfies Apple is not stated in the report.

ScatterLab says it will keep discussing youth protection and intellectual property with regulators, app stores and the content industry.

What to watch

  • Will Apple restore new downloads of Zeta, and on what terms?
  • Will the teen time and payment limits arrive this year as promised?

Try it

If a teen in your home uses AI chat apps, open the app's settings and check the age and spending controls.

Sources and links

First reported by aitimes.com. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.

Liked it? Say why

Add a line for other readers.

No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.

More AI news