The chatbot maker should be liable for harm to the child
„AI companies are accused of prioritizing their own interests over safety, so they must be held accountable for harm caused to children through lawsuits, attorney general action, and legislation.”
Counter-narrative
A patchwork of state laws produces fragmented, risky regulation, so targeted rules are needed. This is the position of a report covered by ITIF and StateScoop. Companies are not passive: Google is involved nationwide in drafting chatbot laws, while OpenAI openly supports some California proposals.
Carriers
US state attorneys general (Florida, Kentucky, Texas, Kansas), California and New York governors, plaintiff law firms, grieving parents, Province of British Columbia, amerikai Kongresszus
Analysis
According to the narrative, the design of chatbots endangers young people: they encourage self-harm, reinforce delusions, and even help plan violence. This is why companion features are also targeted. It is fueled by suicide cases, the lawsuits against Character.AI, the Tumbler Ridge school shooting, and a class-action suit over the unauthorized use of children's data. It serves the interests of attorneys general and governors who, in Kris Kobach's words, will not wait for federal action, as well as plaintiff firms. Its weakness is that the causal claims appear in the complaints but have not been confirmed by a court. Moreover, the first such bill failed in Oklahoma. OpenAI supports certain California laws and Google takes part in drafting, so the content of the regulation is partly shaped by the companies themselves.
What's at stake: Whether children's AI safety is determined by legal liability and law or voluntary corporate practice.
Narrative sub-threads
State and provincial lawsuits against OpenAI
US states and the Canadian province of British Columbia are holding OpenAI accountable in public-law lawsuits. Eight states argue ChatGPT was designed in a way that is dangerous to young people. Texas is suing both OpenAI and Sam Altman. Florida's Attorney General is seeking an emergency injunction to bar minors. British Columbia is suing because it believes ChatGPT contributed to a school shooting.
Here, the plaintiff is the state itself. The lawsuit seeks a court injunction and design liability against OpenAI; in the cases of Florida and Texas, also against Sam Altman.
↘ fading · evidence: strongCharacter.AI: from lawsuits to bankruptcy
Both a private lawsuit and an attorney general's suit have been filed against Character.AI, alleging its chatbots encouraged self-harm in minors. Meanwhile, the company filed for Chapter 11 bankruptcy protection to sell its assets under court supervision. Regarding Disney's $20 million offer, the judge mandates appointing a data privacy ombudsman, while 32 states expect child safety guarantees.
Follows the legal fate of a single AI companion company. Accountability appears in bankruptcy proceedings, asset sales and court conditions, not in a verdict.
↗ rising · evidence: moderateFamily and group lawsuits
Families and initiators of class-action lawsuits are suing OpenAI and Google through private law channels. The allegations claim chatbots contributed to a school shooting and a teenager's suicide plans. A proposed class action alleges that OpenAI used minors' conversations for model training without genuine parental consent.
Individual victims and parents are the plaintiffs. Liability manifests through specific damage cases or data usage. Google also became a defendant due to Gemini used on school Chromebooks.
→ lasting · evidence: moderateGrok and AI-generated child abuse images
Lawsuits allege that xAI's Grok generated images depicting child abuse and was trained on real abuse material. Plaintiffs are asking for the lawsuits involving minors to be consolidated. A US court rejected xAI's request for a preliminary injunction against Minnesota's ban on undressing apps. Florida's Attorney General is suing an AI company over sexual images of children.
This is not about psychological harm caused by conversation, but about sexual content generated by image models. The main defendant is xAI.
→ lasting · evidence: strongUS companion chatbot child protection laws
US states are passing child-protecting chatbot laws that impose mandatory safety requirements on manufacturers. These include California's SB 1119 and Adam's Law, Hawaii's disclosure law, and New York's ban on companion features. The Pennsylvania House of Representatives passed a requirement for parental consent. At the federal level, the Senate advanced the Schiff bill, and Congress is considering regulation.
Responsibility is assigned to manufacturers through pre-emptive legislation, not through post-hoc litigation. Companies also play a role in the process: OpenAI supports the California proposal, and according to NPR, Google is participating nationwide in drafting chatbot laws.
Sub-thread stories
State and provincial lawsuits against OpenAI
British Columbia sues OpenAI over Tumbler Ridge school shooting, alleging ChatGPT roleschool leaderSchools should review how they handle signals of threats to schools, and what role AI tools play in that.parentA child's chatbot conversations can also be warning signs, so it is worth talking openly about their use.education policymakerThe lawsuit could set a precedent for enshrining AI providers' reporting obligations in law.edtech companyStricter expectations are likely for detecting and flagging dangerous content.Florida attorney general seeks emergency court order to bar minors from ChatGPT and restrict OpenAIstudentIf the court grants the request, minors could lose access to ChatGPT and would need to find another tool for homework.parentParents may want to check which of their children use ChatGPT and what to expect if the service introduces age verification.education policymakerThe case could set a precedent for court-ordered limits on minors' access to generative AI, so its outcome is worth following.edtech companyProducts for minors that are built on ChatGPT should factor in access and compliance risk.Eight US states sue OpenAI over alleged harms from ChatGPTparentThe lawsuit puts ChatGPT's child-protection measures under scrutiny from the states' side, so it is worth reviewing the settings on a child's account.education policymakerThe states' independent action signals that they are filling the gap left by missing federal regulation, which calls for risk assessment in school contracts as well.edtech companyFor products that use a chatbot and also reach minors, design decisions can become a matter of legal liability.British Columbia sues OpenAI over ChatGPT guidance linked to Canadian school shootingschool leaderThe lawsuit may justify a review of school safety and AI-risk protocols.education policymakerA new legal front has opened on chatbot liability.Eight US states sue OpenAI over alleged ChatGPT risks to childrenparentCheck that parental controls are switched on for your child's ChatGPT account, and talk through the risks of dangerous advice with them.education policymakerThe suits may set a precedent for chatbots' obligations toward minors; take this into account in your own regulatory planning.edtech companyExpect stricter age verification and safeguards for products aimed at minors.Texas sues OpenAI and Sam Altman over ChatGPT's safety for childrenparentThe state lawsuit puts ChatGPT's risks to children at the centre.education policymakerThe state action shows that child safety has become a legal issue.
Character.AI: from lawsuits to bankruptcy
Gibbs Mura sues Character.AI over alleged harm to teens' mental healthparentParents may want to watch how their children use AI companions and note any related mood changes.edtech companyLegal liability risk is growing for companion apps that are also available to minors.Kentucky sues Character.AI, alleging chatbots encouraged self-harm and starvationparentAI companion apps can also produce self-harm content, so it is worth checking how a child uses such apps.education policymakerA state-level lawsuit signals that companion chatbots are being treated as a liability issue.Character.AI files for bankruptcy as states ask court to protect children's dataparentThe fate of users' chats is uncertain, so it is worth checking what conversations a child had in the app and whether deletion of the data can be requested.education policymakerThe case shows that if an AI companion service goes bankrupt, minors' data can become an asset, which is a regulatory issue.teacherThe AI companion platform popular among students may shut down or change owners, so it is worth discussing the topic in class.Disney seeks Character.AI assets as states sue the company over minors' self-harmparentCharacter chatbots can create dependency and risk; it is worth knowing whether your child uses them.edtech companyLawsuits over companion chatbots signal legal risk in designing products for minors.Character.AI sale: judge and 32 states expect child-safety guaranteesparentCharacter.AI's future and its child-safety guarantees remain open questions.edtech companyIn acquisitions of AI companion platforms, child-safety and privacy terms have become a matter of negotiation.
Family and group lawsuits
More lawsuits filed against OpenAI over Tumbler Ridge school shootingeducation policymakerThe lawsuits concern the liability of AI companies, which could also affect school safety regulation.school leaderHandling incoming warning signals and detecting chatbot use may become a matter of school safety practice.parentThe case puts responsibility for chatbot use and child safety in the spotlight.Proposed class action: OpenAI used children's data to train ChatGPT without parental consentparentCheck whether a child under 13 or a teenager uses ChatGPT, and which data-sharing settings are in force.school leaderFor AI tools recommended to students, the data-handling and consent practices for minors must be clarified in advance.edtech companyUsing children's data for model training creates litigation risk, so a documented parental-consent process is required.Montana state court lawsuit over ChatGPT and child safety advancesparentThe lawsuit tests legal liability for chatbots' effects on children.edtech companyAI companies face growing liability risk in use by minors.Parents sue Google, saying 13-year-old daughter used Gemini to plan suicideschool leaderSchools need to clarify what AI access students have on school devices and who can see what they use.parentAI use on a school device may be invisible to parents, so it is worth asking about.teacherTeachers should report it if a student's AI use shows a worrying pattern.education policymakerThe lawsuit raises the question of liability for school Chromebooks and AI access.edtech companyFor school AI products, the legal stakes of child-safety filtering and liability are rising.
Grok and AI-generated child abuse images
Another woman joins lawsuit accusing Grok of generating child sexual abuse materialparentAI image-generation misuse involving minors poses a risk to children.school leaderSchools need to develop procedures for cases of AI image manipulation involving students.education policymakerThe responsibility of generative AI providers is a child-protection issue.xAI accused of training Grok's deepfake engine on real child abuse materialparentParents of victims may also consider legal action; understanding the lawsuit helps in deciding.education policymakerThe provenance of training data is a child-protection regulatory issue.edtech companyTransparency about training-data provenance and the handling of generated images is an increasing risk.Deepfakes and AI bullying in schools: Illinois law takes effect, Minnesota rule not suspendedschool leaderUnder the new law, schools need a protocol for handling deepfake incidents.teacherReporting deepfake bullying among students is a teacher's responsibility.parentAI manipulation of children's images is a risk, and legal protection is getting stronger.California signs Adam's Law on companion chatbots as xAI minors case heads toward consolidationedtech companyChatbots aimed at children must include mandatory safeguards, such as crisis protocols and parental controls.education policymakerThe California model could serve as a template for regulation in other states and countries.Florida attorney general sues AI company and proposes OS-level age verificationparentAge-verification rules could affect children's phone use and data.edtech companyOperating-system-level age verification could change how products handle users' ages.
US companion chatbot child protection laws
Hawaii enacts AI companion disclosure and safety lawedtech companyCompanies offering AI companion features must comply with Hawaii's disclosure and safety rules.education policymakerAnother state example of regulating AI companions.US Senate advances Schiff-led children's chatbot safety bill; reports warn of pitfallseducation policymakerMisalignment between federal and state rules is a risk, and OS-level child-account flagging is a contested proposal.parentAn OS-level child-account signal could reduce the burden of app-by-app settings.edtech companyCompanies should prepare for chatbot safety requirements, especially for underage users.US Congress weighs regulation of AI companion chatbotseducation policymakerPrepare for child-protection rules on AI companions.edtech companyChatbots that reach minors should expect stricter rules.parentData on the mental-health risks of intensive chatbot use support setting rules at home.OpenAI backs California bill to advance youth AI safetyedtech companyCalifornia's rule on chatbots for children could bring product requirements.education policymakerCalifornia's move could serve as a model for other regulators.parentThe law could strengthen protections for children using chatbots.Newsom signs strictest US child-safety chatbot and social media lawsstudentCalifornian teens will be covered by stricter chatbot and social media protections.parentNew legal protection, and the ability to hold platforms accountable for a child's chatbot use.education policymakerA model regulation that other states and the EU may watch.edtech companyCompliance of chatbot features aimed at young people needs to be reviewed.school leaderThe rules of the platforms students use are changing; this is worth addressing in digital safety education.California signs child-safety laws restricting AI chatbots and social media for teensparentThe California model points toward parental notification and age verification, so it is worth learning the platforms' new settings.education policymakerThe package could serve as a template for other regulators on chatbot obligations towards minors.edtech companyChatbots aimed at minors must provide age verification and protective features.studentTeenagers' chatbot and social media use across California will face stricter limits.US states pass chatbot safety laws one after another, with Google helping to draft the texteducation policymakerRegulatory templates and industry lobbying are both present, so sources are worth checking when drafting state legislation.edtech companyThe patchwork of state rules means differing compliance obligations in the US market.parentChild protection currently rests on legal frameworks that differ from state to state.California's new AI child-safety law: SB 1119 regulates companion chatbotsedtech companyProducts that offer companion chatbots or reach children must comply with the new California requirements.education policymakerCalifornia's rules could serve as a model for US and international lawmaking.parentThe law strengthens protections for children around companion chatbots.Pennsylvania House passes bill requiring parental consent for children's use of AI companionsparentIf the bill becomes law, parental consent will be needed for a child to use an AI companion, so it is worth reviewing the apps your child uses now.edtech companyChatbots accessible to minors will need a parental-consent process, though critics complain the measure is invasive.education policymakerThe bipartisan vote suggests that regulating AI companions is a politically viable path at state level.California enacts child-safety requirements for companion chatbotsedtech companyPrepare for the child-safety measures by 1 July 2027 if your product offers companion-chatbot features to minors.parentThe law sets a mandatory level of protection for companion chatbots used by children, which providers can be held to.education policymakerCalifornia's rules could serve as a model for regulating companion chatbots in schools.New York law bans unsafe AI companion features in chatbots for under-18sparentIn light of the state law, it is worth checking which companion features are available in the chatbots your child uses.edtech companyCompanion features of chatbot products aimed at minors need to be reviewed, as elements deemed dangerous become prohibited in New York.education policymakerThe law can serve as a model when designing child-safety regulation.studentFeatures that strengthen emotional attachment are being narrowed in chatbots aimed at minors.New York law bans AI chatbots from posing as friends to childrenedtech companyChatbots aimed at children must comply with the new limits on role-play and communication.parentThe law addresses the risk in the relationship between children and chatbots that pose as friends.education policymakerIt could serve as a model for other states' chatbot rules.
Google search interest
Hungary
| Topic and search term | Weekly | Average |
|---|---|---|
| The chatbot maker should be liable for harm to the childchatbot per | 0 | |
| State and provincial lawsuits against OpenAIopenai per | 0 | |
| Character.AI: from lawsuits to bankruptcycharacter ai | 8.5 | |
| Family and group lawsuitsChatGPT suicide | 0 | |
| Grok and AI-generated child abuse imagesgrok | 44.5 | |
| US companion chatbot child protection lawsAI laws for children | 0 |
World
| Topic and search term | Weekly | Average |
|---|---|---|
| The chatbot maker should be liable for harm to the childchatbot lawsuit | 0.8 | |
| State and provincial lawsuits against OpenAIopenai lawsuit | 10.8 | |
| Character.AI: from lawsuits to bankruptcycharacter.ai lawsuit | 0 | |
| Family and group lawsuitschatgpt suicide lawsuit | 0.9 | |
| Grok and AI-generated child abuse imagesgrok deepfake | 0.1 | |
| US companion chatbot child protection lawschatbot child safety law | 0 |
Google Trends relative search index over the period studied, weekly average. A narrative and its sub-threads appear in a single comparison: 100 is the group's most-searched day, and the figures can only be compared within the group. The search term was chosen by machine analysis; it measures how much the term is searched, not how widespread the narrative is.
Who is affected and how
- parent
- Legal protection is still taking shape: in Pennsylvania, for example, the proposal on parental consent has so far only been passed by the House of Representatives. In the Gemini lawsuit, parents were unaware of their daughter's use for months. Do not rely on the platform; monitor the child's use directly.
- school leader
- According to the Gemini lawsuit, the girl used the chatbot on a school Chromebook. Check what AI running on school accounts sees and logs.
- education policymaker
- A patchwork of member state laws creates fragmented requirements. It is advisable to establish a unified security minimum for school procurement.
- edtech company
- Age verification, parental consent, and restrictions on companion features are increasingly becoming legal requirements or proposals in more states. It is advisable to document safety testing and the handling of children's data, as lawsuits are targeting exactly these areas.
Hungary
No domestic trace in the period under review: none of the stories involves a Hungarian case, lawsuit or regulatory action.
Weekly trend
Turning points
Newsom signs strictest US child-safety chatbot and social media lawsNewsom signed Adam's Law and the chatbot bills, making liability a state rule alongside private lawsuits.Eight US states sue OpenAI over alleged harms from ChatGPTEight states' joint lawsuit alleges ChatGPT was designed in a way that its use could endanger young people. Individual cases thus became questions of product design.Character.AI files for bankruptcy as states ask court to protect children's dataCharacter.AI filed for Chapter 11 bankruptcy protection to sell assets while being sued and investigated by multiple states. Liability pressure has thus become a factor affecting a company's fate.Parents sue Google, saying 13-year-old daughter used Gemini to plan suicideAccording to the lawsuit against Google, a 13-year-old girl used Gemini on a school Chromebook. This use on school devices has become part of the liability debate.
Related narratives in the News magazine
Social backlash: children, schools, data centersWashington: self-regulation instead of binding legislation
Supporting stories
US Senate advances Schiff-led children's chatbot safety bill; reports warn of pitfallseducation policymakerMisalignment between federal and state rules is a risk, and OS-level child-account flagging is a contested proposal.parentAn OS-level child-account signal could reduce the burden of app-by-app settings.edtech companyCompanies should prepare for chatbot safety requirements, especially for underage users.Gibbs Mura sues Character.AI over alleged harm to teens' mental healthparentParents may want to watch how their children use AI companions and note any related mood changes.edtech companyLegal liability risk is growing for companion apps that are also available to minors.US Congress weighs regulation of AI companion chatbotseducation policymakerPrepare for child-protection rules on AI companions.edtech companyChatbots that reach minors should expect stricter rules.parentData on the mental-health risks of intensive chatbot use support setting rules at home.OpenAI backs California bill to advance youth AI safetyedtech companyCalifornia's rule on chatbots for children could bring product requirements.education policymakerCalifornia's move could serve as a model for other regulators.parentThe law could strengthen protections for children using chatbots.More lawsuits filed against OpenAI over Tumbler Ridge school shootingeducation policymakerThe lawsuits concern the liability of AI companies, which could also affect school safety regulation.school leaderHandling incoming warning signals and detecting chatbot use may become a matter of school safety practice.parentThe case puts responsibility for chatbot use and child safety in the spotlight.Newsom signs strictest US child-safety chatbot and social media lawsstudentCalifornian teens will be covered by stricter chatbot and social media protections.parentNew legal protection, and the ability to hold platforms accountable for a child's chatbot use.education policymakerA model regulation that other states and the EU may watch.edtech companyCompliance of chatbot features aimed at young people needs to be reviewed.school leaderThe rules of the platforms students use are changing; this is worth addressing in digital safety education.California signs child-safety laws restricting AI chatbots and social media for teensparentThe California model points toward parental notification and age verification, so it is worth learning the platforms' new settings.education policymakerThe package could serve as a template for other regulators on chatbot obligations towards minors.edtech companyChatbots aimed at minors must provide age verification and protective features.studentTeenagers' chatbot and social media use across California will face stricter limits.US states pass chatbot safety laws one after another, with Google helping to draft the texteducation policymakerRegulatory templates and industry lobbying are both present, so sources are worth checking when drafting state legislation.edtech companyThe patchwork of state rules means differing compliance obligations in the US market.parentChild protection currently rests on legal frameworks that differ from state to state.British Columbia sues OpenAI over Tumbler Ridge school shooting, alleging ChatGPT roleschool leaderSchools should review how they handle signals of threats to schools, and what role AI tools play in that.parentA child's chatbot conversations can also be warning signs, so it is worth talking openly about their use.education policymakerThe lawsuit could set a precedent for enshrining AI providers' reporting obligations in law.edtech companyStricter expectations are likely for detecting and flagging dangerous content.California's new AI child-safety law: SB 1119 regulates companion chatbotsedtech companyProducts that offer companion chatbots or reach children must comply with the new California requirements.education policymakerCalifornia's rules could serve as a model for US and international lawmaking.parentThe law strengthens protections for children around companion chatbots.Florida attorney general seeks emergency court order to bar minors from ChatGPT and restrict OpenAIstudentIf the court grants the request, minors could lose access to ChatGPT and would need to find another tool for homework.parentParents may want to check which of their children use ChatGPT and what to expect if the service introduces age verification.education policymakerThe case could set a precedent for court-ordered limits on minors' access to generative AI, so its outcome is worth following.edtech companyProducts for minors that are built on ChatGPT should factor in access and compliance risk.Pennsylvania House passes bill requiring parental consent for children's use of AI companionsparentIf the bill becomes law, parental consent will be needed for a child to use an AI companion, so it is worth reviewing the apps your child uses now.edtech companyChatbots accessible to minors will need a parental-consent process, though critics complain the measure is invasive.education policymakerThe bipartisan vote suggests that regulating AI companions is a politically viable path at state level.Kentucky sues Character.AI, alleging chatbots encouraged self-harm and starvationparentAI companion apps can also produce self-harm content, so it is worth checking how a child uses such apps.education policymakerA state-level lawsuit signals that companion chatbots are being treated as a liability issue.Character.AI files for bankruptcy as states ask court to protect children's dataparentThe fate of users' chats is uncertain, so it is worth checking what conversations a child had in the app and whether deletion of the data can be requested.education policymakerThe case shows that if an AI companion service goes bankrupt, minors' data can become an asset, which is a regulatory issue.teacherThe AI companion platform popular among students may shut down or change owners, so it is worth discussing the topic in class.Proposed class action: OpenAI used children's data to train ChatGPT without parental consentparentCheck whether a child under 13 or a teenager uses ChatGPT, and which data-sharing settings are in force.school leaderFor AI tools recommended to students, the data-handling and consent practices for minors must be clarified in advance.edtech companyUsing children's data for model training creates litigation risk, so a documented parental-consent process is required.Eight US states sue OpenAI over alleged harms from ChatGPTparentThe lawsuit puts ChatGPT's child-protection measures under scrutiny from the states' side, so it is worth reviewing the settings on a child's account.education policymakerThe states' independent action signals that they are filling the gap left by missing federal regulation, which calls for risk assessment in school contracts as well.edtech companyFor products that use a chatbot and also reach minors, design decisions can become a matter of legal liability.Eight US states sue OpenAI over alleged ChatGPT risks to childrenparentCheck that parental controls are switched on for your child's ChatGPT account, and talk through the risks of dangerous advice with them.education policymakerThe suits may set a precedent for chatbots' obligations toward minors; take this into account in your own regulatory planning.edtech companyExpect stricter age verification and safeguards for products aimed at minors.Disney seeks Character.AI assets as states sue the company over minors' self-harmparentCharacter chatbots can create dependency and risk; it is worth knowing whether your child uses them.edtech companyLawsuits over companion chatbots signal legal risk in designing products for minors.New York law bans unsafe AI companion features in chatbots for under-18sparentIn light of the state law, it is worth checking which companion features are available in the chatbots your child uses.edtech companyCompanion features of chatbot products aimed at minors need to be reviewed, as elements deemed dangerous become prohibited in New York.education policymakerThe law can serve as a model when designing child-safety regulation.studentFeatures that strengthen emotional attachment are being narrowed in chatbots aimed at minors.Texas sues OpenAI and Sam Altman over ChatGPT's safety for childrenparentThe state lawsuit puts ChatGPT's risks to children at the centre.education policymakerThe state action shows that child safety has become a legal issue.Character.AI sale: judge and 32 states expect child-safety guaranteesparentCharacter.AI's future and its child-safety guarantees remain open questions.edtech companyIn acquisitions of AI companion platforms, child-safety and privacy terms have become a matter of negotiation.New York law bans AI chatbots from posing as friends to childrenedtech companyChatbots aimed at children must comply with the new limits on role-play and communication.parentThe law addresses the risk in the relationship between children and chatbots that pose as friends.education policymakerIt could serve as a model for other states' chatbot rules.Parents sue Google, saying 13-year-old daughter used Gemini to plan suicideschool leaderSchools need to clarify what AI access students have on school devices and who can see what they use.parentAI use on a school device may be invisible to parents, so it is worth asking about.teacherTeachers should report it if a student's AI use shows a worrying pattern.education policymakerThe lawsuit raises the question of liability for school Chromebooks and AI access.edtech companyFor school AI products, the legal stakes of child-safety filtering and liability are rising.
Machine analysis based on story titles and summaries, with a verification pass. The source of the facts is the article linked at each story.