Introduction
In a new digital scandal that strongly highlights the severe failures in moderation and user protection policies among major global technology companies, a detailed investigative report published this week by the Institute for Strategic Dialogue revealed that major social media platforms, spearheaded by YouTube and X, have acted as gateways and direct channels routing and driving millions of users toward suspicious websites and applications. These sites specialize in creating and generating explicit, explicit, and fake images via advanced artificial intelligence technologies known as deepfakes, entirely without obtaining any consent or permission from the targeted individuals and victims whose faces appear in those images. These shocking, alarming, and digitally documented findings with statistics underscore the dismal failure of moderation policies, content filtering, and data management currently applied by major social platforms in their supposed endeavor to prevent the spread and promotion of malicious tools and software clearly used for digital image-based extortion and harassment, raising serious questions about the commitment of those platforms to the security and safety of individuals and communities in the virtual world.
- Massive traffic volume resulting from referral traffic
- Low-cost criminal industry and severe social harm
- Legislative landscape and ongoing failure to assume responsibility
- Frequently asked questions
Massive traffic volume resulting from referral traffic
The meticulous report prepared by the Institute for Strategic Dialogue showed that various social media platforms were directly and practically responsible for attracting and directing more than 5.7 million actual visits to abusive deepfake sites and applications between December 2025 and March 2026. Alum and shockingly, the video giant YouTube topped the list uncontested as the single largest primary source of traffic and referrals for these suspicious sites, being solely responsible for directing 1.82 million visits, representing over 30 percent of the precisely tracked visits. Meanwhile, X, formerly known as Twitter, took second place directly, contributing to routing and referring more than 1.3 million visits by users searching for these services. The report explained that heavily published videos on YouTube guiding users step-by-step to these sites included detailed reviews, promotional showcases of specific user-friendly apps, and often contained direct links and promo codes for free usage credits to attract teenagers and users.
Commenting on this shocking digital disaster, Melanie Smith, senior director of research and policy at the Institute for Strategic Dialogue, told the prominent tech magazine Wired that YouTube’s role went beyond being merely a passive referral and routing source. Smith stated clearly: “In very many of these cases documented by us, the platform and the videos on it were actually facilitating, training, and guiding individuals on how to use and operate these harmful tools.” Smith noted that YouTube’s terms of service and internal rules clearly and strictly prohibit posting sexually explicit content and ban including external links leading to or encouraging pornographic websites, but she added regretfully: “Yet it is clear and certain to us that these strict written policies and rules are never comprehensively, decisively, or effectively enforced in practice.”}
Low-cost criminal industry and severe social harm
The field study examined and analyzed the mechanics and pricing of these deepfake tools, uncovering a true disaster: the service is exceptionally accessible and affordable, allowing intrusive users to generate and create explicit and abusive images of anyone, whether public or ordinary, at a minuscule cost as low as one US dollar per produced image. Despite these extremely low individual user costs, these specialized services and sites can be highly lucrative and commercial for their operators and owners: a recent wide-ranging investigation by Wired estimated that leading deepfake providers collectively generate massive financial revenues and huge returns reaching about 36 million US dollars in ongoing annual profits.
The report also gravely documented that the list of frequent victims and common targets of these hateful digital attacks often includes current or former romantic partners for revenge and defamation, as well as relatives, coworkers, and people from ordinary social circles. The malicious motives behind these acts go far beyond individual sexual harassment and extortion; researcher Smith explained that “many of these requests and generated images had the primary goal of destroying professional reputations, causing certain people to lose their jobs and livelihoods, and severely endangering their professional and personal lives in despicable and harmful ways that cannot be easily repaired.”
Legislative landscape and ongoing failure to assume responsibility
These disturbing findings arrive at a critical time when strict legal and regulatory interest is growing, and demands for serious government action to combat the exploitation of deepfake technology in online defamation and extortion are escalating. The Federal Content Removal Act, passed in the United States in 2025, compels and forces all digital platforms and tech companies to swiftly and immediately delete intimate, non-consensual, and fake images within a maximum of 48 hours of receiving a report or complaint. Last May, a broad coalition of 54 civil society organizations and associations sent a strongly worded and resolute letter to state attorneys general urging and demanding them to take strict, decisive legal action and prosecute operators of fraudulent apps. The US state of Minnesota has already rushed to enact a strict, specific local law explicitly prohibiting the use, development, or distribution of deepfake applications within its borders.
Despite all these preliminary steps, the Institute for Strategic Dialogue report argues strongly and repeatedly that current legal and regulatory measures remain inadequate and severely deficient in addressing the roots of the crisis with the required speed and force, urgently calling for coordinated government responses including stricter, harsher regulations on major social media platforms alongside launching and implementing public awareness and digital literacy programs in schools and educational institutions. Earlier this year, a separate investigative report by media organizations revealed that fake deepfake abusive images and cases were officially reported across roughly 90 schools and educational institutions spanning 28 different countries worldwide, while a complex and organized network of fake accounts on X was detected still operating with intense activity and paying for the continuous promotion of these deepfake tools until very recently in June, highlighting the scale of the societal catastrophe and its rapid spread that must be halted immediately.
Frequently asked questions
Question: What are the main platforms whose direct role in directing users to deepfake sites was uncovered?
Answer: The recent study proved that YouTube and X were the largest and most utilized gateways for referring and routing millions to these abusive websites online.
Question: How did YouTube practically contribute to facilitating user access to these harmful applications?
Answer: Videos on the platform included promotional reviews and instructional explanations of operational mechanics, attaching external links to obtain services and free promo codes.
Question: What is the estimated material cost of producing an abusive image using these advanced tools?
Answer: Users can access fake image production and generation services at a very low cost that may not exceed one US dollar per image, making them accessible and widespread.
Question: Are there current legal and legislative movements to address this phenomenon and hold platforms accountable?
Answer: Yes, federal laws have been passed obligating platforms to remove illicit content within 48 hours, and states like Minnesota have enacted decisions to ban these applications completely.
