The Rise of Real-time Deepfakes and the Delulu Case

The advancement of artificial intelligence technologies has made tools capable of manipulating images and videos in real-time increasingly accessible. Among these, the Delulu application, which allows users to alter their appearance with live deepfakes, has become the center of a debate following an incident that raised serious ethical and legal concerns. A streamer, Sam Pepper, known for his controversial content and for being banned from several platforms, used Delulu on the Kick platform to impersonate public figures, including the famous Mr. Beast, and utter potentially defamatory statements.

The episode highlighted how the ease of use of these technologies can predictably lead to the creation of non-consensual and harmful content. In addition to Mr. Beast, Pepper assumed the appearance of other real figures such as Jeffrey Epstein, Amouranth, and Sydney Sweeney, even showing AI-generated body parts when impersonating a woman. This type of abuse raises urgent questions about the responsibility of platforms and developers in the face of the spread of digital identity manipulation tools.

Delulu's Technology: Accessibility and Customizable "Skins"

Delulu is an application that offers users the ability to assume the appearance of any celebrity from a menu of likenesses the app calls "skins." These "skins" can represent animals, cartoon characters, fictional figures, but also real people like George Floyd, politicians such as Donald Trump and Vladimir Putin, or celebrities like Kim Kardashian and Eminem. The site also includes "skins" of numerous adult performers. To change their appearance, users simply need to grant the app access to their camera and select one of these "skins."

Most of the "skins" available on Delulu are user-generated, a model similar to that adopted by platforms like Civitai for sharing custom AI models. This accessibility contrasts with more complex and expensive solutions, such as the Chinese software Haotian AI, marketed for scam purposes, which requires thousands of dollars, complex installation, and a powerful video card. Delulu, while not achieving the same level of realism, is free and intuitive. The company behind Delulu is Decart, which has raised over $450 million in several funding rounds from major Silicon Valley venture capital firms like Sequoia and Benchmark. Decart also develops other AI video products, including MirageLSD, an AI video generator, and Lucy 2, a real-time video AI model similar to Delulu, but the latter is specifically designed for streamers.

Ethical Implications and Moderation Challenges

The incident involving Sam Pepper and Delulu highlights the profound ethical implications and moderation challenges that platforms and developers must address. Delulu's terms of use, for example, do not explicitly mention the use of the platform to assume the likeness of real people, although they state a policy of respecting copyright and intellectual property. This internal regulatory gap opens the door to ambiguous interpretations and potential abuses that go beyond simple copyright infringement, touching on defamation and identity manipulation.

The speed with which deepfakes can be generated and disseminated in real-time makes it extremely difficult for streaming platforms like Kick, known for its less stringent moderation policies compared to competitors like Twitch, to intervene effectively. The lack of responses from Kick and Decart to requests for comment on Pepper's behavior further underscores the complexity of the situation. For companies evaluating the deployment of AI solutions, especially in on-premise contexts where control over data and content is paramount, managing generative models and preventing misuse represents a fundamental constraint, requiring robust frameworks for governance and compliance.

The Future of Deepfakes and Risk Management

The Delulu case is emblematic of a broader trend in the artificial intelligence landscape: the democratization of powerful tools that, while opening new creative frontiers, also present significant risks. The ability to manipulate digital identity in real-time raises not only legal and ethical questions but also issues of security and public trust. The distinction between reality and fiction becomes increasingly blurred, with potential repercussions on individual reputation and social stability.

For technology decision-makers, it is crucial to understand the trade-offs associated with the adoption and development of these technologies. Although Delulu is a consumer application, its dynamics reflect challenges that also arise in enterprise contexts, particularly regarding data sovereignty and the management of AI-generated content. The need for advanced moderation systems, clear usage policies, and robust attribution mechanisms will become increasingly pressing as real-time deepfakes become more sophisticated and widespread. The discussion about the responsibility of developers and platforms is only just beginning, and the ability to anticipate and mitigate these risks will be fundamental for the responsible adoption of AI.