BOISE, Idaho--(BUSINESS WIRE)--Civitai, a leader in AI image generation, today announced the development of its Semi-Permeable Membrane (SPM) technology, a revolutionary solution that can disable an AI model’s ability to generate harmful content, including Child Sexual Abuse Material (CSAM).
SPM technology introduces a minimally invasive solution that alters existing AI image generation models and replaces specific concepts, thereby preventing the creation of harmful content without compromising the quality and creativity of the output. This innovative approach, built upon research into improving diffusion models, is particularly effective in preventing the generation of CSAM and non-consensual pornography, ensuring that Civitai’s platform remains a space for positive and respectful creativity.
“Civitai is committed to leading the way in responsible AI development and use,” said Justin Maier, CEO and Co-Founder of Civitai. “SPMs represent a significant leap forward in ensuring the responsible use of AI image generation. By proactively addressing the potential for harmful content creation, we are setting a new standard for the industry and empowering users to explore their creativity without compromising safety.”
Ideally, to prevent the generation of CSAM, the training data for open-source foundation models would not include both adult sexual content and images of children, nor any actual CSAM. However, this was not the case for some of the most widely used open-source models today. Civitai’s SPM technology is able to retroactively remove the concept of children from these models, rendering them safer for legitimate uses.
Civitai’s SPM technology has been in testing on its platform and shown promising results in its ability to maintain the integrity and quality of AI-generated images while safeguarding against the creation of harmful content. The company is exploring open-sourcing the solution at a future date to facilitate collaboration with other platforms, increasing safety throughout the ecosystem.
Civitai's commitment to safety extends beyond SPMs. The company also has strict safety guidelines to safeguard minors, respect real individuals, and prevent the generation of harmful or illegal content. Civitai uses automatic detection systems and a 24-hour moderation team to review user-generated content and ensure compliance with its terms of service. Additionally, Civitai actively collaborates with the industry to combat the spread of illegal and harmful content.
With the introduction of SPMs, Civitai is setting a new standard for AI image generation safety. The company is committed to empowering users to explore their creativity while fostering a responsible and ethical environment.
About Civitai
Civitai is at the forefront of generative AI technology, providing a dynamic platform where creativity meets cutting-edge AI tools. Founded in 2022, Civitai empowers users to explore the full potential of AI-generated media, from images and models to complete virtual environments. Guided by a commitment to innovation, inclusivity, and safety, Civitai is dedicated to democratizing AI technology and making it accessible to creators worldwide.
