Civitai, alongside industry leaders such as Amazon, Anthropic, Google, Meta, Metaphysic, Microsoft, Mistral AI, OpenAI, and Stability AI, has committed to implementing robust child safety measures in the development, deployment, and maintenance of generative AI technologies. This initiative, led by Thorn, a nonprofit dedicated to defending children from sexual abuse, and All Tech Is Human, an organization dedicated to collectively tackling tech and society's complex problems, aims to mitigate the risks generative AI poses to children.

By adopting comprehensive Safety by Design principles, Civitai and its peers are setting new standards for the ethical development of AI, ensuring that child safety is prioritized at every stage. As part of the working group, Civitai has also agreed to release progress updates every three months.

This commitment marks a significant step forward in preventing the misuse of AI technologies to create or spread child sexual abuse material (AIG-CSAM) and other forms of sexual harm against children.

“Civitai is aligned with Thorn, All Tech Is Human, and the broader tech industry,” said Justin Maier, Founder and CEO of Civitai. “This pledge underscores our unwavering commitment to fostering responsible AI development. In our pursuit of harnessing AI's potential, we recognize the imperative of safeguarding children and upholding ethical standards. We are steadfast in integrating the Safety by Design principles, ensuring that our AI technologies are not only innovative but safe for our users.”

This collective action underscores the tech industry's approach to child safety, demonstrating a shared commitment to ethical innovation and the well-being of the most vulnerable members of society.

Thorn has published the principles at https://teamthorn.co/gen-ai. Additionally, select participating companies joined Thorn and ATIH to publish a comprehensive paper, "Safety by Design for Generative AI: Preventing Child Sexual Abuse," that features these principles and additional mitigations, detailing actionable strategies that AI developers, providers, data hosting platforms, social platforms, and search engines may take to implement these principles, making it more challenging for bad actors to exploit generative AI technologies for harmful purposes.

For more information on the principles for Safety by Design in Generative AI, visit https://civitai.com/articles/4991.

About Civitai

Civitai is a pioneering AI generative image-maker platform at the forefront of image creation transformation. Civitai empowers users to generate dynamic and customizable images quickly and easily, revolutionizing how visuals are created in the digital landscape. Civitai provides a versatile solution for creating high-quality images without extensive design expertise, from customizable templates to advanced editing options. Visit their website at https://civitai.com/ to learn more about Civitai and experience the future of image creation firsthand.

About Thorn

Thorn is a nonprofit that builds technology to defend children from sexual abuse. Founded in 2012, the organization creates products and programs to empower the platforms and people who have the ability to defend children. Thorn’s tools have helped the tech industry detect and report millions of child sexual abuse files on the open web, connected investigators and NGOs with critical information to help them solve cases faster and remove children from harm, and provided parents and youth with digital safety resources to prevent abuse. To learn more about Thorn’s mission to defend children from sexual abuse, visit thorn.org.

About All Tech Is Human

All Tech Is Human is a nonprofit dedicated to collectively tackling tech and society's complex problems such as mitigating the risks generative AI poses to children. The organization brings together key stakeholders across civil society, government, industry, and academia to understand values, trade-offs, and best practices. Based in NYC with a global audience and impact, All Tech Is Human has a wide variety of activities that are focused on uniting a multistakeholder community, educating a broad audience, and diversifying the traditional tech pipeline to better match the complex problems we face. Learn more at AllTechIsHuman.org.

View source version on businesswire.com: https://www.businesswire.com/news/home/20240423987311/en/