Citadel AI and Deloitte Tohmatsu Announce Collaboration on AI Quality Evaluation and Monitoring

Citadel AI Inc. (Shibuya-ku, Tokyo, CEO: Hironori Kobayashi, hereinafter “Citadel AI”), which provides an automated quality management system for AI, has started a collaboration with Deloitte Tohmatsu Consulting LLC (Chiyoda-ku, Tokyo, Representative: Yusuke Kamiyama, hereinafter “Deloitte Tohmatsu”), a member of the Deloitte Tohmatsu Group, in the field of AI quality evaluation and monitoring.

With the advent of generative AI, corporate adoption of AI is accelerating, and numerous easy-to-use AI solutions are now available, advancing the “democratization of AI”. Furthermore, AI agents capable of autonomous decision-making and independently managing multiple tasks are expected to become widely adopted this year. AI usage is predicted to expand beyond internal corporate processes to encompass a broader range of activities aimed at not only improving productivity but also creating new business value. However, although awareness of AI-related risks is growing, effective AI risk management practices have not kept pace with AI deployment. As the number of AI models in use expands, manual AI risk monitoring will soon reach its limits, making digitalization and automation of risk monitoring essential.

In response to this situation, Deloitte Tohmatsu has prioritized establishing a comprehensive support system for AI risk management across planning, implementation, and operations, leading to the collaboration with Citadel AI, known for its AI quality evaluation and monitoring technology. Deloitte Tohmatsu has traditionally supported the implementation of AI risk governance by utilizing the “Trustworthy AI™” framework, assisting in everything from policy formulation to operationalizing guidelines, processes, and systems. Through this collaboration, we aim to support companies in efficiently monitoring AI risks while advancing AI utilization in a wide range of domains, addressing challenges faced by enterprises in their AI initiatives.

Under this collaboration, Citadel AI will provide advanced AI quality evaluation and monitoring technologies, including “Citadel Lens,” which automatically validates AI models and data during training to accelerate quality improvement; “Citadel Radar,” which continuously monitors production AI models and data to ensure stable operation; and Lens for LLMs, a comprehensive evaluation tool for large language models.     

We are delighted to collaborate with Citadel AI to offer our clients consulting services that leverage cutting-edge AI quality evaluation and monitoring technologies. This collaboration enables us to swiftly and accurately address the challenges our clients face, helping them establish a competitive edge in the digital and AI-driven era.

Yusuke Yoshizawa, Partner, Deloitte Tohmatsu Consulting LLC

This collaboration with Deloitte Tohmatsu Consulting marks a significant step in enhancing our AI quality evaluation and monitoring offerings. It will enable us to deliver valuable solutions to more clients, accelerating their digital transformation through AI. Together, we aim to contribute to a society where AI can be utilized safely and with confidence.

Hironori ‘Rick’ Kobayashi, CEO of Citadel AI

About Deloitte Tohmatsu Consulting LLC

As a member of Deloitte, we at DTC (Deloitte Tohmatsu Consulting) provide clients with consulting services in Japan. We help clients across the board, from agenda and strategy development through execution. We provide clients with advisory services to help them attain solid and sustainable growth. We also support them and the entire society by solving social issues and creating new industries.

About Citadel AI

Citadel AI provides software products that test and monitor the quality of AI systems. Our technology helps organizations minimize AI reliability risks and maximize AI performance from research to deployment. Citadel AI’s technology is built from our team’s first-hand experience deploying high-risk AI systems at world-leading companies such as Google, Waymo, Toyota, and more.