Report – Improving Governance Outcomes Through AI Documentation: Bridging Theory and Practice
Executive Summary
AI documentation is a foundational tool for governing AI systems, via both stakeholders within and outside AI organizations. It offers a range of stakeholders insight into how AI systems are developed, how they function, and what risks they may pose. For example, it might help internal model development, governance, compliance, and quality assurance teams communicate about and manage risk throughout the development and deployment lifecycle. Documentation can also help external technology developers determine what testing they should perform on models they incorporate into their products, or it could guide users on whether or not to adopt a technology. While documentation is essential for effective AI governance, its success depends on how well organizations tailor their documentation approaches to meet the diverse needs of stakeholders, including technical teams, policymakers, users, and other downstream consumers of the documentation.
This report synthesizes findings from an in-depth analysis of academic and gray literature on documentation, encompassing 37 proposed methods for documenting AI data, models, systems, and processes, along with 21 empirical studies evaluating the impact and challenges of implementing documentation. Through this synthesis, we identify key theoretical mechanisms through which AI documentation can enhance governance outcomes. These mechanisms include informing stakeholders about the intended use, limitations, and risks of AI systems; facilitating cross-functional collaboration by bridging different teams; prompting ethical reflection among developers; and reinforcing best practices in development and governance. However, empirical evidence offers mixed support for these mechanisms, indicating that documentation practices can be more effectively designed to achieve these goals.
Our report also outlines the design trade-offs organizations must consider when developing and implementing documentation strategies. For example, customized documentation can address specific risks but may reduce comparability across documentation artifacts, whereas standardized formats promote consistency and institutionalize norms of practice but may overlook details relevant to particular systems. Organizations may also face decisions about whether to create a single, general-purpose documentation artifact or multiple tailored artifacts; while the multiple tailored formats may better serve diverse stakeholders, they are more challenging to maintain. Also, organizations must carefully determine the appropriate level of detail to include in documentation artifacts—excessive information can overwhelm users, while insufficient detail may omit critical information. We also explore the trade-offs involved in automating the documentation process and the choice of whether to develop interactive interfaces that allow stakeholders to explore the documentation more thoroughly.
The report concludes with recommendations for designing effective documentation processes. These include realistically assessing an organization’s capacity for implementation, identifying the needs of key stakeholders, prioritizing essential details, and regularly evaluating progress against specific success criteria.
By carefully designing and implementing documentation processes that address the needs of diverse stakeholders, organizations can establish a strong foundation for robust AI system risk management. Moreover, by regularly assessing and refining their documentation practices, organizations can contribute to improved AI governance over time.
Coalition Urges Senate Not to Let Companies Waive Financial Regulations for AI
CDT joined AI Now Institute, American Civil Liberties Union, and several organizations dedicated to tech policy, consumer protection, and civil rights in a letter to Senate leadership and the Senate Banking, Housing, and Urban Affairs Committee opposing the “AI Innovation Labs” language in Sec. 10509 of the CLARITY Act.
As concern about risks and harms related to AI systems continue to grow, a growing chorus of policymakers, industry leaders, and advocates have called for independent AI assessments. This explainer provides an overview of recent proposals for third-party assessment in the United States, including state and federal legislation, executive actions, and industry proposals.
Having third parties assess AI systems might seem like common sense, but crafting effective policies toward this goal can be devilishly tricky. A poorly-constructed ecosystem for third-party assessment could easily fail to consider the most consequential mechanisms of risk, neglect the AI harms that most impact people, or do more to protect AI companies than people.
Not All Guardrails Are Created Equal: Comparing Content Safety and Copyright Filtering
As courts and policymakers work through questions about chatbot liability, they should be wary of analogies that flatten meaningful technical differences. Copyright filtering and safety intervention share real challenges around ambiguity and evasion, but they diverge in what each control must assess, how each manifests over the course of a conversation, and how much can be verified from the outside.
