Report – Fostering Responsible Tech Use: Balancing the Benefits and Risks Among Public Child Welfare Agencies
CDT report, entitled “Fostering Responsible Tech Use: Balancing the Benefits and Risks Among Public Child Welfare Agencies.” Illustration of an adult hand and a child’s hand, palms up, with a digital image of a home floating above them.
Across the country, child welfare agencies work with over 390,000 youth in foster care each year by temporarily placing them in foster homes, facilitating adoption if parental rights are terminated, and managing their cases. These agencies are tasked with the high-stakes responsibility of ensuring the safety and wellbeing of youth in their care, but face many challenges, such as lack of coordination across agencies that work with foster youth, insufficient or biased data about a child’s environment, and heavy administrative burdens that contribute to high rates of social worker turnover.
To address these issues, child welfare agencies are using, or considering, data and technology systems including artificial intelligence (AI) tools. However, despite the promises that data and technology provide, these systems risk entrenching racial and socioeconomic disparities, stigmatizing foster youth based on social and academic achievement, and compromising the privacy and security of personal data.
This report highlights the ways that data and technology can mitigate some of the problems that child welfare agencies face, while also recognizing their inherent risks. The Center for Democracy & Technology (CDT) offers recommendations to maximize benefits and mitigate the harms, including:
Identifying the problems that data or technology may solve, and the potential harms it could introduce;
Engaging affected stakeholders, from caseworkers to foster youth;
Establishing and/or enhancing inter- and intra-agency data and technology governance to guide decision making;
Implementing and managing AI tools safely and responsibly, and;
Being diligent in vetting third party vendors.
Though these recommendations pertain to all data and technology uses, they are especially important as more and more public agencies are looking to take advantage of AI-powered tools.
Coalition Urges Senate Not to Let Companies Waive Financial Regulations for AI
CDT joined AI Now Institute, American Civil Liberties Union, and several organizations dedicated to tech policy, consumer protection, and civil rights in a letter to Senate leadership and the Senate Banking, Housing, and Urban Affairs Committee opposing the “AI Innovation Labs” language in Sec. 10509 of the CLARITY Act.
As concern about risks and harms related to AI systems continue to grow, a growing chorus of policymakers, industry leaders, and advocates have called for independent AI assessments. This explainer provides an overview of recent proposals for third-party assessment in the United States, including state and federal legislation, executive actions, and industry proposals.
Having third parties assess AI systems might seem like common sense, but crafting effective policies toward this goal can be devilishly tricky. A poorly-constructed ecosystem for third-party assessment could easily fail to consider the most consequential mechanisms of risk, neglect the AI harms that most impact people, or do more to protect AI companies than people.
Not All Guardrails Are Created Equal: Comparing Content Safety and Copyright Filtering
As courts and policymakers work through questions about chatbot liability, they should be wary of analogies that flatten meaningful technical differences. Copyright filtering and safety intervention share real challenges around ambiguity and evasion, but they diverge in what each control must assess, how each manifests over the course of a conversation, and how much can be verified from the outside.
