Evaluating Generative AI Systems: the Good, the Bad, and the Hype

Time: 9:00 am – 5:30 pm ET

Date: Monday, April 15, 2024

We’re bringing together a fantastic program of machine-learning (ML) researchers and engineers, policymakers, lawyers, and civil society for a day of invited talks and panels on the nuts and bolts of generative AI evaluations — where the technology is, what policymakers and civil society say they want from evaluations, and concrete gaps between the two (focused on both misconceptions, and opportunities).

The goal? To go deep on our curated set of topics.

We’re discussing 1) training-data attribution, 2) privacy, 3) data provenance & watermarks, and 4) system refusal — all in response to topics raised in President Biden’s Executive Order.

Each topic will be addressed in pairs of talks: putting an ML expert in conversation with an expert from law or civil society.

The day will also include updates from the U.S. Copyright Office, FTC, U.S. AI Safety Institute (& NIST), and U.K. AI Safety Institute.

Watch Livestream

Please note that this event will be recorded (both video & photography).