Rather than ban AI in the classroom, we should teach every student how to build their own evals—turning AI into an object of study and empowering every citizen to test whether AI holds their values.
Great idea! Even if not focused on governance, the basic project of building an eval is the best example I’ve seen yet of an AI literacy task that has relevance & longevity.
The student eval idea is great, but the vision for AI accountability needs an institutional layer to actually work. Like how investigative journalism needs a publication to make its work known. Do you think the next step would be something like GitHub for public evals where anyone can build their own and run them with the results accumulating publicly over time?
This is the way.
Compare/contrast the tools.
Only then can you determine which and how to use them (and for the appropriate task).
Great idea! Even if not focused on governance, the basic project of building an eval is the best example I’ve seen yet of an AI literacy task that has relevance & longevity.
Yeah absolutely! It can be extremely broad
The student eval idea is great, but the vision for AI accountability needs an institutional layer to actually work. Like how investigative journalism needs a publication to make its work known. Do you think the next step would be something like GitHub for public evals where anyone can build their own and run them with the results accumulating publicly over time?