How Transparent Are AI Models? Stanford Researchers Found Out
VentureBeat, Wednesday, October 18,2023
Stanford University's Center for Research on Foundation Models (CRFM) took a big swing on evaluating the transparency of a variety of AI large language models (that they call foundation models). It released a new Foundation Model Transparency Index to address the fact that while AI's societal impact is rising, the public transparency of LLMs is falling - which is necessary for public accountability, scientific innovation and effective governance.
The Index results were sobering: No major foundation model developer was close to providing adequate transparency, according to the researchers - the highest overall score was 54% - revealing a fundamental lack of transparency in the AI industry. Open models led the way, with Meta's Llama 2 and Hugging Face's BloomZ getting the highest scores. But a proprietary model, OpenAI's GPT-4, came in third - ahead of Stability's Stable Diffusion.