Relying solely on closed models is not inherently safe — they can be breached, misused, or fail in ways outsiders cannot detect — and concentrating advanced AI capabilities behind a small number of closed models compounds that risk into single points of failure, weakened competition, and control by a few providers, whereas open weight models allow a broad community to examine their behavior, identify vulnerabilities, develop safeguards, and improve them over time.

It's clearly an argument designed to counter any instincts by the current US government to ban or limit open weight models over "safety" concerns - a reasonable consideration given what happened to Claude Fable 5! Relying solely on closed models is not inherently safe: they can be breached, misused, or fail in ways that outsiders cannot detect. And concentrating advanced AI capabilities behind a small number of closed models compounds that risk. It results in a small number of single points of failure, weakens competition, and leaves critical technology in the hands of a few providers. Open weight models, on the other hand, allow a broad community of researchers and developers to examine their behavior, identify vulnerabilities, develop safeguards, and improve them over time.

Read full article ↗excerpt · fair-use quotation