Tweet

“learning from high-quality datasets can mitigate some of the shortcomings of smaller models, maybe even matching the capabilities of large closed-source models in the future. […] enable safer, more factual, and more capable models than simply increasing the size” https://twitter.com/berkeley_ai/status/1643053599390593024

(original)