[[flan t5]] (believe it or not, bearing no relation to #Flancia... yet)
---
RT @amanrsanger
No one is talking about the actual best open-source language model today. It isn't Bloom or OPT, not even GLM-130.
It's an 11B instruction fine-tuned model open-sourced by Google themselves: Flan-T5 11B
And the second best is Flan-T5 3B...
https://twitter.com/amanrsanger/status/1589273062637465602
[[scaling instruction-finetuned language models]] https://arxiv.org/pdf/2210.11416.pdf