Arto πŸ‡ΊπŸ‡¦ (@arampacha) profile picture
Kyiv
Joined March 2011
I was mostly using MiniLM for quick baseline and ELECRA-small if I need something really tiny. Ran couple of experiments on SST2, here are the results. Another experiment with MRPC here tinyurl.com/small-lms
1