Recent comments

KD_A OP t1_jegsqe6 wrote

That's a good criticism. I'd guess that this issue is quite problem-dependent. And I'd hope that an LM is good enough to discriminate between the correct-but-many-synonyms class and the wrong-but-few-synonyms class. (We're using the word synonym, but we really mean "high probability token path given prompt".) It's hard for me to come up with examples where this problem arises in a real classification task. But they may be out there.

2

NonIdentifiableUser t1_jegspod wrote

> The developer has agreed to limit the size of trucks allowed to make deliveries on 19th and to provide a space in the underground parking garage for those deliveries.

One of the things people in opposition to road diets often cite is “what about the delivery trucks?!” This part of the article is a good reminder that not everything has to be delivered via 18 wheeler (I mean it’s literally impossible in many older European cities), and, in fact, the city and other areas would be better off if we didn’t have giant trucks traversing our streets.

8

Simusid OP t1_jegspl8 wrote

VITMAE isn't a generative model. The intent is to use unlabeled data to train the encoder. After that, the decoder is thrown away. Then (in theory) I would use a relatively small amount of labeled data and the encoder with a new head to do traditional supervised classification.

1