Recent comments

KD_A OP t1_jegxas8 wrote

Interesting, and I think I know what you mean. One naive idea is a "top-k tokens" system. This system considers the top k highest probability tokens (conditional on previous ones) for each completion token, and for each completion. And then take the sum of the average likelihoods across all k^n (n = # completion tokens) paths for each completion. That would be one way to address this synonym problem. But ofc it results in way more computation.

Edit: actually, thinking a bit more, I think the synonym problem is more-or-less a non-issue for LMs trained to do next-token prediction.

2

kodex1717 t1_jegxajq wrote

I would love to get to the point where I don't use my car for days at a time. I am in the PG suburbs. So, there is enough density to bike places, but the bike infrastructure is just not there for a lot of trips. Most of the roads along the Route 1 Corridor are more like freeways, and a lot of people do try to bike/walk but I'm not that brave.

1

Fozziebear3 t1_jegxaaz wrote

Definitely recommend Merlin as others have said. And then eBird once you get going to track your progress and be a bit more advanced with it!

Otherwise Merlin coupled with a solid pair of binoculars will have you pretty fluent in no time.

2